Display of ISO8859-1 characters broken in Terminal app?

I've had this issue for years, but never got around to pursuing an answer until now.
I cannot get the Mac Terminal application to display ISO8859-1 characters with
diacritical markings, regardless of the locale and display settings.  It works fine
in xterm.
In Terminal, I get the following output (from an anagram generator I wrote):
  $ a9 -cux 1 orale | head -1
  ??rale!
In xterm, I get what I would expect to get:
  $ a9 -cux 1 orale | head -1
  ¡Órale!
Running the output through od produces the same output in both:
  $ a9 -cux 1 orale | head -1 | od -b
  0000000   302 241 303 223 162 141 154 145 012
The locale is the same in both:
  $ locale
  LANG="en_US.ISO8859-1"
  LC_COLLATE="en_US.ISO8859-1"
  LC_CTYPE="en_US.ISO8859-1"
  LC_MESSAGES="en_US.ISO8859-1"
  LC_MONETARY="en_US.ISO8859-1"
  LC_NUMERIC="en_US.ISO8859-1"
  LC_TIME="en_US.ISO8859-1"
  LC_ALL=
The default set of terminal encodings are enabled, including Western (ISO Latin 1).
Numerous other combinations of locales with C, UTF-8 make no useful difference.
FWIW, I haven't had any problem with this on Linux over the last 15 years, so it's
been easy to ignore the problem on the Mac.  But I'd like to figure it out now.

Hi,
My default Terminal settings in Preferences > Settings > Advanced > Character Encoding is set to 'Unicode (UTF-8)'.
Do you have that option?
John M

Similar Messages

  • Terminal.app and the European Unicode characters?

    Does anyone have the unicode characters working properly in Terminal.app?
    If I try to write in GNU nano 1.2.4 for instance "örrör" it translates into:
    (one empty line)
    örr
    ör
    which isn't certainly right. This is especially awkward when editing an unicode text file where the text then easily becomes more or less garbled. Usually more.
    It doesn't seem to make any difference whether or not I use the Finnish extended (unicode) keyboard layout or the conventional one in nano. If the Terminal.app window preferences are set as UTF-8, it says:
    ?rr
    ?r
    which looks even more garbled.
    In plain bash the characters print like this:
    å = \345
    ä = \344
    ö = \366
    so my mighty apple translates the example string "örrör" as "\366rr\366r".
    Any ideas, anyone?
    PowerBook G4 @ 1.5 GHz   Mac OS X (10.4.4)   1.25 GB DDR SDRAM
    Debian Sarge 3.1 as a slave fetchmail server.

    Hi solarflare,
       My first (and essentially only) language is English as well. However enough folks have asked that I have experimented with multibyte characters. There are so many apps and options involved, it's difficult to get consistent results. However, I'll recount as many settings as I can recall.
       To begin with, you are right about the LC settings. It helps many apps to have:
    export LCALL=enUS.UTF-8
    export LANG=en_US.UTF-8
    set in your shell startup scripts. Then the system should be set to produce unicode when you type. In the "Input Menu" tab of the "International" pane of "System Preferences", you should select a unicode keyboard layout, such as U.S. Extended.
       To configure the Terminal, you need to open the "Terminal Inspector" by selecting "Window Settings..." in the "Terminal" menu. To type many multibyte characters, you need the option key. To use it, you must have the "Use option key as meta key" checkbox unchecked, although I find the meta key too important in UNIX to leave that unchecked. In the dropdown menu in the "Display" pane of the "Terminal Inspector", you should set the "Character Set Encoding" to "Unicode (UTF-8)". In the "Emulation" pane of the same window, you must uncheck the "Escape non-ASCII characters" checkbox. That is important as I've read that it is checked by default and that can produce some pretty strange results.
       Now it's helpful to use a very modern shell. For instance, the latest beta version of zsh-4.3 has the best unicode support of all versions of zsh. After you've chosen a good shell, you're at the mercy of the application that you're using. As I gather you've noticed, vim has excellent unicode support and picks up on the LC settings. I have no idea about nano but it is meant to be a minimal text editor.
       I know that my settings allow me to type extended characters and the "Character Palette" lets me insert more. As far as other command line utilities go, the best you can do is to choose well and keep your apps as up-to-date as possible. Fink or Darwin Ports can often help in that regard.
    Gary
    ~~~~
       This generation doesn't have emotional baggage.
       We have emotional moving vans.
             -- Bruce Feirstein

  • Urxvt can't display certain Unicode arrow characters

    For some of the arrow characters in Unicode, specifically the codepoints 2900 to 2AFF, urxvt shows slim boxes, but for other characters it works.
    I am using a font that supports the glyphs, gnu unifont from the bdf-unifont package.
    Here is my .Xresources and Urxvt compile options
    *background: #002b36
    *color0: #073642
    *color1: #dc322f
    *color10: #586e75
    *color11: #657b83
    *color12: #839496
    *color13: #6c71c4
    *color14: #93a1a1
    *color15: #fdf6e3
    *color2: #859900
    *color3: #b58900
    *color4: #268bd2
    *color5: #d33682
    *color6: #2aa198
    *color7: #eee8d5
    *color8: #002b36
    *color9: #cb4b16
    *cursorColor: #93a1a1
    *fadeColor: #000000
    *fading: 20
    *foreground: #93a1a1
    *pointerColorBackground: #586e75
    *pointerColorForeground: #93a1a1
    URxvt*boldFont: -*-Unifont-*-*-*-*-*-*-100-100-*-*-*-1
    URxvt*boldItalicFont: -*-Unifont-*-*-*-*-*-*-100-100-*-*-*-1
    URxvt*borderLess: false
    URxvt*buffered: true
    URxvt*cursorBlink: true
    URxvt*font: -*-Unifont-*-*-*-*-*-*-100-100-*-*-*-1
    URxvt*hold: false
    URxvt*intensityStyles: false
    URxvt*iso14755: false
    URxvt*iso14755_52: false
    URxvt*italicFont: -*-Unifont-*-*-*-*-*-*-100-100-*-*-*-1
    URxvt*letterSpace: 1
    URxvt*mapAlert: true
    URxvt*mouseWheelScrollPage: true
    URxvt*perl-ext:
    URxvt*perl-ext-common: default,matcher,selection-to-clipboard,theme-switch
    URxvt*print-pipe: cat > $HOME/$(echo urxvt.dump.$(date +'%Y%M%d%H%m%S'))
    URxvt*saveLines: 0
    URxvt*scrollBar: false
    URxvt*scrollBar_floating: false
    URxvt*scrollBar_right: false
    URxvt*scrollTtyOutput: true
    URxvt*scrollWithBuffer: true
    URxvt*scrollstyle: plain
    URxvt*secondaryScreen: true
    URxvt*secondaryScroll: true
    URxvt*urgentOnBell: false
    URxvt*url-launcher: /usr/bin/firefox
    URxvt*utmpInhibit: false
    URxvt*visualBell: false
    Xft.antialias: 1
    Xft.autohint: 0
    Xft.dpi: 107
    Xft.hinting: 1
    Xft.hintstyle: hintfull
    Xft.lcdfilter: lcddefault
    Xft.rgba: rgb
    rxvt-unicode (urxvt) v9.21 - released: 2014-12-31
    options:perl,xft,styles,combining,blink,iso14755,unicode3,encodings=eu+vn+jp+jpext+kr+zh+zhext,fade,transparent,tint,pixbuf,XIM,frills,selectionscrolling,wheel,slipwheel,cursorBlink,pointerBlank,scrollbars=plain+rxvt+NeXT+xterm
    Anyone have any idea what's going on?

    I can confirm the odd character display. Xterm will display the problem Unifont characters, but there are column alignment problems at all but a few point sizes.  Many of the glyphs require two columns, but I don't know what difficulties that presents for font designers or terminal emulator programmers.
    Very few monospace fonts include these seldom used arrow symbols. If you truly need the arrows, you might try Everson Mono or Code2000 from the AUR. They include some of the glyphs in the problem range.

  • Terminal.app won't display OpenType fonts (.otf)

    Where the characters should be, blanks are displayed. This is a serious problem for me because, while I use Monaco in my terminal, the fallback font for Japanese characters is Hiragino, which is an OpenType font: as a result, Japanese text is not visible in my terminal.
    Here is a screenshot: http://i.imgur.com/wlNPV.png
    Note that, since I set the system's language to Japanese, most of the text in Terminal's preferences is also invisible.
    The problem only seems to occur in Terminal.app, and does not affect other users on the same machine (I tried logging in as guest). It occurs with all OpenType fonts I tried, not just Japanese ones.
    Strangely, if I delete Terminal's preferences, the problem almost disappears (except that it still says ル in the window's title bar instead of ターミナル); however, if I close and relaunch Terminal, the problem immediately reoccurs, even though the preferences file is pristine.
    I tried resetting the ATS cache (atsutil databases -remove) and restarting in safe mode, but the problem still occurs. I've tried googling around, and I found some other people mentioning the same problem, but no solution. Can you help?

    I've got the same problem with my new MBP 2011 with Snow Leopard and it really annoys me as I'm dealing with multilingual texts every day.
    What surprises me is that I had no problems at all since MacOs 10.1 and now it appears in 10.6 !
    Back in the old days I had to put a .inputrc file for displaying Japanese characters but that was not a big deal.
    When I create a new account, it works for a few hours (Japanese characters display well even with menlo or courier fonts set as default). But after a few manipulations here and there (that do not seem related to terminal or fonts like setting my iTunes account) and a couple of reboots, the problem reappears again, ie the Japanese characters do not display again.
    I can temporarily solve the problem by using the Osaka font but 1 it is not nicely displayed with irregular spaces between characters and 2 when I want to display other characters (thai, khmer or whatever), I have to change the default font again. This is a real pain in the neck.
    I read in another thread that there is a solution to convert the OpenType Font you wish to use into a TrueType font but it is not a solution for me neither as there is no existing font that covers all the unicode characters.
    Is Apple aware of this bug? Did they acknowledge that there is a problem?
    If someone finds a solution, I'll be really happy.

  • How to display more than 132 characters in a smartform

    Hi Experts,
    I am reading notes/text entries by calling read_text and then passing them in a variable. I want to display the notes. But even after declaring the variable as  LINE2048, it is displaying only 255characters as output length in smartform.
    My code:
    TYPES: BEGIN OF TYP_FINAL,
             PARTNER_NO      TYPE BU_PARTNER,         "Partner No.
            OBJECT_ID       TYPE CRMT_OBJECT_ID_DB,  "Object ID
            PROCESS_TYPE    TYPE CRMT_PROCESS_TYPE,  "Activity Type
           ACTUAL_NOTE     TYPE LINE2048,           "Actual Notes
           END OF TYP_FINAL.
    data : T_FINAL           TYPE STANDARD TABLE OF TYP_FINAL,
              WA_FINAL          TYPE TYP_FINAL.
    data:  v_actualnote     TYPE LINE2048.
              CALL FUNCTION 'READ_TEXT'
                EXPORTING
                 CLIENT                        = SY-MANDT
                  ID                            = C_0002
                  LANGUAGE                      = sy-langu
                  NAME                          = l_name1
                  OBJECT                        = C_BUT000
                TABLES
                  LINES                         = t_line
               EXCEPTIONS
                 ID                            = 1
                 LANGUAGE                      = 2
              IF SY-SUBRC = 0.
               clear: v_accountnote.
               LOOP AT T_LINE INTO WA_LINE.
                 CONCATENATE v_accountnote wa_line INTO v_accountnote SEPARATED BY space.
                 clear: wa_line.
               ENDLOOP.
              wa_final-account_note = v_accountnote.
              clear: v_accountnote.
             ENDIF.
    On the smartformm side, under main window->loop->text(to display the variables).
    How to display more than 255 characters in a smartform.
    Regards,
    Sangeeta.

    why the heck would you use read_text when you want to print a text/note on a form?
    in SAP-Script we use the "INCLUDE"-Statement for this.
    and in smartforms a Text-node of type 'I'.
    you can not write all in one line and expect the system to handle this like a floating text.
    one character takes a cretain amount of space (varying for different characters and font and font sizes).
    you Page has a certain width, so where is the miracle in the thesis that on a sheet of paper with a certain width just a certain amount of characters will fit?

  • Display more than 255 characters in SAP 4.6c version.

    Hi
    Can anyone tell me how to display more than 255 characters in the spool log  of sap or the application server?
    Thanks in advance.
    Geeta

    Hi,
      You have to have some patch.Pls refer to SAP oss notes 626010.
    Pls reward if useful.
    Sushil.

  • ABAP Programming to display more than 255 characters in the screen

    Hi
       I want to display more than 255 characters in the screen after executing a report but i cant able to do that.
    Please help me to find out the solution.
    Thanks
      Mrutyunjaya Trpathy

    Hai tripathy,
    when the output of a report contains columns extending more than 255 characters in length.  In such cases, this set of ALV functions can help choose selected columns and arrange the different columns from a report output and also save different variants for report display. This is a very efficient tool for dynamically sorting and arranging the columns from a report output. The report output can contain upto 90 columns in the display with the wide array of display options.
    The commonly used ALV functions used for this purpose are;
    1.REUSE_ALV_VARIANT_DEFAULT_GET
    2.REUSE_ALV_VARIANT_F4
    3.REUSE_ALV_VARIANT_EXISTENCE
    4.REUSE_ALV_EVENTS_GET
    5.REUSE_ALV_COMMENTARY_WRITE
    6.REUSE_ALV_FIELDCATALOG_MERGE
    7.REUSE_ALV_LIST_DISPLAY
    8.REUSE_ALV_GRID_DISPLAY
    9.REUSE_ALV_POPUP_TO_SELECT
      hope u can try in this way.
    REGARDS,
    PRABA.

  • Display both Arabic & English characters in the same BO report or not

    Hi
    Can  we display both Arabic & English characters in the same BO report or not?
    if yes what will be the character settings/changes required.
    thanks and regards
    thomas
    Edited by: yeldhot on Aug 23, 2010 4:04 PM

    Kglad - I'm not sure I follow your instructions for the fix. I assume you want me to set the _visible property to false via Actionscript ( textInvisible._visible = false; ). What is the purpose of this second text field - does it need any specific content in it to function? It doesn't seem to work to fix the problem but maybe I'm misunderstanding.

  • 10.5.7 - broken terminal.app on 2xMac's

    Since installing 10.5.7 on both my Macbook Pro's, terminal.app no longer works.
    It displays in the applications folder with the standard "A" application icon, as if the package contents or something is missing, and it doesn't launch.
    I've done some searching and not found much, other than one other post on a forum suggesting another person had the issue which was fixed by resetting the PRAM. This hasn't worked for me.
    I have reset permissions on the OS volume, also no luck.
    Any suggestions? Has anyone else experiences this?
    Darren

    I did use the combo update - primarily because I then only have 1 download for both machines - so not for any other reason, though of course I read frequently that it's the best thing to do.
    I 'had' moved terminal to the root of applications, but moved it back to utilities and re-installed 10.5.7 and it still didn't work.
    Last night I restored terminal.app from time machine backup taken just before the original 10.5.7 update. I guess I can now try the 10.5.7 again, with the terminal.app being in the utilities folder now. Not overly confident it will work but I will do it today and report back.
    Thanks for your responses!
    Darren

  • Itunes just started displaying menus in asian characters.  How can I get back to english?

    Itunes just started displaying menus in asian characters.  How do I get them back to english?

    iTunes: Changing the display language - http://support.apple.com/kb/HT2242 - "Follow the steps below to change the language displayed in iTunes and also the language displayed in the iTunes store."
    Above method did not work but reinstalling iTunes did - https://discussions.apple.com/thread/6798898

  • Is it possible to use NUMCHARS to display the number of characters in a block of text instead of the whole document? How?

    Is it possible to use NUMCHARS to display the number of characters in a block of text instead of the whole document? How?

    Getting the character count for a paragraph is trivial:
    Sub NumChars1()
    MsgBox Selection.Paragraphs(1).Range.Characters.Count
    End Sub
    Even outputting it to the document is trivial:
    Sub NumChars2()
    With Selection.Paragraphs(1)
      .Range.InsertAfter .Range.Characters.Count
    End With
    End Sub
    The real issue comes when you want to update the document. If the destination paragraph is only ever empty or contains the character count of the previous paragraph, you could use:
    Sub NumChars3()
    With Selection.Paragraphs(1)
      .Next.Range.Text = .Range.Characters.Count & vbCr
    End With
    End Sub
    Cheers
    Paul Edstein
    [MS MVP - Word]

  • Hi, I have a Apple A1083 Cinema Hd Display 30" Widescreen with a broken lcd, where can I get the replacement part ?

    Hi, I have a Apple A1083 Cinema Hd Display 30" Widescreen with a broken lcd, where can I get the replacement part ?

    Hi, I have a Apple A1083 Cinema Hd Display 30" Widescreen with a broken lcd, where can I get the replacement part ?

  • ANSI Colors in Leopard's Terminal.app

    Has anyone figured out a way to customize the ANSI colors in the Leopard Terminal? The TCColorArray plist setting seems to be ignored.
    I've even gone so far as to copy the Terminal.app from Tiger onto Leopard. Still no go, even Tiger's terminal is ignoring TCColorArray when running on Leopard (which I find very strange).
    Could this be a termcap issue?

    The following will rid your Terminal of blue directory listings:
    1. Add the following to ~/.profile :
    alias ls='/bin/ls -G'
    export LSCOLORS=exfxcxdxbxegedabagacad
    2. Change the color(s) displayed by `ls` considering the following:
    For each pair of characters in the string 'exfxcxdxbxegedabagacad', the first character in the pair represents the foreground color, the second character in the pair represents the background color. Changing the character changes the color; see the following chart:
    a black
    b red
    c green
    d brown
    e blue
    f magenta
    g cyan
    h light grey
    A bold black, usually shows up as dark grey
    B bold red
    C bold green
    D bold brown, usually shows up as yellow
    E bold blue
    F bold magenta
    G bold cyan
    H bold light grey; looks like bright white
    x default foreground or background
    Each character pair in the string 'exfxcxdxbxegedabagacad' represents a type of file displayed by `ls`. The breakdown of character pairs follows:
    Pair 1 (ex) - directories
    Pair 2 (fx) - symbolic links
    Pair 3 (cx) - sockets
    Pair 4 (dx) - pipes
    Pair 5 (bx) - executable files
    Pair 6 (eg) - block special
    Pair 7 (ed) - character special
    Pair 8 (ab) - executable with setuid bit set
    Pair 9 (ag) - executable with setgid bit set
    Pair 10 (ac) - directory writable to others, with sticky bit
    Pair 11 (ad) - directory writable to others, without sticky bit
    So, following this through to conclusion, the following is the list of default color pairs:
    ex - blue/default - directories
    fx - magenta/default - symbolic links
    cx - green/default - sockets
    dx - brown/default - pipes
    bx - red/default - executable files
    eg - blue/cyan - block special
    ed - blue/brown - character special
    ab - black/red - executable with setuid bit set
    ag - black/cyan - executable with setgid bit set
    ac - black/green - directory writable to others, with sticky bit
    ad - black/brown - directory writable to others, without sticky bit
    Finally, to change the listing of directories from blue to cyan, change the first character pair (ex) to (gx) in .profile :
    export LSCOLORS=gxfxcxdxbxegedabagacad
    3. To have the color change take effect, quit and restart Terminal, or run the following command:
    . ~/.profile
    Message was edited by: Apple Scruffs

  • Unwanted minuscule ø in terminal app

    Since some time (probably since I migrated from my PB Titanium) terminal app shows a strange behavior. When typing or otherwise displaying special sequences of characters. E.g., when typing "o/" the miniscule ø is displayed (I hope this is displayed properly in the posting) like when tying "Option-o" on the keyboard. A similar effect happens when typing "l/". This is especially annoying when displaying directory paths.
    I have tried to play around with the terminal settings without success. Any idea why this happens and how to get rid of this "feature"
    Regards
    Stefan

    You should have a look at the input managers in your private or the system-wide library.
    It's most likely the font. Some earlier threads I found:
    http://discussions.apple.com/thread.jspa?messageID=2007290&#2007290

  • Terminal App choices

    There are two features Apple's Terminal lacks that drive me crazy, tabs and the ability to define a list of characters considered part of a word when double clicking.
    iTerm can do both of these things and I really like it, but there are some serious display problems. For example, if you are typing a command that wraps onto a second line and then delete some characters from the first line, the second line doesn't also back up. Sometimes weird things will happen where your cursor will end up a couple of lines above the actual prompt. I am constantly dealing with long paths and filenames that stretch across multiple line, so these diplay problems have made me go back to Apple's Terminal. When this problem is fixed iTerm will be great.
    But for now... Does anyone know of a way to add characters that the Terminal will consider part of a word?
    Is there any other terminal program out there that I've missd?
    Thanks!

    iTerm has both features. I use it exclusively, and have for years. I've also written some scripts to set the tabs to the $PWD and penultimate directory.
    I decided to read the rest of your post. Sorry. Anyway, I think you can get around this problem (which I have never seen) by setting the terminal type to ansi.
    If all else fails, contact the developers. They've added and fixed things for me, and are very quick with updates.
    There are a number of tabbed terminals that run under X11, including kterm (or whatever the KDE terminal is called), the gnome one, mrxvt, multi-aterm all have tabs.

Maybe you are looking for