Displaying unicode characters

Dear all,
I am currently dealing with a character displaying problem on the MAM.
We will soon go live in China. Until now we only had European countries, with a Latin alphabet.
Now however this changes, so we need to use Unicode to display all characters correctly.
Therefor I have converted all our custom language files to language files with Unicode escape characters.
e.g.:
EQUIPMENTS_EQU_MAT_NR=设备材料号码
Now the strange thing is that when we login in Chinese, everything is displayed correctly, but when we login in German or Polish (countries which also have some special characters), we don't see everything displayed correctly.
This is the code how we display an entry from the language file on the screen:
<%@page language="java" contentType="text/html; charset=UTF-8"%>
meta http-equiv="Content-Type" content="text-html; charset=UTF-8"
<jsp:useBean id="res" class="com.sap.ip.me.api.services.MEResourceBundle" scope="session"></jsp:useBean>
<%=PageUtil.ConvertISO8859toUTF8(res.getString("CONFIRMATIONS_HEADER_DETAIL"))%>
For Chinese language, the characters are displayed correctly in this way.
e.g.: 最后一次同步时间
However Polish characters and German characters are not (always) displayed correctly.
e.g.: Wskaźnik pierwszego usuniÄu2122cia usterki
The only 'difference' that I can see is that for China, every character in the language file has a special Unicode notation, while for Polish and German characters, only the special characters are displayed in special Unicode notation.
e.g.:
  EQUIPMENTS_EQU_MAT_NR=Numer materia\u00c5‚u sprz\u00c4™tu
FYI, I've converted the files to Unicode escape characters with the java util native2ascii.exe.
Is there anyone who knows how to solve this issue?
Thanks already in advance!
Best regards,
Diederik
Edited by: Diederik Van Wassenhove on Jul 6, 2009 2:34 PM

Dear all,
I've found the reason for this problem.
Thanks anyway for your time!
The problem was that when converting the language files to Unicode escape characters, the source format was wrong. The files where saved as UTF-8, but the JAVA tool native2ascii is not taking UTF-8 as standard input format. So the resulting Unicode file was not containing the correct Unicode characters.
I've re-generated the language files with the parameter -encoding UTF-8, and now everything is displayed correctly!
Have a good day!
Diederik

Similar Messages

  • [SOLVED] Conky Not Displaying Unicode Characters Correctly

    I have some music that requires unicode characters in order to be displayed properly. The artist name is Röyksopp, but it is displayed like this:
    http://i.imgur.com/rRBDxZn.png
    Does anyone know how to either make it display correctly (Röyksopp), or at least remove the umlauts to make it almost correct(Royksopp)? I've set the locale, so it displays correctly in both i3bar and urxvt, but it had no effect on conky.
    EDIT: Here is my conkyrc.
    Last edited by ProfessorProcrastinator (2014-05-14 22:50:16)

    x33a wrote:Try a different font.
    I know that this font works because I tried it in urxvt and it displayed correctly.
    Also, I tried "override_utf8_locale yes" and it still was incorrect.

  • Illustrator CS6 is not displaying unicode characters properly.

    I need to access certain unicode characters (namely the x/8 fractions). I have the appropriate font installed, and the characters display in every other program on the machine, but they are not displaying correctly in Illustrator. If I type the characters in using alt codes, the 3/8 character displays as "\", the 1/8 character displays as "[", etc. Is there some setting I need to change to enable support for Unicode characters?
    *UPDATE*
    If I type the character in another program, copy it, and paste it into Illustrator, it shows up as a box with an X through it. If I highlight the box and change the font to one that supports the character, then the character does display correctly. This is, however, quite inconvenient. Is there a way to type the character directly into Illustrator?
    Message was edited by: NovakDamien

    I use the following method...
    Mike

  • How to display unicode characters

    hi
    How could we save, display, write or read Unicode characters.

    Thanks a lot. I fully understand what you have said.
    My test is running under Traditional Chinese "Big5" Windows XP system.
    Chinese "Big5" font can display on a Console window. I can even input Chinese into the console window.
    Or, in another word, I can TYPE a text file which contains "Big5" Chinese characters and show from the Console window. I assume this will prove that the Console window do know how to handle Chinese characters.
    Now, my test is trying to CONVERT a Unicode string into a Chinese character string expecting the resulting Chinese string can be output into the Console window and let the XP Console window to handle the Chinese character display.
    My main concerned question is "How can I CONVERT a Unicode string into a Big5 Chinese character string?"
    String tstr = new String("\u39321\u28207","big5");
    It seems this statement is INCORRECT, isn't it?

  • Display unicode characters?

    When I store "\uXXXX" as string, I cannot get the character. I can get "\uXXXX" only. How do I get the character?
    import java.io.UnsupportedEncodingException;
    import javax.swing.JOptionPane;
    * @author user2
    public class convert {
    public static String convert(String s) {
        // modified from
        // http://www.cngr.cn/article/54/67/2006/2006071933783.shtml
        String unicode = "";
        char[] charArray = new char[s.length()];
    for(int i=0; i<charArray.length; i++) {
        charArray[i] = (char)s.charAt(i);
        unicode+="\\u" + Integer.toString(charArray, 16);
    return unicode;
    // You can convert any characters into \\uxxxx where x is a letter or number
    // * and \\uxxxx represents a character
    public static void main(String[] args) throws UnsupportedEncodingException {
    String nonAsciiString="&#19968;&#20108;&#19977;&#22235;&#20116;&#20845;&#19971;&#20843;";
    String unicodeString=convert(nonAsciiString); // a series of \\uxxxx
    String someUnicodeSeries="\u4e00\u4e8c\u4e09\u56db\u4e94\u516d\u4e03\u516b";
    JOptionPane.showMessageDialog(null,someUnicodeSeries,"",-1);
    // someUnicodeSeries is displayed properly
    JOptionPane.showMessageDialog(null,unicodeString,"",-1);
    // unicodeString does not display "&#19968;&#20108;&#19977;&#22235;&#20116;&#20845;&#19971;&#20843;"
    // How do I make unicodeString display "&#19968;&#20108;&#19977;&#22235;&#20116;&#20845;&#19971;&#20843;"?

    tse2009 wrote:
    When I store "\uXXXX" as string, I cannot get the character. I can get "\uXXXX" only. How do I get the character?Well, first of all, I don't know why you would want to do that. It seems pointless to take a string which is only meaningful to a Java compiler and to try to use it outside that context. It would be far more practical to use an existing encoding to convert the string to bytes, rather than inventing an unsupported encoding which requires extra code to be written and which requires more than twice as much storage as any supported encoding.
    However if somebody has already decided to do that and you are stuck with implementing their decision, then drop the first two characters and use Integer.parseInt(string, 16) on the remainder to convert it from hexadecimal to a number.

  • Safari suddenly doesn't display Unicode characters in fields

    I'm running OS 10.6.3, and I've just upgraded to Safari 4.0.4 (along with the most recent system update).
    Suddenly, in the fields in many web pages, if I insert or type text in other languages, particularly Central European, Safari displays only a blank space where the foreign characters should be. This happens on some sites, but not on others. For example, in this box I can enter ř, ý or ž, and I can see them. However, on other sites (such as Google Translate), I just get those empty spaces.
    This is a totally new problem on my system. I first noticed it in Firefox a couple of upgrades ago, but now the problem has started in Safari with its upgrade. I have gone into preferences and adjusted the fonts for Unicode and Central European, but it doesn't do any good.
    This is a serious problem for me, because my business relies on being able to use foreign languages.
    Thanks for any advice.

    HI,
    I've just upgraded to Safari 4.0.4
    Safari's latest versoin is 4.0.5
    Try deleting the Safari .plist file.
    Go to the Safari Menu Bar, click Safari/Preferences. Make note of all the preferences under each tab. Quit Safari. Now go to ~/Library/Preferences and move this file com.apple.safari.plist to the Desktop. Relaunch Safari. If it's a successful launch, then that .plist file needs to be moved to the Trash.
    Carolyn

  • How to display UNICODE characters in a Widget control

    Hi,
    I am working on a widget. Some of the contents (descriptions) are Chinese.
    How to display these Chinese characters in a Widget control. I am currently using Table as the control for this.
    Thanks in advance.
    Regards,
    Ram.

    You don't need to use CIDFonts and CMaps for Cyrillic (though you can). The crucial thing to realise is that displaying Latin1 (that is, English and related text) leaves you in a very simple corner of PDF. Doing anything with other encodings instantly makes a project more complex, perhaps 10 times more complex. Far eastern fonts perhaps 10 times more complex again.
    The principle is the same for all of them. To use any character you need
    1. A font containing that character. PDF has built in fonts containing Latin1, such as Helvetica, but there is no such luxury for other encodings.
    2. The right (license) to embed the font.
    3. The technical ability to embed the font. In many case this isn't just a case of embedding a file as a stream, but also you need to analyse the tables in the font, and sometimes trim or modify them.
    4. An encoding for the font.
    5. Text streams which use character positions in the encoding to show the text.
    Basically you need to read and read and reread the chapter on text, and its references (such as font formats). This will become your constant friend or tormenter for the many months of the project.
    If you don't like the sound of that, or it doesn't make ecomomic sense to do that, there are many PDF libraries which have taken the necessary months or years to do this.

  • Issue with displaying Unicode Characters returned by a webservice

    Hi, We are developing a mobile application which provides multi language selection (Arabic & English). but we are having an issue with displaying returned JSON which has Arabic text. The output we get is as below. Our .net client throws the following
    exception. Appreciate your kind help and thank you in advance.
    [net_WebHeaderInvalidControlChars]
    Arguments:
    Debugging resource strings are unavailable. Often the key and arguments provide sufficient information to diagnose the problem. See http://go.microsoft.com/fwlink/?linkid=106663&Version=4.7.60408.0&File=System.Net.dll&Key=net_WebHeaderInvalidControlChars
    Parameter name: name”
    Returned JSON:
    https://72.44.81.184/~shababcapital/wp-json/posts?type=news&lang=ar
    Connection ? Keep-Alive
    Content-Type ? application/json; charset=UTF-8
    Date ? Fri, 27 Feb 2015 03:35:43 GMT
    Keep-Alive ? timeout=1, max=100
    Last-Modified ? Thu, 26 Feb 2015 14:43:55 GMT
    Link ? <http://72.44.81.184/~shababcapital/wp-json/posts/131>; rel="item"; title="387 Ù?اعب Ù?Ù?اعبة ضÙ?Ù? فعاÙ?Ù?ات اÙ?تدرÙ?ب اÙ?Ù?ستÙ?ر Ù?اÙ?تشاف اÙ?Ù?Ù?اÙ?ب اÙ?رÙ?اضÙ?Ø©", <http://72.44.81.184/~shababcapital/wp-json/posts/119>;
    rel="item"; title="387 Ù?اعب Ù?Ù?اعبة ضÙ?Ù? فعاÙ?Ù?ات اÙ?تدرÙ?ب اÙ?Ù?ستÙ?ر Ù?اÙ?تشاف اÙ?Ù?Ù?اÙ?ب اÙ?رÙ?اضÙ?Ø©", <http://72.44.81.184/~shababcapital/wp-json/posts/118>; rel="item";
    title="اÙ?جÙ?در Ù?ؤÙ?د استÙ?رار "اÙ?شباب Ù?اÙ?رÙ?اضة" فÙ? دعÙ? Ù?سÙ?رة اÙ?Ù?راÙ?ز اÙ?شبابÙ?Ø©", <http://72.44.81.184/~shababcapital/wp-json/posts/117>; rel="item"; title="اÙ?جÙ?در
    Ù?Ø´Ù?د بدÙ?ر اÙ?Ù?راÙ?ز اÙ?شبابÙ?Ø© فÙ? تطبÙ?Ù? رؤÙ?Ø© Ù?اصر بÙ? Ø­Ù?د فÙ? احتضاÙ? اÙ?شباب", <http://72.44.81.184/~shababcapital/wp-json/posts/55>; rel="item"; title="اÙ?جÙ?در: Ù?دفÙ?ا
    تحÙ?Ù?Ù? أفضÙ? فرص استثÙ?ارÙ?Ø© Ù?Ù?Ø£Ù?دÙ?Ø© اÙ?Ù?Ø·Ù?Ù?Ø© Ù?Ù?بارÙ? اÙ?Ù?شرÙ?ع اÙ?جدÙ?د", <http://72.44.81.184/~shababcapital/wp-json/posts/45>; rel="item"; title="اÙ?جÙ?در Ù?Ø´Ù?د بدÙ?ر
    اÙ?Ù?راÙ?ز اÙ?شبابÙ?Ø© فÙ? تطبÙ?Ù? رؤÙ?Ø© Ù?اصر بÙ? Ø­Ù?د فÙ? احتضاÙ? اÙ?شباب"
    Server ? Apache
    Transfer-Encoding ? chunked
    X-Content-Type-Options ? nosniff
    X-Pingback ? http://72.44.81.184/~shababcapital/xmlrpc.php
    X-Powered-By ? PHP/5.4.24
    X-WP-Total ? 6
    X-WP-TotalPages ? 1

    I originally downloaded it using IE and viewed the content in Fiddler.  Use this code to get the content:
    string url = "https://72.44.81.184/~shababcapital/wp-json/posts?type=news&lang=ar";
    HttpBaseProtocolFilter MyFilter = new HttpBaseProtocolFilter();
    MyFilter.IgnorableServerCertificateErrors.Add(Windows.Security.Cryptography.Certificates.ChainValidationResult.InvalidName);
    HttpClient request = new HttpClient(MyFilter);
    string response = await request.GetStringAsync(new Uri(url));
    MyContent.Text = response;
    Matt Small - Microsoft Escalation Engineer - Forum Moderator
    If my reply answers your question, please mark this post as answered.
    NOTE: If I ask for code, please provide something that I can drop directly into a project and run (including XAML), or an actual application project. I'm trying to help a lot of people, so I don't have time to figure out weird snippets with undefined
    objects and unknown namespaces.

  • Writing Unicode characters to scripting parameters on Windows

    I am trying to read/write a file path that supports Unicode characters to/from scripting parameters (PIDescriptorParameters) with an Export plug-in. This works fine on OS X by using AliasHandle together with the "typeAlias" resource type in the "aete" section of the plugin resource file.
    On Windows I am having trouble to make Photoshop correctly display paths with Unicode characters. I have tried:
    - Writing null-terminated char* (Windows-1252) in a "typePath" parameter -- this works but obviously does not support Unicode.
    - Writing null-terminated wchar* (UTF-16) in a "typePath" parameter -- this causes the saved path in the Action palette to be truncated to the first character, caused by null bytes in UTF-16. It appears PS does not understand UTF-16 in this case?
    - Creating an alias record with sPSAlias->WinNewAliasFromWidePath and storing in a "typePath" or "typeAlias" parameter -- this causes the Action palette to show "txtu&", which does not make sense to me at all.
    The question is: what is the correct scripting parameter resource type (typePath, typeAlias, ... ?) for file paths on Windows, and how do I write to it in such way that Photoshop will correctly display Unicode characters in the Actions palette?

    Hi
    Skip the first (4 or 6 characters) and you'll get the Unicode value.
    regards
    Bartek

  • Displaying unicode chars in title of jdialog

    hello, I am developing application that has several dialogs. For each of these dialogs, I would like to display unicode characters in the title. Can some one please help me out and direct me on what I should to do make this work? All other controls on these dialogs can display i18n text fine, except the dialogs' title and I just can't figure this out. Please help. Thanks in advance.
    Max

    The latest J2RE 1.4.2_03 can display Unicode characters that are not necessarily supported by your host's ANSI character set. Set the font of the frame appropriately, and give it a try with a newer VM.

  • Unicode Characters

    Hello !
    Can anyone please tell me how to avoid the " ? " when trying to display Unicode characters like '\u025A0', '\u25B0' etc from the Geometric Symbols chart ?
    Perhaps there is some way to extend the support for as many coding schemes as needed in order to accomodate the desired characters.
    My computer show support for UTF-16,UTF-16BE,UTF16-LE, UTF-8 but does not shows the proper character for many of the charts I have downloaded for use from www.unicode.org.
    Thanks for helping.
    Nadeem.

    Depends on what you mean by "display" and "show".
    If you are talking about a GUI then all you have to do is to use a font that can render those characters. If you are talking about the system console then you probably can't, as you have no control over the font used there.
    My guess is that you are talking about the system console. Normally when a font can't render a character it displays a rectangular box instead. But when you convert the character to bytes using an encoding that doesn't understand that character, it gets converted to ? instead. That's what is happening to you.

  • URGENT : Viewing HTML files & UNICODE characters

    I do not know how to view HTML files in Java2. I have various HTML files which I would just like to display in the ContentPane of a Dialog Box.
    Please let me know how should I do it.
    Also, I have another question. How do I display Unicode characters like the alpha and the beta even after I know their hexadecimal values? I would like to display them as text on a JLabel. But the intended character doesnt appear. Instead, what appears is a black empty square in its place. Please let me know how to rectify this.

    You can use JEditorPane to display HTML file.You can dislpay alpha and the beta characters by
    jlabel.setText("\u03B1\u03B2");
    where 03B1 is unicode value for alpha and 03B2 is unicode value for beta.
    You can get unicodes for Greek from following link.
    http://www.unicode.org/charts/PDF/U0370.pdf

  • Unicode characters a real challenge??????

    Hello everybody
    I cannot believe it that no one has been able to help me with displaying unicode characters (Arabic letters in particular) I have posted 2 threads no one has answered. I hope that someone out there knows how to handle unicode characters.
    that includes reading and writing them to a file.
    Hope you can help.
    Rana

    Hello Rana,
    Please use this code as a sample. You have to use this code inside of your paint() method.
    String myString = "\u0635\u0634\u0633\u0632\u0631\u0630\u0629\u0628\u0627";
    g.setFont(Font.getFont(Font.FACE_SYSTEM, Font.STYLE_PLAIN, Font.SIZE_MEDIUM));
    g.drawString(myString, (this.getWidth() - (Font.getFont(Font.FACE_SYSTEM, Font.STYLE_PLAIN, Font.SIZE_MEDIUM).stringWidth(myString))), 0, Graphics.TOP|Graphics.LEFT);And you can find the full list of unicode table of Arabic letters at this document:
    http://www.unicode.org/charts/PDF/U0600.pdf
    If you have some troubleshooting, please come back again, we can find a solution.
    Regards,
    Ran

  • The JSP WYSIWYG Editor can't display most Unicode characters

    Eclipse supports display of Unicode characters very well since version 3. However, NitroX couldn't display most most of them. Well, besides characters from other non-Western European languages, NitroX can't even display characters that it's supposed to support. Well, that's what I think so. I mean, when we type the & character, we have the whole list of character entity references amongst which we could find &and; &nabla; &or; &rarr; but which are not displayed correctly. And many more are in this case.
    Is this a feature or a bug? By "feature", it means that we can't get them in free version.

    I have exactly the same problem. I support web pages for 25 European countries. I've not seen Nitrox support any unicode characters. Until M7 answers this question or fixes the editor, you can use the Eclipse editor to see and edit the text.

  • Create HTML file that can display unicode (japanese) characters

    Hi,
    Product:           Java Web Application
    Operating system:     Windows NT/2000 server, Linux, FreeBSD
    Web Server:          IIS, Apache etc
    Application server:     Tomcat 3.2.4, JRun, WebLogic etc
    Database server:     MySQL 3.23.49, MS-SQL, Oracle etc
    Java Architecture:     JSP (presentation) + Java Bean (Business logic)
    Language:          English, Japanese, chinese, italian, arabic etc
    Through our java application we need to create HTML files that have to display unicode text. Our present works well with English and most of the european character set. But when we tried to create HTML files that will display unidoce text, say japanese, only ???? is getting displayed. Following is the code we have used. The out on the browser displays the japanese characters correctly. But the created file displays only ??? in place of japanese chars. Can anybody tell how can we do it?
    <%
    String s = request.getParameter( "txt1" );
    out.println("Orignial Text " + s);
    //for html output
    String f_str_content="";
    f_str_content = f_str_content +"<HTML><HEAD>";
    f_str_content = f_str_content +"<META content=\"text/html; charset=utf-8\" http-equiv=Content-Type></HEAD>";
    f_str_content = f_str_content +"<BODY> ";
    f_str_content = f_str_content +s;
    f_str_content = f_str_content +"</BODY></HTML>";
    f_str_content = new String(f_str_content.getBytes("8859_9"),"Shift_JIS");
    out.println("file = " + f_str_content);
              byte f_arr_c_buffer1[] = new byte[f_str_content.length()];
    f_str_content.getBytes(0,f_str_content.length(),f_arr_c_buffer1,0);
              f_arr_c_buffer1 = f_str_content.getBytes();
    FileOutputStream l_obj_fout; //file object
    //file object for html file
    File l_obj_f5 = new File("jap127.html");
    if(l_obj_f5.exists()) //for dir check
    l_obj_f5.delete();
    l_obj_f5.createNewFile();
    l_obj_fout = new FileOutputStream(l_obj_f5); //file output stream for writing
    for(int i = 0;i<f_arr_c_buffer1.length;i++ ) //for writing
    l_obj_fout.write(f_arr_c_buffer1);
    l_obj_fout.close();
    %>
    thanx.

    Try changing the charset attribute within the META tag from 'utf-8' to 'SHIFT_JIS' or 'utf-16'. One of those two ought to do the trick for you.
    Hope that helps,
    Martin Hughes

Maybe you are looking for

  • Customs export declaration not getting created

    Hello everyone .. i need help of your expertise I am creating billing document on R/3 and we have made it such that the F2 document flows onto GTS and creates a Customs export declaration The issue here is i have created the billing docs but i cannot

  • Web Page Problems in IE 7

    Can someone help me with a probelm? On all my pages there should be a line above the 'Gallery' link on the left side of all the pages which is apparent in all browsers except Internet Explorer separating this link from the stand alone text above it.

  • Check point not completed in oracle 8i

    Hi, in alert log file i found the error like: Thread 1 cannot allocate new log, sequence 216998 Checkpoint not complete Current log# 5 seq# 216997 mem# 0: /oracle5/oradata/metasolv/redo05.log Current log# 5 seq# 216997 mem# 1: /oracle2/oradata/metaso

  • How to turn off spell check

    What do I need to do to remove spell check when typing (turn off and on) as I type messages in different languages

  • WDA: Hide filter - function on ALV

    Hi @ all, does anybody know how to hide filter in ALV - Grid in WebDynpro for Abap? The Class where you can set alv-settings doesn`t have Method to hide filter on ALV. Have anybody an idea? [ Class: IF_SALV_WD_TABLE_SETTINGS ] Best regards, Dennis