Display of CJK

Hi All:
I am using test1.jsp to accept any CJK/latin character and display it
in test2.jsp. test1.jsp uses post method and has only one text box.
test2.jsp does a request.getParameter(...) to display it. The browser's
encoding is set to unicode UTF-8. But test2.jsp is not displaying the
japanese / CJK chars properly although the charset is explicitly set to
UTF-8 via <meta> http tag as well as via <@page contentType="text/html; charset=UTF-8"%>
Any comments.
Regards
Sanjay.

Take a look at a previous thread:
http://forum.java.sun.com/thread.jsp?forum=16&thread=179441
Regards,
John O'Conner

Similar Messages

[SOLVED] Xterm Japanese/Unicode Characters not displaying (??) instead

Hey,
So I'm new to linux and arch and I've made a point of reading every relevant thread posted when I searched for 'Japanese terminal' and I haven't been able to get my terminal to display Japanese characters. All I see are ?????.
This is my /etc/locale.config
LANG=en_CA.UTF-8
LC_COLLATE=C
This is the output from running:
$ locale
LANG=en_CA.UTF-8
LC_CTYPE="en_CA.UTF-8"
LC_NUMERIC=\"en_CA.UTF-8\"
LC_TIME=en_CA.UTF-8
LC_COLLATE=C
LC_MONETARY=\"en_CA.UTF-8\"
LC_MESSAGES=C
LC_PAPER=\"en_CA.UTF-8\"
LC_NAME=\"en_CA.UTF-8\"
LC_ADDRESS=\"en_CA.UTF-8\"
LC_TELEPHONE=\"en_CA.UTF-8\"
LC_MEASUREMENT=\"en_CA.UTF-8\"
LC_IDENTIFICATION=\"en_CA.UTF-8\"
LC_ALL=
This is the output from running:
$ locale -a
C
POSIX
en_CA.utf8
en_US.utf8
ja_JP.utf8
This is my ~/.Xresources file:
! Name
Xterm*termName: xterm-256color
! Font style
xterm*faceName: xft:monospace:size=11
xterm*faceNameDoublesize: xft:Droid Sans Japanese:style=Regular
xterm*utf8: 2
! Window size
xterm*VT100.geometry: 100x40
! No more bell
xterm*vbell: True
! Scrollback
xterm*savelines: 4096
! double-click to select whole URLs :D
xterm*charClass: 33:48,36-47:48,58-59:48,61:48,63-64:48,95:48,126:48
! Scrollbar
xterm*rightScrollBar: false
xterm*ScrollBar: false
! Foreground & background
*background:#293b3b
*foreground:#bf6e63
!terminal colours----------------------------------------------------------------------
!http://www.xcolors.net/dl/fishbone
!black
*color0:#293b3b
*color8:#344040
!red
*color5:#bf5357
*color13:#bf6367
!green
*color2:#41a551
*color10:#51a55f
!yellow
*color3:#aea64f
*color11:#aea75d
!blue
*color4:#416ea5
*color12:#5177a5
!magenta
*color1:#bf6053
*color09:#bf6e63
!cyan
*color6:#714da5
*color14:#7859a5
!white
*color7:#876868
*color15:#876f6f
Also, when I trying inputting text into xterm using ibus's anthy, nothing gets entered, and I'm assuming that is related to the problem of not being able to view the Japanese characters properly
I'm really not sure where I'm going wrong, but it's driving me nuts and any help would be greatly appreciated.
Last edited by Bipolarbearz (2014-12-24 03:24:40)

Your default xterm font is DejaVu Sans Mono. I don't know how scim and anthy may complicate setting up a locale but you do appear to have something oddly configured.
Your output from the bare locale command shows backslashed double quotes. My output shows no backslashes:
$ locale
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE=C
LC_MONETARY="en_US.UTF-8"
-- snip --
LC_ALL=
The only line I have uncommented in /etc/locale.gen is:
en_US.UTF-8 UTF-8
The only possibly significant difference between your xterm settings and mine is the way we set xterm to use UTF-8. I have:
⁣ XTerm*locale: true
You have:
⁣ xterm*utf8: 2
I think they may just be different methods that reach the same end when you only have UTF-8 locales installed. I can get the Droid glyphs to display using either resource setting.
If I were in your shoes, I would work through the Archwiki's Locale page, step by step, to see if I could silence the warnings.
If the warnings still appeared, I would step back, and do things one step at a time. If you uninstall anthy, or scim-anthy, and regenerate your locales, do the warnings disappear? Does xterm display the CJK glyphs? If not, does regenerating the locales using only en_CA.UTF-8 work?
I wish I could offer more help but I don't have the knowledge to offer more.
If you want to see which installed fonts say they have Japanese language support, use this command:
fc-list ':lang=ja'
Do note that what a font advertises and what you and I would call language support may be different.

Display CJK web page

Hi;
When I write html for a Chinese/Japanese/Korean web page - a couple of questions:
1) What charset encoding should I use - both if it's all 1 language and if it's mixed?
2) What header settings should I set for language, charset, & locale?
thanks - dave
ps - I realize this is a Java, not html forum but I'm writing the html from Java and I figured someone here would know.

UTF-8 will definitely cover all 3 of these. iIn the header for your web page, just put in:
<html><head>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=UTF-8">
... other header fields go here ...
</head>
Then instert all the text using an editor that can produce UTF-8...jedit works pretty well. The only drawback is that older web browsers might not support UTF-8.
It is possible that one of the other far east char sets (like big5, one of the iso2022 variants, etc.) would be better supported and would cover all 3 languages that you want, but I don't know for sure if any of them do.

Non-english character display as square box

Hi all,
I'm not very sure if this question should be asked here or in the JRE board, thus I'm trying here also
I have been trying an opensourced application called Alliancep2p (could be obtained from www.alliancep2p.com) using JRE 1.6 on an English Windows XP Pro machine.
The problem:
all chinese input are displayed as "square box". It looks like the programme "gets" the correct character, only that everything is displayed as "square box".
It looks like a font issue, though I'm not that sure. Is there anyway the default fonts could be changed, or to get the characters correctly displayed?
Note: I have east asian fonts installed, and the Java config panel can display chinese or other non-english characters correctly.
I tried the same application under GNU/Linux (locale is UTF-8) and chinese input/display correctly without any problem at all. Does it mean that it is not the problem of the application, or?
The original question in the JRE board:
http://forum.java.sun.com/thread.jspa?threadID=5265369&tstart=0
Thanks for all the input.

I'm not really sure if it's a problem of the application or not. But the fact that it works perfectly under Linux makes me think maybe it's not the problem of the program, and actually their developers said that unicode is being used all over the program and seems like they're not CJK users also.
I'm not a java guru so I can't really tell from the source if there's anything wrong.

CJK characters in xml element name

Hi People,
I have a question as it looks like I am doing something wrong, but I do not know what.
I am trying to use CJK characters in the element name of an xml document and the element names are encoded/parsed using the default encoding and not the encoding specified at the xml document.
This is the specific code
     ByteArrayOutputStream baos = new ByteArrayOutputStream();
     Document document = DocumentBuilderFactory.newInstance().newDocumentBuilder().newDocument();
     document.appendChild(document.createElement("\ub3c4\uba54\uc778"));
     TransformerFactory tFactory = TransformerFactory.newInstance();
        Transformer transformer = tFactory.newTransformer();
        transformer.setOutputProperty(OutputKeys.ENCODING, "UTF-8");
        transformer.transform(new DOMSource(document), new StreamResult(baos));
        System.out.println(new String(baos.toByteArray(), "UTF-8"));
        System.out.println(new String(baos.toByteArray()));(you have to run this on a system that does not have UTF-8 as the default locale :-)
The result of this is
<?xml version="1.0" encoding="UTF-8" standalone="no"?><???/>
<?xml version="1.0" encoding="UTF-8" standalone="no"?><도메인/>
So the encoding of the element name is not UTF-8 but the default encoding.
Just in case someone ask
$ java -version
java version "1.6.0_05"
Java(TM) SE Runtime Environment (build 1.6.0_05-b13-120)
Java HotSpot(TM) 64-Bit Server VM (build 1.6.0_05-b13-52, mixed mode)
Thanks,
Lucas

Hi Alpha.23,
well I'm not sure, and maybe I'm totally wrong, but here is what I think about your problem.
As there is no error while running the code, there should be no XML problem (so the characters you are using are XML compatible for tag names).
I think the problem is the ability of any computer to display such chars. The questionmark often indicates that there is a char which cannot display correctly. This depends partitially on the font your are using.
If I try to display the chars with simple System.out.println("\ub3c4\uba54\uc778"); I get those question marks too. So I guess the console of my IDE (eclipse) can't display these Korean symbols. But I haven't installed the specific language-support for any of the Asian languages (so I don't know what happend when they are installed, though I guess that doesn't solve the problem...).
So my tip is first to look for a way to print these char in general (on the console, into a file, maybe try to create a word document because a unicode font -i.e. Arial Unicode- is able to print these - try ALT+47700 or ALT+46020).
Best Wishes
esprimo

Chinese/Japanese/Korean characters do not display ...

Hi there,
I recently noticed that no characters show up on Skype at all, they appear only as squares, however if I copy and paste these into a different program, then the characters are displayed. This is obviously a display problem which is specific only to Skype, any suggestions? I've tried uninstalling and reinstalling in Chinese, but even on the install screen, only the header bar displayed correctly, everything within the program displayed only as squares. Also changed font to an Asian font which I use when typing Chinese, but still no success.
Solved!
Go to Solution.

smithintaiwan wrote:
Hi,
I had a similar problem after updating. Oddly enough, having an Asian font made things worse. This seems to be an issue for people using multiple Asian languages.
A quick fix that worked for me was to change the IM font to Arial Unicode. To do that I had to click on the "Display More Fonts" button and change the Arial Unicode font to "show" in the Control Panel window that opened. Back in Skype I had to close and reopen the "Options" "IM fonts" window and then select the newly available Arial font.
Now CJK all display correctly, but they're not quite as pretty as they were.
Hope this works.
Craig
This solution worked for me. However, I hope the skype dev team comes out with a fix for this consistent problem.

Displaying/reading multilingual characters

(1) how do you display universal characters in their native character sets? i have a multilingual file containing
chinese, japanese, Korean and english characters (there may be different/more languages). This file is encoded in unicode for development purposes.I need to display these in their proper native glyphs. Problem i encountered was choosing the right font.properties, for e.g. when i use font.properties.ko , korean fonts are display properly but chinese/japanese are not...and when i use font.properties.ja then korean characters are displayed as black boxes.
(2) Given a InputStream containing multi-lingual charactes such as CJK and english, is there a way to find out the locale of the character set. I need this so that numeric information is displayed in the proper local.
i'm using JDK 1.3 on windows 2000 sp2.
any help is greatly appreciated.
thanks

(1) Since the data is already in Unicode, just get a font that can display all unicode characters. Arial Unicode MS is one such font.
(2) Not without some processing.

On some websites, some characters load as only boxes with four numbers/letters in them. What is this, and how do I get it to display the characters properly?

Several pages will display characters as only boxes with four letters in them. I would like it to display all the characters.

See my posts in this thread: [/questions/766381]
Pages that use Unicode (UTF-8) display a little box with the hex code if the character can't be displayed. That allows you to look up the character in a table.
This can be caused by missing font support for East Asian (CJK: Chinese, Japanese, Korean) or complex script (Indic) languages.

Acroread 8.1.2 cannot display some Japanese documents

For details and a test .pdf file see:
http://bugzilla.novell.com/show_bug.cgi?id=376856
acroread 8.1.2 cannot display some Japanese documents although
the Japanese font package and the CMaps are installed.
Checking which fonts are used in the testfile ~RubiJapanese.pdf~:
mfabian@magellan:~/test-texts/pdf/japanese$ pdffonts RubiJapanese.pdf
name type emb sub uni object ID
MS-Mincho CID TrueType no no no 10 0
Arial-Black TrueType no no no 14 0
Arial-BlackItalic TrueType no no no 15 0
mfabian@magellan:~/test-texts/pdf/japanese$
I.e., this document uses the ~MS-Mincho~ font which comes with
Microsoft Windows. It is not embedded, therefore Acroread has to
search for it on the system and if it cannot find it it should replace
it with a fallback Japanese font.
I have this font installed on the Machine where I am testing but
acroread fails to use it, complains about missing CJK support
(which is not true) and displays only dots instead of Japanese
characters.
You can get the test document from the above mentioned
bugreport, it is attached to comment #1:
http://bugzilla.novell.com/show_bug.cgi?id=376856#c1

Neha,
Thanks for the response.
We are running acroread headlessly since it is on a remote server that we access via telnet. Without an XServer session, I can't tell whether acroread is able to read and display the PDF files normally. However, we can view the PDFs with Adobe Reader 8.1.2 on Windows and the acroread -toPostScript command-line that we are using does work properly with other PDFs.
I will email you a copy of a problematic PDF shortly.
Regards,
Steven Dickson

Display Chinese Language

In the struts-config.xml I set
<message-resources parameter="test.view.TestResources_zh_cn"/>
The TestResources_zh_cn.properties file contains the Chinese characters for the keys. Next I go to the Internet Explorer to set the language to Chinese[zh-cn] by moving it to the top of the list. But when I run my web app, the keys (labels) in JSP page are not displayed in Chinese, but in ??.
How can I solve the problem
Thanks
Scott
I did set the following in the JSP page:
<%@ page contentType="text/html;charset=GB2312" %>
<% request.setCharacterEncoding(GB2312); %>

Well for CJK support i mean chinese japanese korean language u need to have propelry translated Unicode Strings and hw r u using it ..i mean u r writing smothing on one system n using or its client server thing..let me know details so can hv more specific detail.

Vim not displaying CKJ text

even though vim is compiled with multibyte support and multilang, most of the Japanese, or Korean text is displayed as question marks, tildas, and other symbols. Some parts of the text are displayed correctly.
Any where i should look to make changes?
Thanks
Sample of Chinese text in vim
?~L~W京奧?~A~K?~\~C?~A~V?~A??~@~L祥?~[??~@~M?~J?~M~H?~\??~Q??~R~L浩?~I??~B?~B??~A~^? ~L?~@~Y?~X??~E??~~
R~Y?~O??~G?治?~M~@?~C?~E??~Z~D?~V?~Y?~B??~A~^?~@~B

Ah! You have to deselect the Escape non-ASCII option under Emulation for the terminal.
Inputting in CJK
For those unfamiliar:
1) Launch the Terminal, then start up vim as usual.
2) Type :set encoding=utf-8
3) File->Show Info
4) Select "Emulation" from the drop-down
5) Uncheck the Escape non-ASCII option
Switch to the input method you desire then start typing.
This allows you to paste in text from websites and such as well (even if the webpage was encoding using something other than UTF-8).
I got the answer here http://www.vim.org/htmldoc/mbyte.html#mbyte-first

Putting CJK text into PostScript file

Our application, as one of several export options, generates PostScript files. We recently added support for UNICODE text to the application - all internal text is utf16. I am having trouble exporting asian (CJK) fonts correctly. Before the switch to UNICODE we supported ShiftJIS for Japanese. I know that PS does not directly support UNICODE. So, my question is, what is the best way to proceed given the facts that I have UNICODE text and I must generate a correct PS file which will display that text?
To my pea-sized brain, it looks like there are two possible paths...
1. Convert the utf16 to ShiftJIS (or whatever code page is required) and export as before? This seems doable, but strikes me as a hack since I would need to look at each code point and figure out which code page it is related to.
2. Re-encode the font? But how? I've looked at documentation for CID-keyed fonts and some sample code for re-encoding, but I admit that I have not yet had an aha! moment. I'm not even sure if I'm looking at the correct stuff.
Also, do we need to embed the font(s)? (I realize that CJK fonts can be large, but file size is not a major consideration.)
Thanks for any help.

At this point embedding & reencoding appear to be more advantageous from what I understand of your project.
I have written PostScript drivers that embed Type 1 format fonts by converting the binary printer font (.pfb) file into a 7-bit ascii PostScript file and inserting that in the PostScript output stream. The font just needs to be inserted so that it is available in the context of when it will be used (ie. before font use and same or more significant save/restore level.
I have also reencoded font characters within a PostScript job in order to access special characters that didn't exist in an EBCDIC character table using octal codes, but I'm not sure if this will suit your solution 2 or not.
Code sourced probably sourced from Adobe Developer Kit of many years ago:
/reencsmalldict 12 dict def
/ENC
{reencsmalldict begin
/newcodesandnames exch def
/newfontname exch def
/basefontname exch def
/basefontdict basefontname findfont def
/newfont basefontdict maxlength dict def
basefontdict
{exch dup /FID ne
{dup /Encoding eq
{exch dup length array copy newfont 3 1 roll put}
{exch newfont 3 1 roll put}
ifelse
{pop pop}
ifelse
}forall
newfont /FontName newfontname put
newcodesandnames aload pop
newcodesandnames length 2 idiv
{newfont /Encoding get 3 1 roll put}
repeat
newfontname newfont definefont pop
end
} def
/EVEC [
8#030 /mu
8#031 /eth
8#032 /Yacute
8#033 /brokenbar
8#034 /onehalf
8#200 /Aacute
8#201 /Acircumflex
8#202 /Adieresis
8#203 /Agrave
8#204 /Aring
8#205 /Atilde
8#206 /Ccedilla
8#207 /Eacute
8#210 /Ecircumflex
8#211 /Edieresis
8#212 /Egrave
8#213 /Iacute
8#214 /Icircumflex
8#215 /Idieresis
8#216 /Igrave
8#217 /Ntilde
8#220 /Oacute
8#221 /Ocircumflex
8#222 /Odieresis
8#223 /Ograve
8#224 /Otilde
8#225 /Scaron
8#226 /Uacute
8#227 /Ucircumflex
8#230 /Udieresis
8#231 /Ugrave
8#232 /Ydieresis
8#233 /Zcaron
8#234 /copyright
8#235 /registered
8#236 /trademark
8#237 /aacute
8#240 /acircumflex
8#260 /adieresis
8#265 /agrave
8#276 /aring
8#300 /atilde
8#311 /ccedilla
8#314 /eacute
8#321 /ecircumflex
8#322 /edieresis
8#323 /egrave
8#324 /iacute
8#325 /icircumflex
8#326 /idieresis
8#327 /igrave
8#330 /ntilde
8#331 /oacute
8#332 /ocircumflex
8#333 /odieresis
8#334 /ograve
8#335 /otilde
8#336 /scaron
8#337 /uacute
8#340 /ucircumflex
8#342 /udieresis
8#344 /ugrave
8#345 /ydieresis
8#346 /zcaron
8#347 /logicalnot
8#354 /minus
8#355 /threesuperior
8#356 /thorn
8#357 /twosuperior
8#360 /yacute
8#362 /threequarters
8#363 /Eth
8#364 /onequarter
8#366 /Thorn
8#367 /divide
8#374 /plusminus
8#375 /multiply
8#376 /onesuperior
8#377 /degree
] def
/WE {EVEC ENC}def
/HLN {/HLNWE findfont}bind def
/Helvetica-Narrow /HLNWE WE

Safari for Windows is NOT compatible with Unicode 3.1 CJK characters!

This is an "old" problem since Safari for Windows was initially released. In the meantime, the problem is still not fixed in the latest version 4.0.3 (531.9.1).
Not only Safari (for Windows) does not properly show homepages that contain Unicode 3.1 CJK characters, but it also fails to show Unicode 3.1 CJK characters (it shows "squares" instead) in the whole application, such as Search box and all dialog boxes. Will this be fixed in the next release?
By the way, it is strange that Safari 4 for Mac is Unicode 3.1 compatible.

To speak more precisely, the Safari for Windows doesn't support CJK characters of Unicode CJK Unified Ideographs Extension B.
The following test illustrates the incompatibility of Safari for Windows:
1. Sample text displayed in Firefox 3.0.2 on Fedora 9.
http://farm4.static.flickr.com/3020/3002743180_e026d5c84b.jpg
2. Sample text displayed in Safari 3.x/4.x on Windows XP with "MingLiu Ext-B" (an Ext-B font provided by Microsoft) installed.
http://farm4.static.flickr.com/3224/2971019999_1c113109a9.jpg

Invalid POV Found in Display POV

We have 11.1.2.1 installed, and Windows 7 with a mix of Office 2007/2010.
Some of our SmartView users are getting an error "Invalid POV Found in Display POV" when they open an existing ad-hoc template (Planning connection) and try to Refresh. After clicking OK twice, they can get past the error and retrieve data.
One user (with Office 2007) has suppression enabled and tries to retrieve, gets this error, and then a message that ad-hoc grid cannot be created (because there is no data). Some of the POV dimensions are then 'deleted', meaning the drop-down is blank, and user cannot get back to member selection. The only fix so far is to go back to a clean version of the template, and start over.
We have uninstalled and reinstalled SmartView, and the problem persists.
Any thoughts or advice are appreciated!

cjk,
I have the same problem. So unfortunately I don't have the answer. But one intersting thing I noticed. If I put all the Member Selection data in the worksheet, but not in the recognized Smartview grid, I get the error. If I move the Member Selection data and put it in the grid (where the row and column data intersect), I don't get the error message when I open the file. You can also put all the member selection data (all but two in order to create the grid) in POV and you shouldn't get the error.

Korean / CJK INPUT on 8330: RIM Are You Listening?

It's official. I am on the brink of meltdown!!!!!!!!!!
It is extremly frustrating not being able to install
Korean / CJK INPUT on my 8330 Curve.
I've done quite a bit of Googling and ended up installing
multilanguage version of handheld software on my BB
which flawlessly displays CJK. However input method is
still limited to English UK and English US.
When I was just about to give up on CJK Input,
I saw a thread of hope from the above.
According to sources (BB Forums, Pinstack), using EastAsia
version of handheld software, CJK input was successfully
installed on SOME Curves. Holding onto that thread of hope,
I've countlessly tried installing CJK Input using "EastAsia
version of handheld softwares for 8300, 8310 and 8320" onto
my 8330 but failed miserably each and every time.
I demand EastAsia version of handheld softwares for 8330!!
(or anything that enables CJK Input!!)
Do not underestimate the size of Asian American market!
Message Edited by numbaz on 11-19-2008 11:21 AM

You demand??? Maybe we should demand that Americans speak English!
RIM releases the OS's to carriers and the carriers release them to the customers. CJK versions of the OS are tough because the carriers don't release those versions in the US. There are very few CDMA carriers in Asia (though, there are a few) so there aren't many options for carrier sites to download from.
I recommend going through the list below and looking through the Asian CDMA carriers and maybe you'll find a version that supports CJK input. You may not find the exact OS version you're looking for, though.
1. Please thank those who help you by clicking the "Like" button at the bottom of the post that helped you.
2. If your issue has been solved, please resolve it by marking the post "Solution?" which solved it for you!

Display of CJK

Similar Messages

Maybe you are looking for