Using native2ascii

Hi,
we are using Oracle 8 db.Our application uses
XML and while inserting data , somehow illegal
XML characters are being inserted in the records.
And when the records are reterieved, the XML
is throwing exception as Illegal XML characters.
I have read about native2ascii tool.But, was
not clear on how to use for our purpose to
read the illegal XML characters.
If i use,
native2ascii -encoding 646 p1.txt p2.txt
If p1.txt contains illegal XML characters,
how r they represented in p2.txt(output file).
Since, i have to know how the illegal characters
are represented.
Please, advise me.
Thanks

Hi Ron,
This looks like an interesting problem.
I am familiar with native2ascii but have very little knowledge of XML.
I'm not sure exactly what you're thinking of doing, but here's how native2ascii works:
native2ascii assumes that you have a file of correctly formed characters in some encoding and that you want the java reader to be able to input this file ( for example, a .java or .properties file). Suppose the file p1.txt is encoded in UTF8. Then you would call
native2ascii -encoding UTF8 p1.txt p2.txt. In file p2.txt, all ASCII characters (all characters from p1.txt with code points less than 0x0080) are represented as single byte ASCII characters. Any characters with code points >= 0x0080 are represented as a sequence of six single byte ASCII characters representing the unicode code point. Thus, for example, if the input file contains the Chinese character for tea, this would be represented in the output file as \u8336 and would be correctly read in by the java reader.
What is that 646 encoding you used in your example?
Regards,
Joe

Similar Messages

Is it possible to read native encodings without using native2ascii

Hi All,
I have a text file containing japanese characters saved in a UTF8 format. I can read this into my java application after converting it using the native2ascii tool.
However i'm wondering whether i can read this directly into my java application without going through the native2ascii tool since this file is already in UTF8 format. I have tried, but it doesnt work. Please advise.
Thanks.

You missed reading the java.util.Properties documentation:
"When saving properties to a stream or loading them from a stream, the ISO 8859-1 character encoding is used. For characters that cannot be directly represented in this encoding, Unicode escapes are used; however, only a single 'u' character is allowed in an escape sequence. The native2ascii tool can be used to convert property files to and from other character encodings."
What's so bad about using native2ascii?

How to use native2ascii tool?

Hi Friends,
I created one property file in english named string.property for my application. I need to convert that property file for different languages like chinese, arabic, japanese, spanish, etc.
I found native2ascii too is use to convert propert file. But I have no idea how to use it. can any one plese explain me by giving proper example if possible.
I would appreciate your help for this.
Thank you

native2ascii [options] [inputfile [outputfile]]
-reverse
Perform the reverse operation: convert a file with Latin-1 and/or Unicode encoded characters to one with native-encoded characters.
-encoding encoding_name
Specify the encoding name which is used by the conversion procedure. The default encoding is taken from System property file.encoding. The encoding_name string must be taken from the first column of the table of supported encodings in the Supported Encodings document.
-Joption
Pass option to the Java virtual machine, where option is one of the options described on the reference page for the java application launcher. For example, -J-Xms48m sets the startup memory to 48 megabytes.

How to use Native2ASCII Extension

hello
in need sample code for Native2ASCII Extension any code example how to use it in project

Here is the basic explanation of what is Native2ASCII -
http://java.sun.com/j2se/1.4.2/docs/tooldocs/windows/native2ascii.html
To activate the extension just right click on a file in the application navigator and choose the option.

Use properties to get character in file but some char could not be decode

i use properties class to get a file with Big5 character inside the file, but some character could not be display properly.....
sample code:
import java.io.*;
import java.util.*;
public class Frankie {
public static void main(String[] arg) {
try {
Properties p = new Properties();
p.load(new FileInputStream("file.ini"));
Enumeration e = p.propertyNames();
while (e.hasMoreElements()) {
String name = (String)e.nextElement();
String value = p.getProperty(name);
String coded_value = new String(value.getBytes("iso-8859-1"), "Big5");
System.out.println(name + " : " + coded_value);
byte[] bBytes2 = coded_value.getBytes();
for (int k = 0; k < bBytes2.length; k++) {
System.out.println("byte " + "iso1" + "[" + k + "] = " + bBytes2[k]);
catch (Exception e) {
e.printStackTrace();
==================
file.ini
people=你
a=餐
==================
result:
a : ?
byte iso1[0] = 63
people : 你
byte iso1[0] = -89
byte iso1[1] = 65
==================
the proper byte of "餐" should be (-64, 92).....
If i use a varible to store this character in the source code, and use value.getBytes("big5"), the byte could be properly display for this character....
how can i solve this? thanks a lot!

The Properties class javadoc says
The load and store methods load and store properties in a simple line-oriented format specified
below. This format uses the ISO 8859-1 character encoding. Characters that cannot be directly
represented in this encoding can be written using Unicode escapes ; only a single 'u' character
is allowed in an escape sequence. The native2ascii tool can be used to convert property files to
and from other character encodings.
which means you are not supposed to use "big5" encoding in your Properties text file
directly. There is a commandline tool "native2ascii" bundled with your jdk package that
you can use to convert your "big5" encoded Properties file into unicode escapes based
text file, then you no longer needs to play the trick
String coded_value = new String(value.getBytes("iso-8859-1"), "Big5");
p.getProperty(name) will give you exactly the correct "value" defined in your properties
file.
-x
btw, when using "native2ascii", if you are not in a "big5" env, using "-encoding big5" option
to force it.

Problems using native2acii

I have a very basic question about using native2ascii.exe.
I have set of Japanese characters that i need to convert to unicode.
I know the syntax is:
native2ascii -encoding shift_jis file1.txt file2.txt
File1 will contain the japanese characters and file2 will be the output in the form of unicodes
My question is how to save the file1.txt..
Do i need to save that in ANSI, Unicode or UTF-8?
If i save in Ansi, all my format goes out, and only the question mark remains.
The unicode equivalent for "必ずご入力く&# 12384;さい。 " is "\ufeff\u5fc5\u305a\u3054\u5165\u529b\u304f\u3060\u3055\u3044\u3002"
But i am not able to get this when i save "必ずご入力く&# 12384;さい。 " in file1.txt and run the native2ascii script
Any ideas where i'm going wrong?
Any help would be much appreciated.
Thx.

Anyone?

Native2ascii tool

i need to show the japanese text in my web application. this is how i am doing it.
first i develop my code on windows NT and then preapre a jar file and migrate it to unix server which will host the application.
in my windows NT , i convert the native characters to ascii using native2ascii tool and use these unicode characters in my properties file. every thing works fine and when i host the application on my windows NT machine , i could see the japanese text correctly.
now when i create jar file and migrate to unix server , the japanese characters get screwed up. why ? is it that the unicode characters are different on windows NT and unix server ? do i have to convert the characters on unix machine and use those unicode characters ? assuming that i did that , are these characters different from version of solaris machine to another ? should the jdk version be same ?
on my windows
java version "1.3.1_02"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.3.1_02-b02)
Java HotSpot(TM) Client VM (build 1.3.1_02-b02, mixed mode)
on my unix server
java version "Solaris_JDK_1.2.2_12"
Solaris VM (build Solaris_JDK_1.2.2_12, native threads, sunwjit)
Thanks,
bala

if i were you i will try this:
1. what's the encoding you are using for native2ascii, if it's SJIS, i will check first if i can browse some other web pages with SJIS encoding, so i can determine if it's only my wep application can't show jap text correctly in the unix box.
2.if your web browser cannot display jap text with SJIS encoding, then you need to install some fonts.
you can find some clue from the following link.
http://users.erols.com/eepeter/chinesecomputing/programming/java.html
you can test your jap text by changing the following sample code with an unicode for your jap string
Displaying Chinese
Finding Chinese Fonts Java 2 allows the programmer to directly access the fonts on the machine. The code sample below gets a list of all the fonts on the system, and then checks each font to see if it can display a sample Chinese string. Matching fonts are printed. Variations of the below code can be used to automatically find Chinese fonts and set the font of the Swing components accordingly. A bug in the JVM currently also lists all the logical fonts, whether they support Chinese or not, so I remove them from the list.
// Determine which fonts support Chinese here ...
Font[] allfonts = GraphicsEnvironment.getLocalGraphicsEnvironment().getAllFonts();
int fontcount = 0;
String chinesesample = "\u4e00";
for (int j = 0; j < allfonts.length; j++) {
if (allfonts[j].canDisplayUpTo(chinesesample) == chinesesample.length()) {
if (fontcount == 0) {
ctextarea.setFont(new Font(allfonts[j].getFontName(), Font.PLAIN, 12));
if (allfonts[j].getFontName().startsWith("dialog") == false &&
allfonts[j].getFontName().startsWith("monospaced") == false &&
allfonts[j].getFontName().startsWith("sansserif") == false &&
allfonts[j].getFontName().startsWith("serif") == false) {
cfontchooser.addItem(allfonts[j].getFontName());
fontcount++;
}

Native2ascii

hi,
Can I use native2ascii for files which are not properties file for e.g xml configurations.
or any other files.
has anyone tried that.
Thanks
Rajesh Mittal

native2ascii doesn't really care what the file is. You can use it on any text file.
John O'Conner

(Internationalization) - Unicode and Other ... Encoding Schemes

Hello,
I am developing a application that requires multiple languages
(Chinese/Japanese/English, French/German) support.
I plan to use utf-8 encoding, and not individual encoding for each language
like SHIFT_JIS for Japanese, BIG5 for Chinese etc.
This is more so because i would need to display multiple languages on the
same page, and allow the user to enter data in any language he/she chooses.
1. So, is the assumption that nothing but utf-8 can be used here, correct ?
2. If this is the case, why do people go for SHIFT_JS for Japanese or BIG5
for Chinese at all ? After the advent of Unicode, why cant they just use
utf-8.
3. I am using Weblogic 6. And my app is composed of JSPs alone at the
moment. It is working fine with utf-8 encoding, without me setting anything
at all in properties files etc. anywhere. I am getting data entered by user
in forms (in chinese/japanese etc) fine, and able to insert it into the
database and get it back too, without any problems.
So, why is it that people are talking of parameters to be set in properties
files to tell the app abt encoding being used etc.
4. My resource bundles are ASCII text files (.properties) which have name
value pairs. Hex Unicode numbers of the form /uXXXX represent the value. And
this works fine.
For example :
UserNameLabel = \u00e3\ufffd\u2039\u00e3
instead of -
UserNameLabel = ãf¦ãf¼ã
If the properties files have the original characters where values shud be
present, my java code is not able to read the name value pairs in Resource
Bundle.
Am i following the right approach ?
The problem with the current approach is after i create the Resource
Bundles, i must use native2ascii compiler to convert the characters into
their equivalent Hex Code values.
Thanks
JSB

charllescuba1008 wrote:
Unicode states that each character is assigned a number which is unique, this number is called code point. Right.
The relationship between characters and code points is 1:1.Uhm .... let's assume "yes" for the moment. (Note that the relationship between the Java type char and code point is not 1:1 and there are other exceptions ...)
Eg: the String *"hello"* (which is sequence of character literals) can be represent by the following Code Points
*\u0065 \u0048 \u006c \u006c \u006f*Those are the Java String unicode escapes. If you want to talk about Unicode Codepoints, then the correct notation for "Hello" would be
U+0048 U+0065 U+006C U+006C U+006F
Note that you swapped the H and e.
I also read that a certain character code point must be recognized by a specific encoding or else a question mark (?) is output in place of the character.This one is Java specific. If Java tries to translate some unicode character to bytes using some encoding that doesn't support that character then it will output the byte(s) for "?" instead.
Not all code points can be recognized by an encoding.Some encodings (such as UTF-8) can encode all codepoints, others (such as ISO-8859-*, EBCDIC or UCS-2) can not.
So, the letter *ל* would not be recognized by all encodings and should be replaced by a question mark (?) right?Only in a very specific case in Java. This is not a genral Unicode-level rule.
(disclaimer: the HTML code presented was using decimal XML entities to represent the unicode characters).
What you are seing is possibly the replacement character that your text rendering system uses to represent characters that it knows, but can't display (possibly because the current font has no character for them).

Need help in Displaying Chinese Character in JSF

Hi. Good Morning!
I'm having problem with displaying Chinese Characters in JSF. I've tried placing all the chinese words in the *.properties file however it doesn't work..
The result in the browser is something like this.
��

Hi,
When you say that you put Chinese characters in
*.properties files, can you be more specific? Did
you use native2ascii to convert the files to ASCII?
What is the character encoding setting for the JVM?
Have you sniffed the HTTP headers? If so, what's the
character encoding listed for the response?
Answers to these questions should help you nail down
the problem.
Regards,
PeterHi...
I did not use any converter like native to ascii... an example of what I placed in the properties file is:
title : 以下5种标签的表面要求列样
Request=条码离边框
Tablehead=透明标签
Note1= 透明标签
Note2= 透明标签
NoteA= 印商标图
then when i build the project in linux it turns out to be like this:
title= ???
Request=???
Tablehead=???
Note1= ???
Note2= ???
NoteA= ???
The character encoding for JVm.. i haven't check that yet nor know how...

How to realize czech texts with ResourceBundles

Hi!
I have got a big problem trying to make one of our german applications available in czech.
We are using ResourceBundles with .properties files for our texts and have now translated them into czech. When loading the bundle by calling:
ResourceBundle rb = ResourceBundle.getBundle("x.x.x.BundleName", locale);all seems to work and there is no exception thrown.
But when i try to get any text out of it i.e. by calling:
rb.getString("name");i get an exception:
java.util.MissingResourceException: Can't find resource for bundle java.util.PropertyResourceBundle, key name
I tryied to use native2ascii with several encodings (Cp1252, ISO-8859-1, ISO-8859-2, UTF-8, UTF-16, ...) but i never got one that realy works the way i want. Most of the encodings i tryied changes some of the special characters in the file but also left some of them so that i can get some translated texts but most of them with boxes or question symbols within. native2ascii with UTF-8 encoding only answers with a sun.io.MalformedInputException in the comand line. UTF-16 initially looked fine cause nearly all special characters was translated into \uXXXX escape sequences but also there i got a problem with one special character: � (hope it will be displayed correctly here). This character seems to annoy the native2ascii tool cause the following characters would also be translated into escape sequences even if this is not necessary. Also i got some question symbols in the GUI again (having the charset in the HTML/JSP file set to UTF-16).
I don't know why the original translated property file could not be read in getting an exception only when trying to get a text not when loading the file. Another thing confusing me is that all encodings (except UTF-16) that i tryied for the translated file corrupted the file by seperating each character with a blank one (so i.e. name = jm�no appered as n a m e = j m \u00e9 n o).
Some of the special characters in the translation are: � � � � � (and also some other characters with those symbols).
Please can anyone help me or does anyone has experiences with translating a (web) project to czech or any similar/related language.
Thanks a lot
Juergen

You also seem to have a problem with using native2ascii. You say that you tried to use it with Cp1252, ISO-8859-1 (among others), but how can you possibly have a Czech file in those code pages? They don't support the Czech characters set. You simply need to know which source code page your file is actually in, and then run native2ascii on the file specifying that encoding. I have never had a problem executing native2ascii on a Czech file, it seems to work just fine - as long as the correct source encoding is used.

Polish , turkish text not decoding in the alert boxes in JSP file

Hi All,
Currently I am working on application in the J2ee development perspective in NWDI and this contains many Jsp pages.As per the business requirement we need to make this application support Polish and turkish languages , for this we have maintained properties files .
I have encoded the polish and turkish text using the u201CHTML Unicode format encodingu201D hence when checked the url in the IE with Polish and turkish locale all the characters are getting decoded properly ,but i have a proplem with the text in the alert boxes i.e. the special characters in the text displayed in the alert boxes is not getting decoded at all eg:"Wprowadź numer konta BP" whereas it has to display as "Wprowadź numer konta BP:
Also i have used java encode also to achieve the same and for this "?" is getting displayed i.e. it is not getting properly decoded.
I have also used native2ascii method in this also it is getting decoded but not correctly i.e. "?" is displayed
Please note that the alert boxes are written in the script tag in the JSP page.
Request you to kindly help me in resolving the issue at the earliest as this is a very critical issue in my project now.
Thanks and Regards,
Nishita Salver

Hi nishita,
We had a similar problem in one of my projects, but what i remember is we have kept the ascii value for that character directly in the properties files and tried to encode it, this way i resolved my problem.
Try this way and let me know the result.
Regards,
Saleem Mohammad.

How to display unicode values in file to corresponding characters

Hello Java-ians !
Could you please calrify my doubt ! I am able to generate unicode values for arbic, russian characters. I did it by generating a UTF-8 format file and I used native2ascii tool to generate unicode values. No I am unable to dispaly the characters. I read the file using FileReader and used JTextFiled.setText method to redisplay the characters. Instead of displaying the corresponding character, I am getting only unicode values. Why it's happening ?
Also could you plese tell me how ResourceBundle works ? It reads the unicode values and displays proper charcters, how ?
Please help me ! I need it desperately !
Martin Sunder Singh D.S.

you have to do like this:
FileInputStream fos = new FileInputStream(new File("japanies.out"));
BufferedReader bw = new BufferedReader(new InputStreamReader(fos,"UTF8"));
System.out.println(bw.readLine());
bw.close();

How to deal with hindi lang

I am storing text messages in a PropertyResourceBundle as follows
txt_EmailAdd = {mel ADres
txt_Password = pasvDR
I made the above file in MSword using hindi fonts
The folllowing text is supposed to be in hindi
{mel ADres
pasvDR
but it does not show the text in hindi it still shows in English but when I open the above text file in MSword it shows the text in hindi
Please tell me how to deal with this problem . I hope you people reply as eaarly as possible.
I also have another prob, I am developing a website using jsp+servlet now I have made the above mentioned property file and stored it in c:\tomcat5.0\webapps\emailreadersevice\IndexMessagesBundle.properties
but when I access it from my application's index.jsp file Tomcat gives me following exception
java.lang.NullPointerException
     java.util.ResourceBundle.getBundleImpl(ResourceBundle.java:714)
     java.util.ResourceBundle.getBundle(ResourceBundle.java:579)
     org.apache.jsp.index_jsp._jspService(index_jsp.java:55)
     org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:94)
     javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
     org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:324)
     org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:292)
     org.apache.jasper.servlet.JspServlet.service(JspServlet.java:236)
     javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
My index.jsp file is stored in c:\tomcat5.0\webapps\emailreaderservice\index.jsp
In my index.jsp file i have written the following statement to get the IndexMessagesBundle but tomcat gives me the above exception.
ResourceBundle IndexMessages = ResourceBundle.getBundle("IndexMessagesBundle",currentLocale);
Please guide me abt how to go abt it. Also tell me whether I am doing the right thing or not. If no then please tell me the right steps to follow

Hi one_dane
I have made the property file using hindi fonts to type the following thing
{ m e l A D r e s
p a s v D R
No the above values are not place holders Infact in order to type EmailAddress and Password in hindi I had to type the above keys. so when I put system.out.println in my jsp page it does not display any hindi text but the above keys which i used to type in order to display hindi text in my txt file.
But I think i am not going on the right track should i type the unicode values for hindi text which is of the form \udddd in my property file. I have the unicode chart for hindi fonts so I can look up the chart and type appropriate unicodes(\udddd) to display Email Address and Password in hindi. Or am i still not getting how to do it? If not then please tell me how did you create your hindi property file. Is the following that you typed in your property file or is it the output of converting your property file into unicode using native2ascii
title=\u090f\u0926\u0938\u093e \u092a\u0917\u0932\u094d\u0917 \u0942\u093e\u0902\u0942JSP i18n issues
Please reply as soon as possible and hanks a lot for your help.
Eagerly waiting for a reply,
Heti shah

Cannot display BIG5 characters for web applications deployed to 9iAS

I have just installed the J2EE and Webcache module of Oracle9iAS Release 2 to
my Windows NT Server 4.0 and deployed a simple web application to it. However,
I found that the JSP cannot display chinese (Big5) characters correctly. My JSP
is something like:
<%@ page contentType="text/html; charset=BIG5" %>
<HTML><BODY>
<% String s = SOME_BIG5_CHARACTERS; %>
<%= s %>
</BODY></HTML>
On the other hand, I tried to re-direct the standard output to a log file and
do the following in my servlet.
System.out.println(SOME_BIG5_CHARACTERS);
Now, the Big5 characters CAN be displayed correctly in the log file. So, I am
confused with where the problem is.
Here are my settings to my 9iAS:
1) Using regedit, I have set the NLS_LANG variable of the corresponding
ORACLE_HOME to TRADITIONAL CHINESE_TAIWAN.ZHT16BIG5
2) In the file %ORACLE_HOME%\Apache\Jserv\conf\jserv.properties, I have
inserted the following line:
wrapper.env=NLS_LANG=TRADITIONAL CHINESE_TAIWAN.ZHT16BIG5
3) In the file %ORACLE_HOME%\Apache\Apache\conf\httpd.conf, I have added the
following line:
PassEnv NLS_LANG
4) In the file %ORACLE_HOME%\opmn\conf\opmn.xml, I have added the following
line to the corresponding OC4J instance:
<environment>
<prop name="NLS_LANG" value="TRADITIONAL CHINESE_TAIWAN.ZHT16BIG5"/>
</environment>
5) For my application server, I set the java option with -Dfile.encoding=Big5
6) I have replaced the file font.properties with font.properties.zh_TW under
%ORACLE_HOME%\jdk\jre\lib.
7) I have set the following in the file orion-web.xml of my web application:
<orion-web-app
deployment-version="9.0.2.0.0"
default-charset="Big5"
jsp-cache-directory="./persistence"
temporary-directory="./temp"
internationalize-resources="false"
default-mime-type="application/octet-stream"
servlet-webdir="/servlet/">
</orion-web-app>
Anyone have idea on fixing my problem? Thanks in advance.
Regards,
Kae

I met a similar problem before but not exactly your case. When I compile the JSP by Jdeveloper, it will convert the chinese characters to strange characters. It makes me crazy to handle the chinese characters ...
Anyway, by my experience, you better isolate the chinese characters from your JSP or Java programs. Instead, put all language dependent text in a properties file and then use native2ascii to covert your properties file into Unicode. Of course, u need to change your page charset to UTF-8.
U can get more idea from the following site.
Brief Description of Internationalization:
http://java.sun.com/products/jdk/1.2/docs/guide/internat/faq.html
Detail Tutorial:
http://java.sun.com/docs/books/tutorial/i18n/
Native-to-ASCII converter:
http://java.sun.com/products/jdk/1.2/docs/tooldocs/win32/native2ascii.html

Using native2ascii

Similar Messages

Maybe you are looking for