Problem in Writing Chinese Wording to File

Hi all
I am now doing a java program to query result from SQL Server and write those results to a ASCII text file (the text file is used for another software that only support ASCII text file as input).
Since records in SQL Server contains Chinese words stored in unicode format, I failed to write a text file with correct Chinese words.
I assumed the problem related to either:
(1) String that with record result should be changed in encoding.
(2) Method to write String to file.
Please help if you have any idea.
Thanks a lot
Shek

Your problem is the other program. ASCII in itself is an encoding, and its character set does not include Chinese characters, so it writes them entirely differently.
For instance, if you try to write the Chinese character \u4F2A, that's across two bytes (the 4F is one, followed by the 2A in another). ASCII will be expecting every character to take up one byte at most, so it takes the bytes that represent your Chinese character, and displays them as two separate characters (ASCII 4F, followed by ASCII 2A). If the other program can only handle an ASCII file, chances are that it receives ASCII 4F and 2A, and has no idea whatsoever that these two ASCII characters are in reality your Chinese character. It's likely only thinking in ASCII encoding, not one that can handle Chinese (UTF-8, UTF-16, Big5, GBK etc.). Any idea if this second program has anything dealing with character encodings within its setup and the like?
Hope that helps!
Martin Hughes

Similar Messages

Problem while writing data on xls file using jxl API

Hi,
I am getting problem while writing data on excel file using jxl api.
When i write data on file and all handles associated to the file are closed, file size increases but when i open the file nothing is written in it and when file is closed manually from excel window, file size decreased to its original that was before writing data.
here is code:
          FileOutputStream os = new FileOutputStream(this.dirPath + this.fileName, true);
          WritableWorkbook this.workbook = Workbook.createWorkbook(os);
after writing data following handler are closed:
this.os.flush();
                    this.workbook.write();
                    this.workbook.close();
                    this.os.close();
                    this.os = null;
can any body help me.
Thanks in advance

Err, I did help you. I did understand your problem; and I solved it for you. What was missing was that you apparently made no effort to understand what you were being told. Or even consider it. You just argued about it, as though you were the one with the solution, instead of the one whose code didn't work.
And the other thing that was missing was the part where you said 'thank you' to me for solving your problem. Somewhat more appropriate than biting the hand that fed you, frankly. I do this for nothing, on my own gas, and it's extremely irritating when people keep asking about problems I have already solved for them. I am entitled to discourage that. It's part of making them more efficient actually.
But it happens often enough that it also makes me think I'm just wasting my time. Probably I am.

Problem in writing into the excel file using java code

Hai ,
I will be getting the data as a string and i am writing into the excel file. the problem is .if it has numeric values even now i will writing as a string data ,at this time i am getting the message in the excel file as "Number in the cell is formatted as text".
I need to remove this thru my code..but i can write only as a string .
To write in a excel file ,i used HSSFWorkbook.

just check out
http://www.andykhan.com/

Problem of Query Chinese words in MySQL using Java (Servlet java)

In my servlet, if I build in this sql inside ,
SELECT * FROM table WHERE location='Chinese word here'
It outputs nothing!
if i change the 'Chinese word here' to English,it have result!
But if I query in mysql, i can
If the 'Chinese word here' is get in a form, (ie 'Chinese word here' is got by req.getParameter but not built in), it can display result, why???

Hi hlj_zhj
Oh your method works, I change the Gb2322 to Big5,
and I have a question about your "return shift", shift is not defined in your part of programme, so I change to follows:
private String getISO(String gbstr){
String temp=null;
try{
String temp_p = gbstr;
byte[] temp_t = temp_p.getBytes("Big5");
temp = new String(temp_t, "ISO8859-1");
catch(Exception e){}
return temp;
ANOTHER question, Some of my BIG5 words contains "Hong Kong Words,eg:�`��", therefore, using temp_p.getBytes("Big5") not work in this case, do you have any suggestion in this case? thanks

Small problem in sending chinese charaters using file adapter

Hi,
Actual scenario is,
Sender system -> file adapter -> XI -> ABAP Proxy -> Receiver system.
error is occured when the data reached the XI.
                                                                                1. The data file contains Chinese characters (Unicode).
2. When file adapter reads this file, the data in the payload no longer
    shows Chinese characters.
Can you please help in this regard...
Thanks,
Surya.

Hi,
Actually i am sending an EXCEL sheet which contains chinese charaters to XI using sender file adapter.
When file adapter reads this file, the data in the payload no longer shows Chinese characters.
what i need to do?
SUrya...

Problem in writing message to a file

Hi all.
I am now working on a message listener which will get the message from the queue, then write to a file and process the file to import the data into database.
The message the listener gets is in XML format. But in my program, I just cast the message to TextMessage and then get the String by message.getText() and write to a file.
The problem is I found extra space or characters appear in some of the xml tag. Would it be any problem of my coding? Do anyone have some ideas on it? Thanks for advanced.
Priscilla

Try to write arbitrary hard coded xml tags to a file using ur code. If its fine, then its in the message if not then it in ur code.

Problem in writing Spaces in an FIle.

Hi All ,
    I want to write the data in a file at application server. The data is in the form of an structure or an internal table. But the problem is that if the last fields of the structure are blank then I am not getting spaces in the file and the EOL is getting appended after the last populated field only.
Is there any way to avoid this ? I want to have EOL after the spaces or after the actual length of the structure. Is there any way to do this ?
I am using Open Dataset to open the file in text mode , Transfer to write the contents , and Close Dataset.
Thanks,
Ashwa...

There is no need to add one more field in the internal table.
I also faced the same problem and solved in the following way:-
My record length was 339 character and i defined it 440 (reuired + one.)
the last field was Ref_matDoc of char14.
data: l_reclength type i value 440.
but as it was last filed 14 character are not written at end.
I define the last field as char15 (required + one more.)
and written to file by following wy:-
*Ref_matDoc
    ****logic to populate *Ref_matDoc field.
    if ITAB-Ref_matDoc is initial.
     " move the control character at the end of record
      " to leave the 14 spaces.
      move cl_abap_char_utilities=>CR_LF(1)
         to ITAB-Ref_matDoc+14(1).
    endif.
*transfer statement
     transfer ITAB to FILENAME length l_reclength.
Hope this will solve your problem.

Problem in writing data to flat file

Hi,
I have created an interface with table as source and file as target. My interface is running from long time but its not writing data into file. Any clue?
-Chikk

Hi,
Please, take a look if the target file is locked.
Try to delete it and put the "Truncate" option from IKM to yes.
Cezar

Writing CAN data to a spreadsheet or word processing file.

Hi. I need to know how I can write CAN data to a spreadsheet or word processing file. I have a vi that reads information from a CAN device and I need to write everything that is read to a spreadsheet or word processing file. Also I'm getting an error message using a vi that uses the frame API to write and read frames. It happens when I change the read or write queue value. Right now they are set at 100 each and when I change them just a little(even by 1) there is an error. Thanks in advance.

I would recommend against writing DIRECTLY to Excel, while the CAN vi is running, the MSOffice interface is too slow to be doing while the CAN vi is running. There are 2 different ways you can get around this problem though.
1. When you receive a CAN frame you want to log, write it to a buffer of some kind in Labview (this could be a string buffer wired to a shift register, it simply adds the new data to the end of the buffer) then when your VI closes, it writes the string data to an excel worksheet.
2. You could log the data to a text file, if you use the Write File.vi (in the File I/O pallette) you can quickly write data to a file if it is done correctly. DO NOT use the VI's on the first row (Write to Spreadsheet.vi and Write Characters to File.vi) because they will be too slow, they open the file, write data, and then close the file each time they run, which takes too much time.
As for changing the buffers, you can do that, if you change the buffers at the time you call ncCANConfig, if you change the buffers after that you will get an error.

Problem in reading no. of files and writing into a single file

Hi,
Iam with Problem in reading no. of files and writing into a single file....
Iam reading no. of files stored in local directory.......
Iam able to read and print the data in files successfully....but while writing..only first file is being written...and the next files are not written in my output file...
plz tell me my mistake....I hope Iam doing some mistake while writing into file...PLz help.....
Basically my code structure is like this....
import java.io.*;
import java.util.regex.*;
import java.util.*;
import java.text.*;
import org.apache.poi.poifs.filesystem.POIFSFileSystem;
import org.apache.poi.hssf.usermodel.HSSFWorkbook;
import org.apache.poi.hssf.usermodel.HSSFSheet;
import org.apache.poi.hssf.usermodel.HSSFRow;
import org.apache.poi.hssf.usermodel.HSSFCell;
class Writing {
public static void main(String args[]) throws Exception {
          FileOutputStream fileOut = new FileOutputStream("ServerResult.xls"); //my output file
          int counter = 1;
          File dir = new File("C:/Perform/ServerLogs");
          String[] children = dir.list();
          if( children == null)
               System.out.println("The Directory mentioned does not exist");
          else {
               for (int fileNo = 0; fileNo < children.length; fileNo++ ) {        //Files iteration starts
                    String filename = children[fileNo];
          File logFile = new File(filename);
FileReader logFileReader = new FileReader(logFile);
BufferedReader logReader = new BufferedReader(logFileReader);
StringBuffer sBuf = new StringBuffer(5000);
          HSSFWorkbook wb = new HSSFWorkbook();
          HSSFSheet sheet = wb.createSheet();
          HSSFRow rowTitle;
          HSSFRow rowReq;
          HSSFRow rowRes;
String aLine = null;
boolean skip = false;
boolean readed = false;
boolean initReq = false;
          boolean flag = false;
long requestTime = 0;
long responseTime = 0;
long recdTime = 0;
long sentTime = 0;
          long hasTime = 0;
          long presentTime = 0;
          int hasCalls = 0;
Pattern startMessage = Pattern.compile("^<MESSAGE.*ID=\".*_"+args[0]+"\".*", Pattern.DOTALL);
Pattern requestMessage = Pattern.compile("^<MESSAGE.*TS=\"(.*)\" CATEGORY=\"RequestMsg.\".*ID=\".*_"+args[0]+"\".*<ActName>(.*)</ActName>.*", Pattern.DOTALL);
Pattern requestMessage1 = Pattern.compile("^<MESSAGE.*TS=\"(.*)\" CATEGORY=\"RequestMsg.\".*ID=\".*_"+args[0]+"\".*<Svc id=\"(.*)\">.*", Pattern.DOTALL);
Pattern responseMessage = Pattern.compile("^<MESSAGE.*TS=\"(.*)\" CATEGORY=\"ResponseMsg\".*ID=\".*_"+args[0]+"\".*", Pattern.DOTALL);
Pattern initMessage = Pattern.compile("^<MESSAGE.*TS=\"(.*)\" CATEGORY=\"HostConnInit\".*ID=\".*_"+args[0]+"\".*", Pattern.DOTALL);
Pattern initResMessage = Pattern.compile("^<MESSAGE.*TS=\"(.*)\" CATEGORY=\"ResponseMsg\".*ID=\"null\".*", Pattern.DOTALL);
Pattern initResIDMessage = Pattern.compile("^<MESSAGE.*TS=\"(.*)\" CATEGORY=\"ResponseMsg\".*ID=\"null\".*<IATA>"+args[0]+"</IATA>.*", Pattern.DOTALL);
          Pattern sentMessage = Pattern.compile("^<MESSAGE.*TS=\"(.*)\" CATEGORY=\"DCMsgSentInfo\".*ID=\".*_"+args[0]+"\".*", Pattern.DOTALL);
          Pattern rcvdMessage = Pattern.compile("^<MESSAGE.*TS=\"(.*)\" CATEGORY=\"DCMsgRcvdInfo\".*ID=\".*_"+args[0]+"\".*", Pattern.DOTALL);
SimpleDateFormat sdf = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss.SSS");
DecimalFormat dcf = new DecimalFormat("########.##");
String actName = "";
          if (fileNo ==0)
          rowTitle = sheet.createRow((short)0);
          rowTitle.createCell((short)0).setCellType(HSSFCell.CELL_TYPE_STRING);
          rowTitle.createCell((short)0).setCellValue("Req/Res");
          rowTitle.createCell((short)1).setCellType(HSSFCell.CELL_TYPE_STRING);
          rowTitle.createCell((short)1).setCellValue("Action");
          rowTitle.createCell((short)2).setCellType(HSSFCell.CELL_TYPE_STRING);
          rowTitle.createCell((short)2).setCellValue("Server Time(in ms)");
          rowTitle.createCell((short)3).setCellType(HSSFCell.CELL_TYPE_STRING);
          rowTitle.createCell((short)3).setCellValue("Request Vs Response Time in Server(in ms)");
          rowTitle.createCell((short)4).setCellType(HSSFCell.CELL_TYPE_STRING);
          rowTitle.createCell((short)4).setCellValue("Time Taken By HAS/HOST(in ms)");
          rowTitle.createCell((short)5).setCellType(HSSFCell.CELL_TYPE_STRING);
          rowTitle.createCell((short)5).setCellValue("No. of HAS calls");
          rowTitle.createCell((short)6).setCellType(HSSFCell.CELL_TYPE_STRING);
          rowTitle.createCell((short)6).setCellValue("Data Size");
          //wb.write(fileOut);
while((aLine=logReader.readLine()) != null) {
if(aLine.startsWith("<MESSAGE TYPE=\"EVENT\"")) {
Matcher m = startMessage.matcher(aLine);
if(m.find()) {
sBuf.setLength(0);
sBuf.append(aLine);
skip = false;
initReq = false;
m = initMessage.matcher(aLine);
if(m.find()) {
initReq = true;
} else {
if(initReq) {
m = initResMessage.matcher(aLine);
if(m.find()) {
sBuf.setLength(0);
sBuf.append(aLine);
skip = false;
} else if(aLine.startsWith("</MESSAGE>")) {
if(!skip) {
sBuf.append(aLine);
readed = true;
} else if(!skip){
sBuf.append(aLine);
if(!skip && readed) {
String tempStr = sBuf.toString();
if(tempStr.length() > 0) {
boolean reqMatched = false;
Matcher m = null;
if(initReq) {
m = initMessage.matcher(tempStr);
actName = "Intialization";
} else {
m = requestMessage.matcher(tempStr);
String time = "";
if(m.find()) {
reqMatched = true;
for (int i=1; i<=m.groupCount(); i++) {
String groupStr = m.group(i);
if(i == 1) {
time = groupStr;
} else if(i == 2) {
actName = groupStr;
} else if(!initReq){
m = requestMessage1.matcher(tempStr);
if(m.find()) {
reqMatched = true;
for (int i=1; i<=m.groupCount(); i++) {
String groupStr = m.group(i);
if(i == 1) {
time = groupStr;
} else if(i == 2) {
actName = groupStr;
if(time.length() > 0 ) {
try{
requestTime = sdf.parse(time).getTime();
}catch(Exception ex){}
System.out.println("Request,"+actName+","+time+",,,,"+dcf.format(((double)time.length()/1024.0))+"K");
                              //bw.write("Request,"+actName+","+time+",,,,"+dcf.format(((double)time.length()/1024.0))+"K");
                              String reqDataSize = dcf.format(((double)time.length()/1024.0))+"K" ;
                              rowReq = sheet.createRow((short)counter);
                                   rowReq.createCell((short)0).setCellType(HSSFCell.CELL_TYPE_STRING);
                                   rowReq.createCell((short)0).setCellValue("Request");
                                   rowReq.createCell((short)1).setCellType(HSSFCell.CELL_TYPE_STRING);
                                   rowReq.createCell((short)1).setCellValue(actName);
                                   rowReq.createCell((short)2).setCellType(HSSFCell.CELL_TYPE_STRING);
                                   rowReq.createCell((short)2).setCellValue(time);
                                   rowReq.createCell((short)3).setCellType(HSSFCell.CELL_TYPE_STRING);
                                   rowReq.createCell((short)3).setCellValue("");
                                   rowReq.createCell((short)4).setCellType(HSSFCell.CELL_TYPE_STRING);
                                   rowReq.createCell((short)4).setCellValue("");
                                   rowReq.createCell((short)5).setCellType(HSSFCell.CELL_TYPE_STRING);
                                   rowReq.createCell((short)5).setCellValue("");
                                   rowReq.createCell((short)6).setCellType(HSSFCell.CELL_TYPE_STRING);
                                   rowReq.createCell((short)6).setCellValue(reqDataSize);
                                   counter = counter +1;
                                   System.out.println("counter is "+counter);
                         Matcher l = sentMessage.matcher(tempStr);
                         Matcher k = rcvdMessage.matcher(tempStr);
               if(l.find()) {
                                        for (int i=1; i<=l.groupCount(); i++) {
     String groupStr2 = l.group(i);
try{
sentTime = sdf.parse(groupStr2).getTime();
}catch(Exception ex){}
                    if(k.find())
                                             for(int j=1;j<=k.groupCount(); j++) {
                                             String groupStr1 = k.group(j);
                                             try{
recdTime = sdf.parse(groupStr1).getTime();
}catch(Exception ex){}
                                             presentTime = (recdTime - sentTime);
                                             hasTime = hasTime + presentTime;
                                             hasCalls = hasCalls +1;
if(!reqMatched) {
if(initReq) {
m=initResIDMessage.matcher(tempStr);
} else {
m=responseMessage.matcher(tempStr);
if(m.find()) {
for (int i=1; i<=m.groupCount(); i++) {
String groupStr = m.group(i);
try{
responseTime = sdf.parse(groupStr).getTime();
}catch(Exception ex){}
                                             String resDataSize = dcf.format(((double)tempStr.length()/1024.0))+"K" ;
                                             rowRes = sheet.createRow((short)(counter));
                                             rowRes.createCell((short)0).setCellType(HSSFCell.CELL_TYPE_STRING);
                                             rowRes.createCell((short)0).setCellValue("Response");
                                             rowRes.createCell((short)1).setCellType(HSSFCell.CELL_TYPE_STRING);
                                             rowRes.createCell((short)1).setCellValue(actName);
                                             rowRes.createCell((short)2).setCellType(HSSFCell.CELL_TYPE_STRING);
                                             rowRes.createCell((short)2).setCellValue(groupStr);
                                             rowRes.createCell((short)3).setCellType(HSSFCell.CELL_TYPE_NUMERIC);
                                             rowRes.createCell((short)3).setCellValue((responseTime - requestTime));
                                             rowRes.createCell((short)4).setCellType(HSSFCell.CELL_TYPE_NUMERIC);
                                             rowRes.createCell((short)4).setCellValue(hasTime);
                                             rowRes.createCell((short)5).setCellType(HSSFCell.CELL_TYPE_NUMERIC);
                                             rowRes.createCell((short)5).setCellValue(hasCalls);
                                             rowRes.createCell((short)6).setCellType(HSSFCell.CELL_TYPE_STRING);
                                             rowRes.createCell((short)6).setCellValue(resDataSize);
                                             hasTime = 0;
                                             hasCalls = 0;
                                             counter = counter + 1 ;
sBuf.setLength(0);
readed = false;
          wb.write(fileOut);
          } // End of for (int fileNo = 0; fileNo < children.length; fileNo++ )
}     //End of else
          fileOut.close();
} //End of public static void main
} // End of Class

First of all, use [code]-tags to make your code readable, please.
I didn't do a complete inspection of your code (because it's too much and unreadable as it is) and I don't know POI, but creating a new HSSFWorkbook for each input file sounds fishy to me ... try re-using the workbook and just creating a new sheet in each iteration.

Problem with index markers and importing MS Word 2007 files

This was ugly in that it wasn't caught until after a book had been typeset and the index was being finalized. I'm now having to go back and manually insert a zillion index markers. Not fun.
This was my first project since migrating from FM 7.1 to FM9.0.3.
Source documents are Microsoft Word 2007. Am working in Microsoft Windows 7 64-bit.
When the Word files were imported into FrameMaker, only SOME of the index markers were imported. The difference between those that were imported and those that weren't was seemingly random.
I did some testing and found the problem and a solution.
Looking at the source Word .docx file, and displaying hidden text shows two types of index markers:
1. { XE "word to be indexed"}
2. {xe "word to be indexed"}
Note the difference in case and the extra space after the opening brace in #1. Markers of type 1 were imported fine. Markers of type 2 were stripped by the import process.
The solution:
Backsave the Word file to Word 2003 format (.doc) before importing into FrameMaker.
I backsaved to Word 2003 and imported using both the "Microsoft Word" and "Microsoft Word 2007" filters and both filters imported correctly. It's only when trying to import a Word 2007 .docx file directly that things run amok.
Grr...

Thank you for posting your solution, Dan. It's cold comfort, but I've also ran into this issue in the past, almost certainly well before Word2003 though, probably as far back as Word2000 or earlier.
In your testing, did you try saving as RTF to see if the markers were homogenized, by any chance? In my simple testing just now, Word itself recognized the index field correctly no matter whether I changed the field to "xe" or "XE", but FM's import of the .docx file format wouldn't recognize "xe", only "XE". But importing an RTF file handled both upper- and lower-case entries.
Ah, yes, that's it -- saving the Word2007 file as RTF (with 2 fields, one caps, one lower-case) changed cap field to lower-case when the RTF is opened in Word again, so saving as RTF does homogenize the fields to lower-case. Is it possible that your file(s) were changed to or saved as RTF at any point in their life-cycle? I believe some older versions of Word were actually RTF under the hood, too -- if you do Save As in Word2007 you can scroll through the File Type entries and see "Word 97-2002 & 6.0/95 - RTF (*.doc)" I believe some doc management systems change binaries to RTF too, or conversely some apps create RTF but they name the files as doc.
So Word itself recognizes either lower- or upper-case, and FM's RTF import handles both, but not the .docx import.
Sheila

How to read Chinese word from a TXT file

File.OpenText() read a TXT File with Chinese word in ;but it not show right.
exam:The TXT File include :中国
this.Txt1.Text=ofd.File.OpenText().ReadToEnd();
but it show :��ʹ�ݼƻ��
How to solve it

What encoding does the text file use? Unlike .NET, Silverlight only supports UTF-8 and UTF-16. File.OpenText() uses UTF-8 by default.
If the text file is in some other encoding, you can create your own encoding class (that derives from System.Text.Encoding) that can be used to read the text file.
class MyEncoding : System.Text.Encoding {
this.Txt1.Text = (new StreamReader(ofd.File.OpenRead(), new MyEncoding())).ReadToEnd();
Regards,
Justin Van Patten
Program Manager
Common Language Runtime

Having problems converting pdf to word. I'm not able to convert the file, what do I need to do?

having problems converting pdf to word. I'm not able to convert the file, what do I need to do?

Hi prates77,
I'm sorry to hear that you're having trouble converting files. Are you receiving the conversion error regardless of the file that you try to convert? Does the error occur whether you use the web interface, or convert via Reader? And an odd question: how many files do you have stored in your Acrobat.com account? We have seen reports of this error when there are a large number of files stored in the root folder of your Acrobat.com account.
I look forward to hearing back from you.
Best,
Sara

Problem while writing to fixed length flat file from xml

Hi,
I have a problem in writing data into a flat file of fixed length...
My input is a xml file and i want the output as a flat file. I am successful in converting the xml into flat file... But the main problem is, i am unable to insert spaces in between my fields in the flat file.
The data in the flat file comes without spaces... Any suggestions on writing the schema...
Regards
Surya.

Have a look at this doc
http://otndnld.oracle.co.jp/document/products/as10g/101310/doc_cd/integrate.1013/b28994/nfb.htm#BGBBAJFD
your element should be something like this, it pads with a space using the paddedBy expression
<xsd:element name="C1" type="xsd:string" nxsd:style="fixedLength" nxsd:length="4" nxsd:paddedBy=" " nxsd:padStyle="tail" />if having trouble post what you want the file to look like, and the xsd you are using.
cheers
James

Writing chinese character into a file

Hi,
I need to write chinese characters into a file,I used FileOutputStream, using the method write(byte[] b)...
whereby I will convert the chinese word into bytes....
but it couldn't work...
Please Help!!

you can write the unicode hex string (e.g. 606D559C53D18D22 for Gong Xi Fa Chai) into a text file by using the following code
          PrintWriter out2 = new PrintWriter(new BufferedWriter(new OutputStreamWriter(new FileOutputStream("chinese_out.txt", false), "UTF-8")));
               int countChineseChar = chineseHex.length()/4;
               int index = 0;
               String c = "";
               int b;
               for(int i=0; i<countChineseChar-1; i++)
                    c = new String(chineseHex.substring(index, index+4));
                    b = Integer.parseInt(c, 16);
                    out2.write(b);
                    index+=4;
Note that the OutputStreamWriter uses the UTF-8 to encode the unicode hex. I'm assuming that the hex is fixed at 4 digits each character
syam

Problem in Writing Chinese Wording to File

Similar Messages

Maybe you are looking for