Problem reading Japanese text file

Hi - I'm having a problem trying to read in Japanese (EUC) formatted text from a text file. When viewed as ansi, each Japanese character is displayed as two characters (e.g. ��), and there is no problem with editing them in this format in Notepad. However, BufferedReader doesn't seem to want to read some of the characters properly, for example '�'. It reads in as '?', and totally screws up what I am trying to do, which is to read in a text file regardless of its encoding, character by character. Is there any way to do this, or do I need to set up separate conditions for each possible encoding format? Is there another class I can use to read in the characters in this way? If not, how do I read in the characters properly? Thanks very much.
-ns

Read a text file regardless of its encoding? Nope.
If it's encoded then you have to decode it, andit's
up to you to specify the encoding.Pardon my ignorance, but isn't that what Unicode is
supposed to be for? Should it be possible to write in
a format (UTF-8?) that encompassed all the characters
you may ever need it to?Yes, that is exactly what Unicode is supposed to be for. And yes, UTF-8 should encompass any character you ever need. But in the real world, as for example in the original poster's case, people encode their files using other standards such as EUC-JP.

Similar Messages

Read from text file and seperate column

hello,
I have a problem reading my text file. This text file is downloaded from weather link. All data will be changed upon the selection of user. my problem is I can read the data column by column but i cannot retrive the right column header for each data. I also attached the test file. Can somebody help me? Thanks in advance..
Attachments:
download.txt ‏8 KB
read text file.JPG ‏11 KB
read data.JPG ‏43 KB

Hi
Sorry, I missed that one. The file formatting is strange though. It uses spaces to separate columns but also within columns. I attached a modified VI that tries to take care of that, but it fails at the columns "Solar Energy" and "Hi Solar Rad.". This is very difficult to read programmatically as there's one space each between "Solar", "Hi", and "Solar" again. So how do we distinguish between column separator and space within column?
Is download.txt the original file? Or was it probably modified by an editor that would replace tabs by space characters?
Attachments:
test-mod-2.vi ‏11 KB

Problem using saxparser(reading japanese xml file)

Hi everybody,
I hav a problem while reading japanese xml file.(UTF-8 charset)
I have to read the file and process it.
But in the characters function of the saxparser(defaulthandler) the japanese chatracters are not read properly and the program is
displaying some junk values(????) instead of the actual japanese characters.
I am also usind xsd validation.
I am not able to where the characters manipulation is being done.
Please help me as soon as possible .
Thanks in advance,
Charan.

There are a couple of things probably going on.
1) When I've done things using Unicode unusual characters, they do not print properly if you do System.out.println( ). If you have a Gui panel and can put them into a JTextArea or JEditorPane, they may show up properly if you have set the font for that object to one that can display the characters.
2) Many people starting with SAX write their code assuming that the characters method is only called once for each element that has text content. This is incorrect. The characters method can be called many times, and it is your responsibility to catch all of the data. In 1.4 you can use a StringBuffer, or in 1.5 there is a StringBuilder. You use these to accumulate the data from all of the calls to charactrers() between the startElement and endElement.
Each parser can decide how often it calls characters, so you have to be able to process data from several calls.
Dave Patterson

Reading Japanese Text

Hi,
I have a standalone program that would like to read in a text file and display in the textarea. The problem is, the text file is encoded in Japanese using JIS, EUC, and SJIS. Is there a way for me to detect, upon opening the file, which decoder to use, and how can I display the Japanese character correctly on the textarea? Please help. Thanks.
angela

Below is what I have now. It works fine. The only problem is, I'm harding it to decode using SJIS. That means I can read any files encoded using JIS or EUC. Is there a way for me to detect how the text file is encoded and use the appropriate decoder for it? Please help. Thanks.
import java.io.*;
import java.awt.*;
import java.awt.event.*;
import javax.swing.*;
public class Japanese extends JDialog
   JScrollPane scrollPane;
   JTextArea textArea;
   JButton openButton;
   JTextField textField;
   public Japanese ()
      getContentPane().setLayout ( new BorderLayout () );
      getContentPane().setSize ( 500, 500 );
      textArea = new JTextArea ();
      scrollPane = new JScrollPane ( textArea );
      getContentPane().add ( scrollPane, BorderLayout.CENTER );
      JPanel bottomPanel = new JPanel ();
      openButton = new JButton ( "Open" );
      openButton.addActionListener ( new ActionListener ()
         public void actionPerformed ( ActionEvent e )
            textArea.setText ( "" );
            textArea.setCaretPosition ( 0 );
            openFile ( textField.getText () );
      textField = new JTextField (20);
      bottomPanel.setLayout ( new FlowLayout ( FlowLayout.LEFT ));
      bottomPanel.add ( textField );
      bottomPanel.add ( openButton );
      getContentPane().add ( bottomPanel, BorderLayout.SOUTH );
   private void openFile ( String filename )
      File file = new File ( filename );
      if (! file.exists () )
         System.out.println("file does not exist \n");
      else
         try
            //read file
            BufferedReader br = new BufferedReader ( new InputStreamReader ( new FileInputStream (file), "SJIS" ) );
            String nextLine = br.readLine ();
            while ( nextLine != null )
               textArea.append ( nextLine + "\n");
               nextLine = br.readLine ();
            textArea.setCaretPosition ( 0 );
         catch ( Exception exp )
            exp.printStackTrace ();
   public static void main ( String args [] )
      Japanese japanese = new Japanese ();
      japanese.show ();

How to open saved files using 'read from text file' function

Hi everyone, I am having a hard time trying to solve the this particular problem ( probably because I am a newb to lanbview ). Anyway , I am able to save the acquired waveforms by using the 'Write to text file' icon. I did manually modify the block diagram of the 'Write to text file' icon and create the correct number of connector so as to make my program work. But now I have no idea on how to modify the block diagram of the 'Read from text file' block diagram to make my program 'open' my saved waveforms. Or i do not have to modify anything from the block diagram of the 'Read from text file'? Can anyone teach/help me connect up? Do i need the build array on the "open" page?
Here are some screenshots on part of my program
let me know if you guys would need more information / screenshots thank you!
Attachments:
ss_save.jpg ‏94 KB
ss_open.jpg ‏94 KB
modified_writetotextfile.jpg ‏99 KB

Ohmy, thanks altenbach. oh yeah i forgot about those sub VIs. will upload them now. Was rather demoralized after reading the comments and really struck me on how weak i'm at on labview really hope to get this done. But of course i have to study through and see how it works. Actually i am going to replace those 'signal generators sub vi' with ThoughtTechonology's sample code so i can obtain data waveforms real-time using Electrocardiography (ECG) ,Electromyography (EMG ) and Electroencephalography (EEG) hopefully i can find out how to connect the sample code.
( ps . cant connect it now unless my program is working otherwise labview will crash )
( p.s.s the encoder of my biofeedback trainer already acts as an DAQ so i wont need to place an DAQ assistant in my block diagram i suppose )
The sample code of ThoughtTechnology is named as attachment.ashx.vi. too bad i cant use it and present it as my project
Attachments:
frequency detactor.vi ‏53 KB
signal generator.vi ‏13 KB
attachment.ashx.vi ‏40 KB

How to make an applet to read the Text file present inside a jar

Hi All,
I have writen one applet named ReadFile.java which reads a text file present in the same directory and does some manipulation of text file contents.
The applet code runs successfully when i run the applet in command prompt like
{color:#ff0000}*java ReadFile*{color}
And i am getting the needed results.
Then i made a jar file with the applet code and text file as
{color:#ff0000}*jar cvf rf.jar ReadFile.class File1.txt*{color}
Then i have inlcuded this applet inside a html file as
{color:#ff0000}*<applet code= "ReadFile.class" width= "500" height= "300" archive = "rf.jar" ></applet>*{color}
after this when i load the html file, the applet code is not executed fully. Its throwing FileNotFoundException: File1.txt.
Applet is not recognizing trhe text file present inside the jar file.
Can any body explain me how to overcome this problem. Any setting needs to be done for making the applet indicate the presence of Text file inside the jar file.

what code in your applet gets the text file and reads it? are you using getResource or something similar?

How do I read a text file in a Jar Executable?

Hello All,
I have a need to package a text file into a Jar Exectable file and then have my java code read that text file in using a BufferedReader. Can anyone out there tell me how to do this? My first question is how do I reference this file by the path name? O, I'm also using Windows.
Thanks for your help.
Karl

I have the same problem with kportner . I did by joop_eggen but I got the error at:
BufferedReader in = new InputStreamReader(is);Can't conver from BufferedReader to InputStreamReader
When I up my applet to server and get it from client. My applet couldn't read the text file.
Any one help me!
Thanks.

How to read several text files at a time

Dear all
Read and write one text file is not a problem, but what confusies me is how to read several text files at one time, in the meanwhile,
is it possible to display the name of the text file?
For example, assuming I want to load file" cha 1, cha 2 , cha 3, " at one time and show their names, how to hadle with it
I have reviewed some files and it is not helpful

Either with a 'for' loop like in the lib you have attached, or like this attached VI
that's it
Message Edited by devchander on 05-30-2006 05:11 AM
Attachments:
MULTIPLE READ.vi ‏44 KB

How can i read the text files and buffer the data in Vector?

hi. I have been running into this problem for days, but with no luck and losing right direction.
The problem is : I am trying to read a text file and buffer the data into a
Queue for each user.
the sample text file is as below:( 1st column is timestamp, 2nd is user_id, 3rd is packet_id, 4th is packet_seqno, 5th is packet_size)
0 1 1 1 512
1 2 1 2 512
2 3 1 3 512
3 4 1 4 512
4 5 1 5 512
5 6 1 6 512
6 7 1 7 512
7 8 1 8 512
8 9 1 9 512
9 10 1 10 512
10 1 2 11 512
11 2 2 12 512
12 3 2 13 512
13 4 2 14 512
14 5 2 15 512
15 6 2 16 512
16 7 2 17 512
17 8 2 18 512
18 9 2 19 512
19 10 2 20 512
20 1 3 21 512
21 2 3 22 512
22 3 3 23 512
23 4 3 24 512
24 5 3 25 512
25 6 3 26 512
26 7 3 27 512
27 8 3 28 512
28 9 3 29 512
29 10 3 30 512
30 1 4 31 512
31 2 4 32 512
32 3 4 33 512
33 4 4 34 512
34 5 4 35 512
35 6 4 36 512
36 7 4 37 512
37 8 4 38 512
38 9 4 39 512
39 10 4 40 512
40 1 5 41 512
41 2 5 42 512
42 3 5 43 512
43 4 5 44 512
44 5 5 45 512
45 6 5 46 512
46 7 5 47 512
47 8 5 48 512
48 9 5 49 512
49 10 5 50 512
50 1 6 51 512
51 2 6 52 512
52 3 6 53 512
53 4 6 54 512
54 5 6 55 512
55 6 6 56 512
56 7 6 57 512
57 8 6 58 512
58 9 6 59 512
59 10 6 60 512
60 1 7 61 512
61 2 7 62 512
62 3 7 63 512
63 4 7 64 512
64 5 7 65 512
65 6 7 66 512
66 7 7 67 512
67 8 7 68 512
68 9 7 69 512
69 10 7 70 512
70 1 8 71 512
71 2 8 72 512
What I wanna do is to read all the data above and buffer them in a queue for each user( there are only 10 users in total).
I already created a class called Class packet:
public class packet {
    private int timestamp;
    private int user_id;
    private int packet_id;
    private int packet_seqno;
    private int packet_size;
    /** Creates a new instance of packet */
    public packet(int timestamp,int user_id, int packet_id,int packet_seqno, int packet_size)
        this.timestamp = timestamp;
        this.user_id=user_id;
        this.packet_id=packet_id;
        this.packet_seqno=packet_seqno;
        this.packet_size=packet_size;
}then I wanna to create another Class called Class user which I can create a queue for each user (10 users in total) to store type packet information. the queue for each user will be in the order by timestamp.
any idea and sample code will be appreciated.

Doesn't sound too hard to me. Your class User (the convention says to capitalize class names) will have an ArrayList or Vector in it to represent the queue, and a method to store a Packet object into the List. An array or ArrayList or Vector will hold the 10 user objects. You will find the right user object from packet.user_id and call the method.
Please try to write some code yourself. You won't learn anything from having someone else write it for you. Look at sample code using ArrayList and Vector, there's plenty out there. Post in the forum again if your code turns out not to behave.

Reading a text file from a URL

I am having problems trying to read a text file from a URL.
This is the code i have been using:
package Java;
import java.net.*;
import java.io.*;
public class Main_1 {
public static void main(String[] args) throws Exception {
     URL myAddress = new URL("http://www.geocities.com/simonrobinson1/java/farrago.txt");
     BufferedReader in = new BufferedReader(
                    new InputStreamReader(
                    myAddress.openStream()));
     String inputLine;
     while ((inputLine = in.readLine()) != null)
     System.out.println(inputLine);
     in.close();
but it returns an error saying:
java.net.NoRouteToHostException: Operation timed out: no further information
at java.net.PlainSocketImpl.socketConnect(Native Method) .....etc etc.
Is this just a problem due to my network or is there something wrong with my code ????

Altho you can access the file by typing the URL in a browser, geocities being a free web-hosting service don't like you to access the materials without seeing their ads. You have to find a way to trick it into thinking that you are indeed coming in from a web browser even tho you aren't.
V.V.

From an Oracle form, I want to read a text file.

From an Oracle form, I want to read a text file. In the form on a button press I have:
declare
in_file Text_IO.File_Type;
linebuf VARCHAR2(1800);
filename VARCHAR2(30);
BEGIN
filename:=GET_FILE_NAME('U:\ora_devl\pps\work\a.txt', File_Filter=>'Text Files (*.txt)|*.txt|');
in_file := Text_IO.Fopen(filename, 'r');
LOOP
Text_IO.Get_Line(in_file, linebuf);
-- :text_item5:=:text_item5||linebuf||chr(10);
Text_IO.New_Line;
END LOOP;
EXCEPTION
WHEN no_data_found THEN
Text_IO.Put_Line('Closing the file...');
Text_IO.Fclose(in_file);
END;
It gets an ORA-302000. I suspect the problem starts with the GET_FILE_NAME because when I comment out everything but that, It processes endlessly never ending.
Forms [32 Bit] Version 11.1.1.3.0 (Production)
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
What can you tell me? Thanks

GET_FILE_NAME will try to open an "Open File" dialog on the server, which obviously can't happen. If you want to use that type of behavior you need to use WebUtil and the function CLIENT_GET_FILE_NAME. Example:
filename := CLIENT_GET_FILE_NAME('C:\', File_Filter=> 'Text Files (*.txt)|*.txt|All Files (*.*)|*.*|', dialog_type=> OPEN_FILE);Refer to the Builder Online help for more details. You can also refer to the demo which is available here:
http://www.oracle.com/technetwork/developer-tools/forms/downloads/index.html
More information here:
http://www.oracle.com/technetwork/developer-tools/forms/webutil-090641.html
Also, it appears that you are attempting to use a mapped drive ("U"). Although this can be made to work, it is not recommended and in some cases will not be supported. If you need access to remote files, you should use some other mechanism to bring the file to the local machine before manipulating it.

Reading Windows text file in Fortran?

Is there a way to make the f90 compiler read Windows text files properly? I made a simple test with a text file created on a Windows system containing these three lines:
This is a Windows text file.
It has some extra control characters.
Unix does not have those.
The output I got was:
<-ext file.
<-e extra control characters.
<-se.
Kevin

That makes more sense. The problem isn't with the Fortran program, but with the Unix terminal (xterm, or whatever you're using to display the output). If you pipe the output through od like this you'll see all the characters, including the ^M:
bash-3.00$ fortranread | od -c
0000000       w   i   n   f   i   l   e       i   s       -   >   T   h
0000020   i   s       i   s       a       W   i   n   d   o   w   s
0000040   t   e   x   t       f   i   l   e   . \r
0000060
0000100                                           <   - \n       w   i
0000120   n   f   i   l   e       i   s       -   >   I   t       h   a
0000140   s       s   o   m   e       e   x   t   r   a       c   o   n
0000160   t   r   o   l       c   h   a   r   a   c   t   e   r   s   .
0000200 \r
0000220                               <   - \n       w   i   n   f   i
0000240   l   e       i   s       -   >   U   n   i   x       d   o   e
0000260   s       n   o   t       h   a   v   e       t   h   o   s   e
0000300   . \r
0000320
0000340                   <   - \n
0000347When the terminal sees the ^M character, it does a carriage return. That means that the next character gets written in the first column. Since the characters after the ^M are spaces, that makes the beginning of the lines appear blank.
If you want to see the output you expect, you need to pipe it through "tr -d '\015'", or you need to make the Fortran program itself delete the ^M characters. For example, you could write "myline(1:len_trim(myline)-1)" to always strip the last character of the line.
We should consider making formatted reads strip the ^M by default. I don't know whether any program would actually want them.

How to scan/ read a text file, pick up only lines you wanted.

I'm new to Labview, I trying to wire a VI which can read a text file
example below:
Example: My Text File:
1 abcd
2 efgh
8 aaaa
1 uuuu
and pick out only any line which start with number 1 (i.e 1 abcd)
then output these 2 lines out to a a new text file?
Thanks,
Palmtree

Hi,
How do you creat your text files? Depending on the programm, there is added characters in the beginning and at the and of the file. So here you will find a VI to creat "raw" text files.
To debug your VIs, use the probs and breakpoints, so you can solve the problem by your self or give an more accurate description of it.
There is also the VI that read a integer and two strings (%d %s %s)
Attachments:
creat text file.vi ‏9 KB
read_from_file.vi ‏14 KB

Read from text file takes very long after the first time

Dear LabVIEW experts,
I'm having a problem with read from text file. I'm trying to read only every nth line of a file for a preview with this sub vi:
I seems to work well the first time I do it. The loop takes almost no time to execute an iteration.
Then when I load the same file again with exactly the same settings one iteration takes around 50ms.
Subsequent attempts seem to always take the longer execution time.
Only when I restart the calling vi it will be quick for one file.
When executing the sub vi alone it is always quick, but I don't see how the main vi (too complex to post here) could obstruct the execution of the sub vi.
I don't have a the file opened elsewhere in the main vi, I don't use too much memory...
Right now I don't now where to look. Does anyone have an idea?
Regards
Florian
Solved!
Go to Solution.

I don't know the LabVIEW internals here, but I would think that it is quite possible that closing a file opened for read/write access writes a new copy of the file to disk, or at least checks the file in order to make sure a new file does not have to be written.
Therefore, if your main VI calls this subVI sequentially (you don't give any information about the place of this subVI in the main VI), you are actually looking at a close (check/write) -> open operation for any time you call it, as opposed to a simple open operation the first time. If you were to open the file for simple read access (since that's all you do), it should work fast every time because there is no need to check to see if it has changed.
Cameron
To err is human, but to really foul it up requires a computer.
The optimist believes we are in the best of all possible worlds - the pessimist fears this is true.
Profanity is the one language all programmers know best.
An expert is someone who has made all the possible mistakes.
To learn something about LabVIEW at no extra cost, work the online LabVIEW tutorial(s):
LabVIEW Unit 1 - Getting Started
Learn to Use LabVIEW with MyDAQ

Reading a text file and transferring values into array

Hi,
I have a problem. So what I am trying to do is that, I read a text file and insert specific values from the text file into an array for future needs.
But I have to make sure that there is no duplicate entries. So thats what I have but, my method takes forever to finish...
here is my code:
String nomFichier = "Test_" + numTest + "_" + date + ".txt";
        String ligne = "";
        int z = 0;
        int j = 0;
        BufferedReader lecteurFichier = new BufferedReader(new FileReader(nomFichier));
        while ((ligne = lecteurFichier.readLine()) != null) {
            if (z > 3)
                String valeur = "";
                String dist = "";
                boolean unique = true;
                String [] chiffre = ligne.split(";");
                 if (intervalleAnalyser == 1)
                    valeur = chiffre[3];
                    dist = chiffre[4];
                if (intervalleAnalyser == 2)
                    valeur = chiffre[2];
                    dist = chiffre[4];
                if (intervalleAnalyser == 3)
                    valeur = chiffre[1];
                    dist = chiffre[4];
                if (z == 4) {
                    intervalleDiagramme[j] = valeur;
                    j++;
                if (z > 4) {
                    for (int i = 0; i < intervalleDiagramme.length; i++)
                         for (int x = 0; x < i; x++)
                             if(intervalleDiagramme[i] == intervalleDiagramme[x])
                                unique = false;
                    if (unique)
                        intervalleDiagramme[j] = valeur;
                    j++;
            z++;
        lecteurFichier.close(); // toujours fermer le fichier

Hi,
Thanks for your reply,
1) Yeah I have a method that asks the question and assigns it to a variable.
2) Well the z will stop once there is no lines to read no?
for the set.add(), I am not that familar...
I changed bit a code and I have this now:
if (z > 4) {
                    for (int i = 0; i < intervalleDiagramme.length; i++)
                        System.out.println(intervalleDiagramme);
if(intervalleDiagramme[i].equals(valeur))
System.out.println(intervalleDiagramme[i] + " " + valeur);
unique = false;
if (unique)
intervalleDiagramme[j] = valeur;
EDIT:
I figured a way to assign " " to all the values in my array. But I get this error:
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 380
at TP3.lireFichier(TP3.java:305)
And my line 305 is: intervalleDiagramme[j] = valeur;
EDIT2:
So ok I found my mistake and corrected it. But I want to know is there a way of doing this without setting the size of the array? because sometimes there needs to be 21 values sometimes 19 and sometimes 20....
If I take out: = new String [21] out I get a NullPointer error...
Edited by: Ara1992Habs on Dec 13, 2009 7:29 AM
Edited by: Ara1992Habs on Dec 13, 2009 7:37 AM

Problem reading Japanese text file

Similar Messages

Maybe you are looking for