How to handle multiple threads to read one line from a file each time?

Dear Sir or Madam,
I'm new to multiple threads java programming. What I want to do is as following:
1. I'm writing a program to read one line of text from a very large file, and then do some process on this one line of text, then read the next line of text from this file, then process on this line of text, ...... When reach the end of the file, close the file.
This is a single thread scenario.
2. To fullly untilized computer resource, I want to create multiple threads to process this large file.
One thing is very important is that each line of text in the large file has to be read sequentially. This means that the first line of text in the large file is read first, then the second line, then the third line ......
My question is that if I create multiple threads to process the same file, how can I make sure that different threads will read the line of text from the same file sequentially?
I don't have enough experience on java multiple threads programming, so it will be very appreaciated if you can help me on this as soon as you are available.
Thanks and regards,
Steven Wu

A better solutoin would be to have a single thread that reads each line an puts it into a queue, and then multiple threads reading from the queue to process these lines.
This will only be effective if the amount of processing to be done on each line is very large compared to how long it takes to read the line, or if you have more than one CPU on your machine.

Similar Messages

Reading one line from a text file into an array

i want to read one line from a text file into an array, and then the next line into a different array. both arays are type string...i have this:
public static void readAndProcessData(FileInputStream stream){
     InputStreamReader iStrReader = new InputStreamReader (stream);
     BufferedReader reader = new BufferedReader (iStrReader);
     String line = "";
     try{
     int i = 0;
          while (line != null){
               names[i] = reader.readLine();
               score[i] = reader.readLine();
               line = reader.readLine();
               i++;
          }catch (IOException e){
          System.out.println("Error in file access");
this section calls it:
try{
     FileInputStream stream = new FileInputStream("ISU.txt");
          HighScore.readAndProcessData(stream);
          stream.close();
          names = HighScore.getNames();
          scores = HighScore.getScores();
     }catch(IOException e){
          System.out.println("Error in accessing file." + e.toString());
it gives me an array index out of bounds error

oh wait I see it when I looked at the original quote.
They array you made called names or the other one is prob too small for the amount of names that you have in the file. Hence as I increases it eventually goes out of bounds of the array so you should probably resize the array if that happens.

How can I input read a line from a file and output it into the screen?

How can I input read a line from a file and output it into the screen?
If I have a file contains html code and I only want the URL, for example, www24.brinkster.com how can I read that into the buffer and write the output into the screen that using Java?
Any help will be appreciate!
======START FILE default.html ========
<html>
<body>
 
<center>

Welcome to a DerekTran's Website! 
Underconstructions.... 
 </center>
 
Hello, 
 
I've been using the PWS to run the website on NT workstation 4.0. It was working
fine. 
The URL should be as below: 
http://127.0.0.1/index.htm or http://localhost/index.htm
And suddently, it stops working, it can't find the connection. I tried to figure
out what's going on, but still NO CLUES. Does anyone
know what's going on? Please see the link for more.... I believe that I setup
everything correctly and the bugs still flying in the server.... 
Thank you for your help.

PeerWebServer.doc
 
CannotFindServer.doc
 
HOSTS file is not found
 
LMHOSTS file
 
How to Setup PWS on NT
 
Issdmin doc
Please be patient while the document is download....
 If you have any ideas please drop me a
few words at [email protected] 
 
 

 
</body>
</html>
========= END OF FILE ===============

Hi!
This is a possible solution to your problem.
import java.io.*;
class AddressExtractor {
 public static void main(String args[]) throws IOException{
 //retrieve the commandline parameters
 String fileName = "default.html";
 if (args.length != 0) fileName =args[0];
 else {
 System.out.println("Usage : java AddressExtractor <htmlfile>");
 System.exit(0);
 BufferedReader in = new BufferedReader(new FileReader(new File(fileName)));
 StreamTokenizer st = new StreamTokenizer(in);
 st.lowerCaseMode(true);
 st.wordChars('/','/'); //include '/' chars as part of token
 st.wordChars(':',':'); //include ':' chars as part of token
 st.quoteChar('\"'); //set the " quote char
 int i;
 while (st.ttype != StreamTokenizer.TT_EOF) {
 i = st.nextToken();
 if (st.ttype == StreamTokenizer.TT_WORD) {
 if (st.sval.equals("href")) {
 i = st.nextToken(); //the next token (assumed) is the '=' sign
 i = st.nextToken(); //then after it is the href value.
 getURL(st.sval); //retrieve address
 in.close();
 static void getURL(String s) {
 //Check string if it has http:// and truncate if it does
 if (s.indexOf("http://") > -1) {
 s = s.substring(s.indexOf("http://") + 7, s.length());
 //check if not mailto: do not print otherwise
 if (s.indexOf("mailto:") != -1) return;
 //printout anything after http:// and the next '/'
 //if no '/' then print all
 if (s.indexOf('/') > -1) {
 System.out.println(s.substring(0, s.indexOf('/')));
 } else System.out.println(s);
}Hope this helps. I used static methods instead of encapsulating everyting into a class.

How to process other task when reading the data from a file?

Hello,
I met a problem. I created a GUI to control the audio data processing. When the "Start" button is pressed, a block of data is read from the audio file and processed, then loop.But other buttons or method cannot be operated in that procession until all data is processed.
How to let the other methods work under that circumstance? Should I use multiple threads?
The relative code:
SourceDataLine line;
boolean stop = false;
// When press "Start" button, the following method is invoked:
public void play(){
line.start();
int bytesRead = 0;
byte[] dataBuf = new byte[7500];
while (bytesRead != -1& !stop)
try
bytesRead = audioInputStream.read(dataBuf, 0, dataBuf.length);
catch (IOException e)
e.printStackTrace();
if (bytesRead >= 0)
int bytesWritten = line.write(dataBuf, 0, bytesRead);
line.drain();
// When press "stop" button, this method is invoked.
public void stop(){
stop = true;
line.stop();
// When press "***" button, the following button is invoked:
public void ***(){
Many thanks.Looking forward to getting your answer.

You have to use a seperate thread :
Wheb you press the start button, you have to make sure a seperate thread is started :
Thread runner = new Thread(){
public void run(){
//Here comes your code which reads the file
runner.start();
KR,
Jan

How to read long line from text file

Hi,
I just faced problem when reading a big text file.
BufferedReader br = new BufferedReader(new FileReader("D:\\afile.txt"));
String str;
int i;
while ((str = br.readLine())!=null)
i++;
//do some work here...
...This code throws exception:
Exception in thread "main" java.lang.OutOfMemoryError: Java heap spaceSo I thought file line is very long. When I opened it in FAR it only displays no more than 4096 characters as a line.
Help me to read a text file that's line is very long?

try,
$ java -X
-Xmixed mixed mode execution (default)
-Xint interpreted mode execution only
-Xbootclasspath:<directories and zip/jar files separated by ;>
set search path for bootstrap classes and resources
-Xbootclasspath/a:<directories and zip/jar files separated by ;>
append to end of bootstrap class path
-Xbootclasspath/p:<directories and zip/jar files separated by ;>
prepend in front of bootstrap class path
-Xnoclassgc disable class garbage collection
-Xincgc enable incremental garbage collection
-Xloggc:<file> log GC status to a file with time stamps
-Xbatch disable background compilation
-Xms<size> set initial Java heap size
-Xmx<size> set maximum Java heap size
-Xss<size> set java thread stack size
-Xprof output cpu profiling data
-Xrunhprof[:help]|[:<option>=<value>, ...]
perform JVMPI heap, cpu, or monitor profiling
-Xdebug enable remote debugging
-Xfuture enable strictest checks, anticipating future default
-Xrs reduce use of OS signals by Java/VM (see documentation)
-Xcheck:jni perform additional checks for JNI functions
The -X options are non-standard and subject to change without notice.

Read Multi Line from External File

Greetings all,
I am building a page that has random Bible scripture on the
bottom and I have the scriptures saved in a text file and flash
pulls it from there. I am trying to get the Chapter and verse
portion of the text to be on a new line when brought in to the
page. Examples:
quote0=And the second is like it: 'Love your neighbor as
yourself'. Matthew 22:39
&quote1=And we know that in all things God works for the
good of those who love him, who have been called according to his
purpose. Romans 8:28
&quote2=Do not repay anyone evil for evil. Be careful to
do what is right in the eyes of everybody. Romans 12:17
&quote3=Humility and the fear of the LORD bring wealth
and honor and life. Proverbs 22:4
&quote4=In everything I did, I showed you that by this
kind of hard work we must help the weak, remembering the words the
Lord Jesus himself said: 'It is more blessed to give than to
receive.' Acts 20:35
&quote5=Blessed is he who has regard for the weak; the
LORD delivers him in times of trouble. Psalm 41:1
&quote6=Turn from evil and do good; then you will dwell
in the land forever. Psalm 37:27
&quote7=Worship the LORD with gladness; come before him
with joyful songs. Psalm 100:2
&quote8=The Father loves the Son and has placed
everything in his hands. John 3:35
Notice at the end of each scripture is the chapter and verse.
Is there a way to get this to automatically get created on a new
line? On some of them, it looks funny on the page because the
Chapter name will be on one line and the verse numbers on the next.
You can see an example of the output at
www.southernhospitalitycaterers.com to see what I am referring to.
I have tried \r \n and many combinations to no avail and
would appreciate any assistance.
Thanks
Wally

You could create the chapter/verse# as separate variables.
OR
You could put a special set of characters, like "xyz" to
separate them in the file and then replace it with a line return.
AS3 has the String.replace() method and AS2 has the
Textfield.replaceText() method.

How to Handle Multiple Thread in JAVA Callout with OSB 11g

Hi Team,
With My OSB 11g, I want create a static Thread when Java callout.
Java code as below.
     private static Thread thread;
static {
          * lazy load thread and with thread-safe ensure
          if(thread == null){
               synchronized (HornetQConnectionHelper.class) {
                    thread = new ConnectionRecoveryThread();
                    // Daemon thread, JVM level, Won't be interrupted, Safe!
                    thread.setDaemon(true);
                    thread.start();
When this class was first called in OSB, the thread start run. while when I redeploy it, the old Thread is still running, if call the class again, it will create a new Thread. The two threads will run at the same time.
Any body know how do configure it, so that there is only one static Thread in the Weblogic JVM.
Thanks.
Best Regards,
Raysen Jia

Hi Raysen Jia,
Create a weblogic startup class... See the references bellow...
Hope this is helpful...
http://jagadesh4java.blogspot.com.au/2010/05/working-with-weblogic-startup-shutdown.html
http://docs.oracle.com/cd/E23943_01/upgrade.1111/e10126/basic_upgrade.htm#FUPAS464
Cheers,
Vlad

How to export multiple separate tracks as one song from Logic to iTunes?

I know how to export the separate tracks that i have recorded, but i want to be able to save all of the tracks into one song, in other words, i want to be able to take my recording from logic 8 and export the entire thing, not just separate tracks, into a file that iTunes can read. Any help/suggestions?

Select "Bounce" (upper right part of Logic arrange window) and make sure MP3 is check under "Destination". This will cause all tracks to be written to a single MP3 stereo file. However, if you have any tracks muted they will not be included in the bounce. Also, make sure no track is "Solo" else you will only get THAT track.
I am assuming that you have mixed all the tracks and done any "mastering".
Once the MP3 file is generated just drag it into iTunes, right click on the song, and then select Get Info and the "Info" tab to assign Artist/Album/etc.
It is very easy......

How to read a line from a file which contains 45000 characters?

Hi all,
     Iam a receiving a .CSV file which contains n number of rows ,each row has a data seperated with delimiter.
These values based on delimiter it is seperated and certain validations are handled.
Iam using UTL_FILE.GET_LINE operator to read the value and store it in a variable which is declared as l_text VARCHAR2(30000).
when we receive a line which contains huge characters say 45000 then it throws an error(Unable to read the file).
Only on rare cases we used to receive these kind of files with huge size.
Kindly help to solve this issues.
Database details.
Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production
PL/SQL Release 11.2.0.2.0 - Production
CORE 11.2.0.2.0 Production
TNS for Linux: Version 11.2.0.2.0 - Production
NLSRTL Version 11.2.0.2.0 - Production
Hereby i have tried with long Raw data type but still same error unable to read the file.pls find the sample code below,
declare
l_text             LONG RAW;
l_importTypeFile   UTL_FILE.FILE_TYPE ;
begin
     PKG_COMMON.PROC_FOPEN(g_Directory, P_FILENAME,    'RB',l_importTypeFile,    p_error_cd, p_error_msg) ;
UTL_FILE.GET_RAW(l_ImportTypeFile,l_Text);
End;
Thanks in Advance
Siva

Hi Siva,
Are you trying to use data from this .csv file into your realtion tables. If yes and If you are using 11g Oracle database. I would suggest you create External Tables using the below query,
http://www.oracle.com/technetwork/issue-archive/2011/11-mar/o21nanda-312277.html
STEP1: You need a Directory where your SCHEMA has read/write access. Store the csv file in that directory.
STEP2: Create an EXTERNAL Table script. Please refer the above URL. Examples are for coma delimiter (,); replace it with your pipe (|) in the code
STEP: Once your external table is created you can simply create a relational table as below:
CREATE TABLE relation_table
AS
SELECT * FROM external_table;
Regards,
RaviR

Problem while reading a line from a file

Hi all
I am facing a problem while readinga line from a file ,
line contains some french characters due to which it skips sequence, returning invalid record in a variable
e.g 'abcdefghÛLasasa'
Starting Point of Û is 9 and if
V1:=substr(''abcdefghÛLasasa',9,3)
result is v1='ÛLas' which is invalid
can i anybody help me out in resolving this problem

Hello,
What is your oracle version? And what is your expected result.
I used the same string and this is my output on 10.2.
select substr('abcdefghÛLasasa',9,3) mystring from dual;
MYS
ÛLa
1 row selected.Regards
Edited by: OrionNet on Jan 29, 2009 12:45 AM

How to handle multiple tables data in Entity Beans?

How to handle multiple tables data in Entity Beans?
i mean, my bean (non trivial) is responsible for frequent
insertion in one table and some deletion on another table.
Can anyone of you...please..?

Is your data model right? If you are adding in one and deleting in another it sounds to me more like a process that an entity, in which case you may revisit your data model and simplify it, add in a session bean with the process method to co-ordinate between the two.
However, if you want to map multiple different tables within a single entity bean it is possible and just part of the mapping. How you actualyl specify it depends on which implementation you are working with.
Cheers,
Peter.

How to handle multiple datasources in a web application?

I have a J2EE Web application with Servlets and Java ServerPages. Beside this I have a in-house developed API for certain services built using Hibernate and Spring with POJO's and some EJB.
There are 8 databases which will be used by the web application. I have heard that multiple datasources with Spring is hard to design around. Considering that I have no choice not to use Spring or Hibernate as the API's are using it.
Anyone have a good design spesification for how to handle multiple datasources. The datasource(database) will be chosen by the user in the web application.

Let me get this straight. You have a web application that uses spring framework and hibernate to access the database. You want the user to be able to select the database that he wants to access using spring and hibernate.
Hopefully you are using the Spring Framework Hibernate DAO. I know you can have more that one spring application context. You can then trying to load a seperate spring application context for each database. Each application context would have it's own configuration files with the connection parameters for each datasource. You could still use JNDi entries in the web.xml for each datasource.
Then you would need a service locater so that when a user selected a datasource he would get the application context for that datasource which he would use for the rest of his session.
I think it is doable. It means a long load time. And you'll need to keep the application contexts as small as possible to conserve resources.

How to handle multiple actions in the webservice ?

Hi Guys,
I have multiple operations in the webservcie and under soap action in the receiver soap adapter, i dont know how to handle multiple soap operations.
can anybody guide me, how to acheive this ?
Thanks,
srini

Hi Srini !
This weblog shows the general design of a scenario with BPM
/people/krishna.moorthyp/blog/2005/06/09/walkthrough-with-bpm
This link:
http://help.sap.com/saphelp_nw04/helpdata/en/de/766840bf0cbf49e10000000a1550b0/content.htm
show how to insert a predefined BPM pattern. You could use one of the BpmPatternSerialize.... patterns to see how you BPM should look like...
Basically it should be:
1) Receive Step (async/sync, as you need) to trigger the BPM
2) Send step (sync) for first webservice
3) Send step (sync) for second webservice
N) Send step (sync) for N webservice
N+1) if the whole communication is sync, here you need to use a send step to return back the answer to sender.
Regards,
Matias.

How to handle multiple request in the servlet

how to handle multiple request in the servlet...
Example:
java forum...
i'm login in the java forum at this time 1000 members make login in this....how happended in servlet?
if we use thread how to implement in servlet ?

Serlets are already threaded. The application container instantiates the servlet, then uses this instance in a new thread for every use.
This is the reason that you should use (almost) no instance variables in a Servlet, but rather that (almost) everything should be local to the method.

How to handle multiple connection or user with l2cap

hi friends,
I need your help please a.s.a.p
how to handle multiple connection with l2cap protocol in j2me
sorry,
I'm a new programmer in j2me
thanks all...

Please stick with the original thread http://forum.java.sun.com/thread.jspa?threadID=5200413&tstart=0
Cross-posting is very rude, and JSch has nothing to do with JSSE, directly. It is an SSH2 API. It does (AFAIK) use some parts of JSSE, but those parts are definately not your problem.
You already have answers in the other thread.

How to handle multiple threads to read one line from a file each time?

Similar Messages

Maybe you are looking for