Output verbose to file and console?

Hello all,
I'm running my PowerShell script from a batch file, and I'm trying to output the verbose statements to a log file as well as to the console. In the batch file I have:
powershell.exe -command ".\Script.ps1 -verbose 4> ScriptLOG.txt"
What I can't figure out is how to incorporate another redirector to have the output also output to the console as well as the LOG file.
Any ideas?

I think we need to realize that each of the redirectalble outputs is a single handle opened to a specific target. When we redirect "standard I/O channel 4" to a file we are reallu closin handle 4 and opening it to a file. We can only
output to a single open handle at a time. THe console is the default handle most of the time. 4 is noramally opend to the console. All of the other handles are opened to teh console until redirected. The default output of the pipeline
is also sent to the console. THe objects are enumerated and formatted to the console for the operator but they really only exist in memory.
I normally write custom loggers.
You can also use "Get-Content file.txt -Wait -Tail 1"
This will display they output to the file one line at a time. This allows monitoring the verbose channel.
¯\_(ツ)_/¯

Similar Messages

Is it possible to have 2 different output config XML files and index the data into 2 endeca apps using the same indexing component ProductCatalogSimpleIndexingAdmin

Hi ,
We have a catalog that defines 2 types of products (they have too many different properties), so wanted to keep them on two different MDEX engines and serve the applications requests. Here DB catalog and front end ATG application is same for both the MDEX instances.
Is it possible to have 2 different output config XML files and index the data into 2 endeca apps using the same indexing component ProductCatalogSimpleIndexingAdmin?
Thanks
Dev

Hi, also have had some problem some monthes ago - I created separete component ProductCatalogSimpleIndexingAdminSecond. After that one of my colleage gave me some advice:
The creating separate component like ProductCatalogSimpleIndexingAdmin for the second IOC is possible way for resolving your situation. But I afraid that this way will be required creating mane duplicates for already existed components.
In my opinion the better way is the following:
starting from AssemblerApplicationConfiguration and ApplicationConfiguration component. It contains details for connecting between ATG and Endeca. Of course you should configure different components for different Endeca Apps.
After that:
Find all components that uses AssemblerApplicationConfiguration and ApplicationConfiguration. Customize these components for using one or another *Configuration component depending on what index works. (many variants released it: the most simple global custom component with flag.)
Then customize the existed ProductCatalogSimpleIndexingAdmin. Using one or another IOC and setting the flag in global custom component when index started. You can add some methods into your custom ProductCatalogSimpleIndexingAdmin like:
Execute baseline index for both IOC (one by one)
Execute baseline for IOC 1
Execute baseline for IOC 2.
Note: you should be afraid about incremental (partial) index in this configuration. But resolving conflicts in incremental index should be done after full implementation these changes.
Regards

Split SQR output into multiple files And Rename each file.

Greetings!
We ran into scenario where we need to split an SQR output (PDF) split into multiple files (each page , each file). More over the out put has to be renamed with EMPLID.
It is for printing Advices, where we run DDP003 to print all of them, Our requirement needs to have one PDF file for each employee to placed into a shared drive OR to be emailed.
I was thinking of running the same process in a loop individually, but this is resource intensive. Is there any way we can batch run this SQR process and split into each page (each paychek comes to one page),
AND
I need them renamed by SQR as it creates them, Each file would be names as EMPLID.
This is all in alternative to run process individually by employee , via self service. to not to over laod Process scheduler server.
Can anyone help me how can we get these thigns done in SQR?
Thanks in advance.

You can use the SQR command new-report for each employee which closes the current report output file and opens a new one with the specified file name (e.g. EMPLID).

Is it better to output t master file and then upload to youtube?

I had to upload 33 videos to youtube today
This has taken tooo long
Just wondering, is it better to create a master file and then upload to youtube?
I could maybe just copy the files to another machine and leave it to upload?
Thanks
Omar

just to add:
don't try to upload your Masterfile to YouTube!
usually, the Masterfile is a copy of the projects timeline = proRes.
that creates incredible large files = time for upload, wasting bandwidth, and YT will complain 'wrong settings'
After saving a masterfile, which goes fast, you should use a 'Converter' of your choice (QuicktimePro, Mpg Streamclip, Compressor) to transcode into YT's recommended upload settings.-

Output report to file and Screen

Is there a way to send the output of a report to a file (PDF) and also see the output on the screen? I am trying to use the "Distribution" feature but it is not working or maybe I am doing something wrong. Please help me.

"C:" drive for server is not your PC's "C" drive, but it's own "C" drive. If the servier is on the same network, you need to make your C drive available to the server, and specify the full path to it as seen from the server (Includeing machine name, etc.). Otherwise, you can only save the file to the server.

How to generate report output in csv file and send it to user email inbox

Hi All,
We have requiremnt to generate the csv file from the report (Bex query)automatically and need to send that file automatically to user email address every week.
It should be done automatically and one more thing the file name should contain that particuar date
for example if we generate file automatically today the file name should be like below.
US_04_15_2009.CSV
Any one have any ideas?
Regards,
Sirisha

Hi Arun Varadarajan.
Thanks for your reply.We are in BI 7.0.Can you tell me how to broadcast the query as CSV.Please let me know if there is any possiblity to display or change the file name dynamically based on system date.
Regards,
Sirisha
Edited by: sirisha Nekkanti on Apr 16, 2009 4:08 AM

Reports output to a file and printer/previewer

Group,
It's been a while since I messed with reports, but I have been given the requirement to somehow save a copy of a generated report, so that it could be reprinted at some later date exactly as it was originally printed. My initial thought was to save a copy of the report in pdf format at the time it was printed. Uses a unique file name and record that in our app.
My questions are is that technically possible, ie save to unique (to that printing) named pdf file at the same time it is printed? Or would they have to run the report twice? Once for the printer and once for the pdf file?
Are there any better alternative methods?
We are currently using forms/reports 6i, soon to be moving to 10g. But the requirement for this feature is required before we move to 10g. This would be required to work on several different reports.
Thanks for any advice.
--pat

6i client server. Calling reports from forms.
So the save to file first then print with host is an option. Will that work with previewer?
thanks.
--pat

"Notching" a quicktime file and getting color to recognize it.

I am long time TV/Film editor with some good technical background. I am little stumped how to get FCP & Color 1.5 to do what I want.
What I have are a number of Quicktime files of already competed shows. Now I want to do shot to shot color correction. The manual solution which works is to simply go back and blade the entire timeline at each shot. This new sequence passes fine into Color 1.5. However since I have a number of these QT movies, I would much prefer to find an automated solution.
I have downloaded trial versions of Scene Detector and and Tokai. They both seem to do an adequate job of detecting shot to shot. With Scene Detector, I can can output an XML file and an EDL. Importing the XML back into FCP7, I get a 'new' master clip with the right video and a whole new series of Markers which are on the cuts. As for EDL's made from Scene Detector (there are 4 kinds) none can be imported in FCP7. More importantly, I can get neither the XML or EDL imported into color. I think I am creating a new color project each time but I am little uncertain. How can I tell if a Color Project is locked.
Using Tokai, I got something to import into Color 1.5 once, but now I can not repeat it. Using FCP, I can import a Tokai EDL, but its now just a a number of new clips in a timeline that won't link back up to the media (well I haven't figure that out).
Thanks
Doug
Message was edited by: Doug Weiner
Message was edited by: Doug Weiner

COLOR is designed to import QT's with CMX EDL's, but razoring the QT on an FCP timeline is how the roundtrip workflow gets established. It is not obviously advantageous, since it entails a bit of work -- but it allows you to make some choices that will make life in COLOR a little bit easier. Usually a CMX EDL will set up a series of "in-frame" events to define dissolves (since this is how it was done in the '80s when this approach was invented) -- but its not actually what you want to do in an NLE application. You will discover that grades cannot be pasted into keyframes, individual room corrections have to be pasted in, one at a time -- so its a tradeoff depending on how complex the finished video is.
jPo

// Code Help need .. in Reading CSV file and display the Output.

Hi All,
I am a new Bee in code and started learning code, I have stared with Console application and need your advice and suggestion.
I want to write a code which read the input from the CSV file and display the output in console application combination of first name and lastname append with the name of the collage in village
The example of CSV file is
Firstname,LastName
Happy,Coding
Learn,C#
I want to display the output as
HappyCodingXYZCollage
LearnC#XYXCollage
The below is the code I have tried so far.
// .Reading a CSV
var reader = new StreamReader(File.OpenRead(@"D:\Users\RajaVill\Desktop\C#\input.csv"));
List<string> listA = new List<string>();
while (!reader.EndOfStream)
var line = reader.ReadLine();
string[] values = line.Split(',');
listA.Add(values[0]);
listA.Add(values[1]);
listA.Add(values[2]);
// listB.Add(values[1]);
foreach (string str in listA)
//StreamWriter writer = new StreamWriter(File.OpenWrite(@"D:\\suman.txt"));
Console.WriteLine("the value is {0}", str);
Console.ReadLine();
Kindly advice and let me know, How to read the column header of the CSV file. so I can apply my logic the display combination of firstname,lastname and name of the collage
Best Regards,
Raja Village Sync
Beginer Coder

Very simple example:
var column1 = new List<string>();
var column2 = new List<string>();
using (var rd = new StreamReader("filename.csv"))
while (!rd.EndOfStream)
var splits = rd.ReadLine().Split(';');
column1.Add(splits[0]);
column2.Add(splits[1]);
// print column1
Console.WriteLine("Column 1:");
foreach (var element in column1)
Console.WriteLine(element);
// print column2
Console.WriteLine("Column 2:");
foreach (var element in column2)
Console.WriteLine(element);
Mark as answer or vote as helpful if you find it useful | Ammar Zaied [MCP]

Not able to save report output in a text file and RTF file

I am using Oracle Developer6.0 . I am facing problem with reports. I am invoking reports from form using run_product.
1. I could not able to save the report in text file . Whenever i try to save the report output in a text file.It gives dump and application get closed.
2. In RTF format , it execute the query which i have given at the design time while creating a report . But while running i am passing query either through lexical parameter or passing value of where criteria user parameters. It display the output for the specified value. But when i save this report output in rtf file . It execute design time query and save that in a rtf file.
If any body is having any idea about it . Please let me ASAP . It is very urgent for me.
Thanks in advance

Try the following:
Do not generate the report to .rep file, but rename/copy the .rdf file to .rep file and execute it.

CMS crash with core files and multiple report output generation

Happy new year to everyone,
Our BOXIR3.1SP6FP2 env has recently started behaving weirdly by triggering multiple output to users inbox and email notification out of scheduled reports. Also we have noticed the CMS crash with core file (almost 4GB) generation at the time of multiple report output.
Most of the times, CMC crashes and recycles itself. At few times, CMS services alone went shut down.
OS details: RHEL 5.5, 32 GB RAM, 8 core processor on each of the clustered node, Oracle 10GR2.4 CMS DB server, 11GR2.4 oracle reporting DB server and oracle 11.1.0.6 client.
2015/01/21 23:54:37.946|>=| | |28123|1534131088|{|||||||||||||||DBQueue::Read
2015/01/21 23:54:37.946|==| | |28123|1496185744|
|||||||||||||||(OracleStatement.cpp:156) Prepare: SQL: SELECT ObjectID,
Version, LastModifyTime, CRC, Properties FROM CMS_InfoObjects6 WHERE ObjectID
IN (1004050) ORDER BY ObjectID
2015/01/21 23:54:37.946|==| | |28123|1496185744| ||||||||||||||(OracleStatement.cpp:183) Prepared statement Execute
2015/01/21 23:54:37.965|==| | |28123|1496451984| |||||||||||||||SResourceSource::LoadString 50293
2015/01/21 23:54:37.966|==| | |28123|1496451984| |||||||||||||||SResourceSource::LoadString Unknown exception in database thread
2015/01/21 23:54:37.967|==| | |28123|1496451984| |||||||||||||||SResourceSource::LoadString 33007
2015/01/21 23:54:37.967|==| | |28123|1496451984| |||||||||||||||SResourceSource::LoadString CMS is unstable and will shut down immediately. Reason: %1...
2015/01/21 23:54:38.506|==| | |28123|1496185744| |||||||||||||||(OracleStatement.cpp:156) Prepare: SQL: SELECT ObjectID,
Version, LastModifyTime, CRC, Properties FROM CMS_InfoObjects6 WHERE ObjectID IN (1009213) ORDER BY ObjectID
2015/01/21 23:54:38.506|==| | |28123|1496185744| |||||||||||||||(OracleStatement.cpp:183) Prepared statement Execute
2015/01/21 23:54:38.512|==| | |28123|1455592672| |||||||||||||||(sidaemon.cpp:549) SUNIXDaemon::run: server restart flag is 1..
2015/01/21 23:54:38.513|==| | |28123|1455592672| |||||||||||||||(sidaemon.cpp:552) SUNIXDaemon::run: in abort ...
2015/01/21 23:54:38.513|==| | |28123|1455592672| |||||||||||||||(sidaemon.cpp:555) SUNIXDaemon::run: doing the WithAbort case ...
2015/01/21 23:54:38.520|==| | |28123|1496185744| |||||||||||||||(dbq.cpp:1357) DBQ: Time required to read 1 objects: 20.000000 ms
Thank you,
Karthik

Hi Denis,
I'm trying my best for the last few weeks to understand the core issue along with SAP however it is still a mystery.
>Ulimit -a
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 270335
max locked memory       (kbytes, -l) 32
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 10240
cpu time               (seconds, -t) unlimited
max user processes              (-u) 270335
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
Below is the observation as part of troubleshooting:
1. CMS breaks at threshold of 3.9 G.
2. CMS DB sits in a different Linux server than BOE server.
3. All core files were generated by boe_cmsd process and are almost 4GB in size (same as max threshold which it breaks).
4. Shell script which I've added in the BOE servers shows that the CMS DB is available/connecting at the time of CMS crash.
5. SAP analysed the Core files and skeptical about the below lines.
     #3 0x58687b80 in skgesigCrash ()
      from /opt/oracle/product/11.1.0/client_1/lib32/libclntsh.so
     #4 0x58687e0d in skgesig_sigactionHandler ()
I'll continue troubleshooting with a hope to fix it at the earliest.
Thanks,
Karthik

Script to search all files in specified folder for multiple string text values listed in a source file and output each match to one single results txt file

I have been searching high and low for this one. I have a vbscript that can successfully perform the function if one file is listed. It does a Wscript.echo on the results and if I run this via command using cscript, I can output to a text file
that way. However, I cannot seem to get it to work properly if I want it to search ALL the files in the folder. At one point, I was able to have it create the output file and appear as if it worked, but it never showed any results when the script
was executed and folder was scanned. So I am going back to the drawing board and starting from the beginning.
I also have a txt file that contains the list of string text entries I would like it to search for. Just for testing, I placed 4 lines of sample text and one single matching text in various target files and nothing comes back. The current script
I use for each file has been executed with a few hundred string text lines I want it to search against to well over one thousand. It might take awhile, but it works every time. The purpose is to let this run against various log files in a folder and
let it search. There is no deleting, moving, changing of either the target folder/files to run against, nor of the file that contains the strings to search for. It is a search (read) only function, going thru the entire contents of the folder and
when done, performs the loop function and onto the next file to repeat the process until all files are searched. When completed, instead of running a cscript to execute the script and outputting the results to text, I am trying to create that as part
of the overall script. Saving yet another step for me to do.
My current script is set to append to the same results file and will echo [name of file I am searching]: No errors found. Otherwise, the
output shows the filename and the string text that matched. Because the results append to it, I can only run the script against each file separately or create individual output names. I would rather not do that if I could include it all in one.
This would also free me from babysitting it and running each file script separately upon the other's completion. I can continue with my job and come back later and view the completed report all in one. So
if I could perform this on an entire folder, then I would want the entries to include the filename, the line number that the match occurred on in that file and the string text that was matched (each occurrence). I don't want the entire line to be listed
where the error was, just the match itself.
Example: (In the event this doesn't display correctly below, each match, it's corresponding filename and line number all go together on the same line. It somehow posted the example jumbled when I listed it)
File1.txt Line 54
Job terminated unexpectedly
File1.txt Line 58 Process not completed
File1.txt
Line 101 User input not provided
File1.txt
Line 105 Process not completed
File2.txt
No errors found
File3.txt
Line 35 No tape media found
File3.txt
Line 156 Bad surface media
File3.txt Line 188
Process terminated
Those are just random fake examples for this post.
This allows me to perform analysis on a set of files for various projects I am doing. Later on, when the entire search is completed, I can go back to the results file and look and see what files had items I wish to follow up on. Therefore, the
line number that each match was found on will allow me to see the big picture of what was going on when the entry was logged.
I actually import the results file into a spreadsheet, where further information is stored regarding each individual text string I am using. Very useful.
If you know how I can successfully achieve this in one script, please share. I have seen plenty of posts out there where people have requested all different aspects of it, but I have yet to see it all put together in one and work successfully.
Thanks for helping.

I'm sorry. I was so consumed in locating the issue that I completely overlooked posting what exactly I was needing help with. I did have one created, but I came across one that seemed more organized than what I originally created. Later
on I would learn that I had an error in log location on my original script and therefore thought it wasn't working properly. Now that I am thinking that I am pretty close to achieving what I want with this one, I am just going to stick with it.
However, I could still use help on it. I am not sure what I did not set correctly or perhaps overlooking as a typing error that my very last line of this throws an "Expected Statement" error. If I end with End, then it still gives same
results.
So to give credit where I located this:
http://vbscriptwmi.uw.hu/ch12lev1sec7.html
I then adjusted it for what I was doing.
What this does does is it searches thru log files in a directory you specify when prompted. It looks for words that are contained in another file; objFile2, and outputs the results of all matching words in each of those log files to another file: errors.log
Once all files are scanned to the end, the objects are closed and then a message is echoed letting you know (whether there errors found or not), so you know the script has been completed.
What I had hoped to achieve was an output to the errors.log (when matches were found) the file name, the line number that match was located on in that file and what was the actual string text (not the whole line) that matched. That way, I can go directly
to each instance for particular events if further analysis is needed later on.
So I could use help on what statement should I be closing this with. What event, events or error did I overlook that I keep getting prompted for that. Any help would be appreciated.
Option Explicit
'Prompt user for the log file they want to search
Dim varLogPath
varLogPath = InputBox("Enter the complete path of the logs folder.")
'Create filesystem object
Dim oFSO
Set oFSO = WScript.CreateObject("Scripting.FileSystemObject")
'Creates the output file that will contain errors found during search
Dim oTSOut
Set oTSOut = oFSO.CreateTextFile("c:\Scripts\errors.log")
'Loop through each file in the folder
Dim oFile, varFoundNone
VarFoundNone = True
For Each oFile In oFSO.GetFolder(varLogPath).Files
'Verifies files scanned are log files
If LCase(Right(oFile.Name,3)) = "log" Then
'Open the log file
Dim oTS
oTS = oFSO.OpenTextFile(oFile.Path)
'Sets the file log that contains error list to look for
Dim oFile2
Set oFile2 = oFSO.OpenTextFile("c:\Scripts\livescan\lserrors.txt", ForReading)
'Begin reading each line of the textstream
Dim varLine
Do Until oTS.AtEndOfStream
varLine = oTS.ReadLine
Set objRegEx = CreateObject("VBScript.RegExp")
objRegEx.Global = True
Dim colMatches, strName, strText
Do Until oErrors.AtEndOfStream
strName = oFile2.ReadLine
objRegEx.Pattern = ".{0,}" & strName & ".{0,}\n"
Set colMatches = objRegEx.Execute(varLine)
If colMatches.Count > 0 Then
For Each strMatch in colMatches
strText = strText & strMatch.Value
WScript.Echo "Errors found."
oTSOut.WriteLine oFile.Name, varLine.Line, varLine
VarFoundNone = False
Next
End If
Loop
oTS.Close
oFile2.Close
oTSOut.Close
Exit Do
If VarFoundNone = True Then
WScript.Echo "No errors found."
Else
WScript.Echo "Errors found. Check logfile for more info."
End If
End if

How can I input read a line from a file and output it into the screen?

How can I input read a line from a file and output it into the screen?
If I have a file contains html code and I only want the URL, for example, www24.brinkster.com how can I read that into the buffer and write the output into the screen that using Java?
Any help will be appreciate!
======START FILE default.html ========
<html>
<body>
 
<center>

Welcome to a DerekTran's Website! 
Underconstructions.... 
 </center>
 
Hello, 
 
I've been using the PWS to run the website on NT workstation 4.0. It was working
fine. 
The URL should be as below: 
http://127.0.0.1/index.htm or http://localhost/index.htm
And suddently, it stops working, it can't find the connection. I tried to figure
out what's going on, but still NO CLUES. Does anyone
know what's going on? Please see the link for more.... I believe that I setup
everything correctly and the bugs still flying in the server.... 
Thank you for your help.

PeerWebServer.doc
 
CannotFindServer.doc
 
HOSTS file is not found
 
LMHOSTS file
 
How to Setup PWS on NT
 
Issdmin doc
Please be patient while the document is download....
 If you have any ideas please drop me a
few words at [email protected] 
 
 

 
</body>
</html>
========= END OF FILE ===============

Hi!
This is a possible solution to your problem.
import java.io.*;
class AddressExtractor {
 public static void main(String args[]) throws IOException{
 //retrieve the commandline parameters
 String fileName = "default.html";
 if (args.length != 0) fileName =args[0];
 else {
 System.out.println("Usage : java AddressExtractor <htmlfile>");
 System.exit(0);
 BufferedReader in = new BufferedReader(new FileReader(new File(fileName)));
 StreamTokenizer st = new StreamTokenizer(in);
 st.lowerCaseMode(true);
 st.wordChars('/','/'); //include '/' chars as part of token
 st.wordChars(':',':'); //include ':' chars as part of token
 st.quoteChar('\"'); //set the " quote char
 int i;
 while (st.ttype != StreamTokenizer.TT_EOF) {
 i = st.nextToken();
 if (st.ttype == StreamTokenizer.TT_WORD) {
 if (st.sval.equals("href")) {
 i = st.nextToken(); //the next token (assumed) is the '=' sign
 i = st.nextToken(); //then after it is the href value.
 getURL(st.sval); //retrieve address
 in.close();
 static void getURL(String s) {
 //Check string if it has http:// and truncate if it does
 if (s.indexOf("http://") > -1) {
 s = s.substring(s.indexOf("http://") + 7, s.length());
 //check if not mailto: do not print otherwise
 if (s.indexOf("mailto:") != -1) return;
 //printout anything after http:// and the next '/'
 //if no '/' then print all
 if (s.indexOf('/') > -1) {
 System.out.println(s.substring(0, s.indexOf('/')));
 } else System.out.println(s);
}Hope this helps. I used static methods instead of encapsulating everyting into a class.

Compare two text files in Powershell and if a name is found in both files output content from file 2 to a 3rd text file

Is it possible using PowerShell to compare the contents of two text files line by line and if a line is found output that line to a third text file?
Lets say hypothetically someone asks us to search a text file named names1.txt and when a name is found in names1.txt we then pair that with the same name in the second text file called names2.txt
lets say the names shown below are in names1.txt
Bob
Mike
George
Lets say the names and contents shown below are in names2.txt
Lisa
Jordan
Mike 1112222
Bob 8675309
Don
Joe
Lets say we want names3.txt to contain the data shown below
Mike 1112222
Bob 8675309
In vbscript I used search and replace commands to get part of the way there like this
Set objFSO = CreateObject("Scripting.FileSystemObject")
Set objFile = objFSO.OpenTextFile("testing.txt", ForReading)
strText = objFile.ReadAll
objFile.Close
strNewText = Replace(strText, "Mike ", "Mike 1112222")
Set objFile = objFSO.OpenTextFile("testing.txt", ForWriting)
objFile.WriteLine strNewText
objFile.Close
That script works great when you know the name you are looking for and the correct values. Lets say someone gives you a list of 1000 employees and says import these names into a list in the correct format and one sheet has the correct names only and
the other sheet has lots of extra names say 200000 and you only need the 1000 you are looking for in the format from names2.txt.

Sure,
Here's a simple one:
$names1 = "C:\names1.txt"
$names2 = "C:\names2.txt"
$names3 = "C:\names3.txt"
Get-Content $names1 | ForEach-Object {
$names1_Line = $_
Get-Content $names2 | Where-Object {$_.Contains($names1_Line)} | Out-File -FilePath $names3 -Append
This basically just reads $names1 file, line by line, and then read $names2 file line by line as well.
If the line being evaluated from $names2 file contains the line being evaluated from $names1 file, then the line from $names2 file gets output to $names3 file, appending to what's already there.
This might need a few more tinkering to get it to perform faster etc depending on your requirements. For example:
- If either $names1 or $names2 contain a lot of entries (in the region of hundreds) then it will be faster to load the whole content of $names2 into memory rather than opening the file, reading line by line, closing and then doing the same for every single
line in $names1 (which is how it is currently works)
- Make sure that your comparison is behaving as expected. The .Contains method always does a case sensitive comparison, this might not be what you are after.
- You might want to put a condition to ignore blank lines or lines with spaces, else they'll also be brought over to $names3
Hopefully this will get you started though and ask if you have further questions.
Fausto

Read multiple files and save all into one output file(AGAIN)

Hi, guys
I need your help for reading data from multiple files and save the results into one output file. When files are selected from file chooser, my program read the data line by line , do some calculations and save the result into the output. I made an array to store input files and it seems to be working fine, but when it comes to SaveFile() function, issues NullPointException message.
public class FileReduction1 extends JFrame implements ActionListener
 // GUI definition and layout
 /* ACTION PERFORMED */
 public void actionPerformed(ActionEvent event) {
 if (event.getActionCommand().equals("Open File")) getFileName();
 /* OPEN THE FILE */
 private void getFileName() {
 // Display file dialog so user can select file to open
 JFileChooser fileChooser = new JFileChooser();
 fileChooser.setFileSelectionMode(JFileChooser.FILES_ONLY);
 fileChooser.setMultiSelectionEnabled(true);
 int result = fileChooser.showOpenDialog(this);
 // If cancel button selected return
 if (result == JFileChooser.CANCEL_OPTION) return;
 if (result == JFileChooser.APPROVE_OPTION)
 files = fileChooser.getSelectedFiles();
 textArea.setText("");
 if(files.length>0)
 filelist="";
 System.out.println("files length"+files.length);
 for(int i=0;i<files.length;i++)
 System.out.println(files.getName());
filelist+=files[i].getName()+" ,";
if (checkFileName(files[i]) )
openButton.setEnabled(true);
readButton.setEnabled(true);
textArea.append("file "+files[i].getName()+"is a proper file"+"\n");
readFile(files[i]);
textfield.setText(filelist);
else{JOptionPane.showMessageDialog(this,"Please select file(s)",
 "Error 5: ",JOptionPane.ERROR_MESSAGE); }
 // Obtain selected file
/* READ FILE */
private void readFile(File fileName_in) {
// Disable read button
readButton.setEnabled(false);
// Dimension data structure
 getNumberOfLines(fileName_in);
 data = new String[numLines][4];
 // Read file
 readTheFile(fileName_in);
 // Rnable open button
 openButton.setEnabled(true);
/* GET NUMBER OF LINES */
/* Get number of lines in file and prepare data structure. */
private void getNumberOfLines(File fileName_in) {
int counter = 0;
 // Open the file
 openFile(fileName_in);
 // Loop through file incrementing counter
 try {
 String line = fileInput.readLine();
 while (line != null) {
 counter++;
 System.out.println("(" + counter + ") " + line);
line = fileInput.readLine();
 numLines = counter;
closeFile(fileName_in);
 catch(IOException ioException) {
 JOptionPane.showMessageDialog(this,"Error reading File",
 "Error 5: ",JOptionPane.ERROR_MESSAGE);
 closeFile(fileName_in);
 System.exit(1);
/* READ FILE */
private void readTheFile(File fileName_in)
// Open the file
//int row=0;
int col=0;
openFile(fileName_in);
System.out.println("Read the file");
// Loop through file incrementing counter
try
String line = fileInput.readLine();
while (line != null)
boolean containsDoubles = false;
double temp;
String[] lineParts = line.split("\t");
try
for (col=0;col<lineParts.length;col++)
temp=Double.parseDouble(lineParts[col]);
data[row][col] = lineParts[col];
containsDoubles = true;
System.out.print("data["+row+"]["+col+"]="+lineParts[col]+" ");
} catch (Exception e) {row=0; col=0; temp=0.0;}
if (containsDoubles){ row++;}
System.out.println();
line = fileInput.readLine();
catch(IOException ioException)
JOptionPane.showMessageDialog(this,"Error reading File", "Error 5: ",JOptionPane.ERROR_MESSAGE);
closeFile(fileName_in);
System.exit(1);
//System.out.println("length"+data.length);
closeFile(fileName_in);
process(fileName_in);
/* CHECK FILE NAME */
/* Return flase if selected file is a directory, access is denied or is
not a file name. */
private boolean checkFileName(File fileName_in) {
 if (fileName_in.exists()) {
 if (fileName_in.canRead()) {
 if (fileName_in.isFile()) return(true);
 else JOptionPane.showMessageDialog(null,
 "ERROR 3: File is a directory");
 else JOptionPane.showMessageDialog(null,
 "ERROR 2: Access denied");
 else JOptionPane.showMessageDialog(null,
 "ERROR 1: No such file!");
 // Return
 return(false);
/* OPEN FILE */
private void openFile(File fileName_in) {
 try {
 // Open file
 FileReader file = new FileReader(fileName_in);
 fileInput = new BufferedReader(file);
 catch(IOException ioException) {
 JOptionPane.showMessageDialog(this,"Error Opening File",
 "Error 4: ",JOptionPane.ERROR_MESSAGE);
 textArea.append("OPEN FILE\n---------\n");
 textArea.append(fileName_in.getPath());
 textArea.append("\n");
 //System.out.println("File opened successfully");
/* CLOSE FILE */
private void closeFile(File fileName_in) {
if (fileInput != null) {
 try {
 fileInput.close();
 catch (IOException ioException) {
 JOptionPane.showMessageDialog(this,"Error Opening File",
 "Error 4: ",JOptionPane.ERROR_MESSAGE);
System.out.println("File closed");
private void process(File fileName_in) {
//getNumberOfLines();
 //data = new String[numLines][3];
 // Read file
double temp,temp1;
 //readTheFile();
//System.out.println("row:"+row);
//int number=data.length;
//System.out.println(number);
for (int i=0; i<row; i++)
temp=Double.parseDouble(data[i][1]);
sumx+=temp;
temp1=Double.parseDouble(data[i][3]);
sumy+=temp1;
multixy+=(temp*temp1);
square_x_sum+=(temp*temp);
square_y_sum+=(temp1*temp1);
//System.out.println("Sum(x)="+sumx);
double tempup=(row*multixy)-(sumx*sumy);
double tempdown=(row*square_x_sum)-(sumx*sumx);
slope=tempup/tempdown;
double tempbup=sumy-(slope*sumx);
intb=tempbup/row;
double tempside=(row*square_y_sum)-(sumy*sumy);
double cordown=Math.sqrt(tempdown*tempside);
corr=tempup/cordown;
r_sqrt=corr*corr;
 textArea.append("Data for file"+ fileName_in.getName()+" have been processed successfully.");
 textArea.append("\n");
 textArea.append("Please enter output file name including extension.");
System.out.println("number"+row);
System.out.println("slope(m)="+slope);
System.out.println("intecept b="+intb);
System.out.println("correlation="+corr);
System.out.println("correlation="+r_sqrt);
saveFile();
private void saveFile()
textArea.append("SAVE FILE\n---------\n");
if (openFile1())
 try {
 outputToFile();
catch (IOException ioException) {
 JOptionPane.showMessageDialog(this,"Error Writing to File",
 "Error",JOptionPane.ERROR_MESSAGE);
private boolean openFile1 ()
 // search for the file path
StringBuffer stringpath;
title=textfield1.getText().trim();
int temp=fileName_in.getName().length();
int temp_path=fileName_in.getPath().length();
int startd=(temp_path-temp);
stringpath=new StringBuffer(fileName_in.getPath());
stringpath.delete(startd, temp_path+1);
//System.out.println("file-path="+temp_path);
//System.out.println("length-file="+temp);
path=stringpath.toString();
fileName_out = new File(path, title);
//System.out.println(file_out.getName());
if (fileName_out==null || fileName_out.getName().equals(""))
 JOptionPane.showMessageDialog(this,"Invalid File name",
 "Invalid File name",JOptionPane.ERROR_MESSAGE);
 return(false);
 else
try
boolean created = fileName_out.createNewFile();
if(created)
fileOutput = new PrintWriter(new FileWriter(fileName_out));
fileOutput.println("File Name"+"\t"+"Slope(m)"+"\t"+"y-intercept(b)"+"\t"+"Coefficient(r)"+"\t"+"Correlation(R-Squared)");
return(true);
else
fileOutput = new PrintWriter(new FileWriter(fileName_out,true));
return(true);
catch (IOException exc)
JOptionPane.showMessageDialog(this,"Please enter the file name","Error",JOptionPane.ERROR_MESSAGE);
return(false);
private void outputToFile() throws IOException
// Initial output
 textArea.append("File name = " + fileName_out + "\n");
 // Test if data exists
 if (data != null)
 fileOutput.println(fileName_in.getName() +"\t"+ slope+"\t"+intb+"\t"+corr+"\t"+r_sqrt);
textArea.append("File output complete\n\n");
 else
textArea.append("No data\n\n");
 // End by closing file
initialcomp();
 fileOutput.close();
private void initialcomp()
slope=0.0;
intb=0.0;
corr=0.0;
r_sqrt=0.0;
sumx=0.0; sumy=0.0; multixy=0.0; square_x_sum=0.0; square_y_sum=0.0;
for(int i=0;i<data.length;i++)
for(int j=0;j<data[i].length;j++)
data[i][j]=null;
/* MAIN METHOD */
public static void main(String[] args) throws IOException
 // Create instance of class FileChooser
 FileReduction1 newFile = new FileReduction1("File Reduction Program");
 // Make window vissible
 newFile.setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);
 newFile.setSize(500,400);
newFile.setVisible(true);
Sorry about the long lines.
As you can see, all input files saved in array called files, however when OpenFile1() function is called, it take input (fileName_in) as a single file not an array. I'm assuming this causes the exception.
When there's muptiple inputs, program should take each file from getFileName() to outputToFile() sequentially.
Does anybody have an idea to solve this?
Thanks a lot!!

you naming convention is confussing. you should follows Java naming convention..you have a getXXX but decalred the return type as "void"...get usully means to return something...
your code is doing too much..and hard to follows..
1. get the selected files
for each selected file
process the file and return the result
write out the result.
/** close the precious resource */
public void closeResource(Reader in){
 if (in != null){
 try{ in.close(); }
 catch (Exception e){}
/** get the total number of line in a file */
public int getLineCount(File file) throws IOException{
 BufferedReader in = null;
 int lineCount = 0;
 try{
 in = new BufferedReader(new FileReader(file));
 while ((in.readLine() != null)
 lineCount++;
 return lineCount;
 finally{ closeResource (in); }
/** read the file */
public void processFile(File inFile, File outFile) throws IOException{
 BufferedReader in = null;
 StringBuffer result = new StringBuffer();
 try{
 in = new BufferedReader(new FileReader(inFile));
 String line = null;
 while ((in.readLine() != null){
 .. do something with the line
 result.append(....);
 writeToFile(outFile, result.toString());
 finally{ closeResource (in); }
public void writeToFile(File outFile, String result) throws IOException{
 PrintWriter out = null;
 try{
 out = new PrintWriter(new FileWriter(outFile, true)); // true for appending to the end of the file
 out.println(result);
 finally{ if (out != null){ try{ out.close(); } catch (Exception e){} } }
}

Output verbose to file and console?

Similar Messages

Maybe you are looking for