URGENT: Loop through files

I have a package that will be run from an Oracle Job and I want to process files in a directory and load each of the files into the database. I can load one specifically, but I want to loop through all the files in the directory and load each one at a time. Any help would be greatly appreciated.
Lisa

I followed the instructions but when I try to create the java, I get the following error (removed the numbers in front of each line):
and compile java source named "DirList"
ERROR at line 2:
ORA-29536: badly formed source: Encountered "<EOF>" at line 1, column 17.
Was expecting:
unknown command beginning "import jav..." - rest of line ignored.
unknown command beginning "public cla..." - rest of line ignored.
unknown command "{" - rest of line ignored.
unknown command beginning "public sta..." - rest of line ignored.
For a list of known commands enter HELP
and to leave enter EXIT.
unknown command beginning "throws SQL..." - rest of line ignored.
unknown command "{" - rest of line ignored.
unknown command beginning "File path ..." - rest of line ignored.
unknown command beginning "String[] l..." - rest of line ignored.
For a list of known commands enter HELP
and to leave enter EXIT.
unknown command beginning "String ele..." - rest of line ignored.
unknown command beginning "for(int i ..." - rest of line ignored.
unknown command "{" - rest of line ignored.
unknown command beginning "element = ..." - rest of line ignored.
For a list of known commands enter HELP
and to leave enter EXIT.
unknown command beginning "#sql { INS..." - rest of line ignored.
unknown command beginning "VALUES (:e..." - rest of line ignored.
unknown command "}" - rest of line ignored.
unknown command "}" - rest of line ignored.
For a list of known commands enter HELP
and to leave enter EXIT.
unknown command "}" - rest of line ignored.
and compile java source named "DirList"
ERROR at line 2:
ORA-29536: badly formed source: Encountered "<EOF>" at line 1, column 17.
Was expecting:
I researched it on metalink with no luck. I'm running it on my local database (Oracle8i Release 8.1.7.0.0 - Production JServer Release 8.1.7.0.0 - Production) so this may be the problem.
Help!
Lisa

Similar Messages

SSIS - Loop through files from a file path based on the value in the variable

Experts,
I have a requirement where I'll be loading multiple files in to a SQL server table and archive the files when loaded. However, the challenge is , the file path should be dynamic based on the value of a variable (say, @ProductName).
For example: If I am running the package for variable @ProductName="Product", the file path would be "\\....\Src\Product", in that case the ForEachLoop will loop through all the files in that folder, load them to the table and Archive
the files to the "\\....\Src\Product\Archive" folder.
Similarly, if the @ProductName="Product_NCP", the foreachloop container should loop through files in the "\\....\Src\Product_NCP" folder, load them to the table and archive them to the ""\\....\Src\Product_NCP\Archive"
folder.
Any suggestions? I should be able to run the package manually just by passing the "@Product" value, create Archive folder if it doesn't exist, load the data and archive the files.

Yes
1. Have a variable inside SSIS to get folder path. Set path based on your rule using an expression
like
(@[User::ProductName] == "Product" ? "\\....\Src\Product" : (@[User::ProductName] == "Product_NCP" ? \\....\Src\Product_NCP:..))
similary archive
(@[User::ProductName] == "Product" ? "\\....\Src\Product\Archive" : (@[User::ProductName] == "Product_NCP" ? "\\....\Src\Product_NCP\Archive" :..))
Please Mark This As Answer if it solved your issue
Please Vote This As Helpful if it helps to solve your issue
Visakh
My Wiki User Page
My MSDN Page
My Personal Blog
My Facebook Page

Looping through files in a folder, How to

Looking for plsql code to read through files in a folder, and pass the name of the file found to a parm.
The parm will then be used to open the table, process data to end of file, and then close the file. The file is then moved to an archive, and the next file in the folder is read, name of file passed to parm, file is opened, data is processed, and file is moved to archive....repeat until no files in folder.
I only need some help with reading through the folder to find the table. I have code on how to open, process and move a folder...it's the file in folder read loop I am trying to develop.
In summary, I am looking for some code showing how to read all tables in a folder and pass the name of the table found, until all files read.

emss wrote:
Yes, you understand....thank you. That's the primary objective of this thread....determine the name of the .csv file.
The putline and so forth process the file. I need to find the file, it's name, and then process the .csv file.PL/SQL itself has no mechanism built in for determining the list of files in a directory.
The Java solution is one of the easiest to implement as PL/SQL can interface fairly simply with Java functions which you can create on the database.
There are other ways, but no way is going to be completely simple.
Remember, from PL/SQL you will only really be able to get to files that the database server itself can see, so either files on the database server itself, or files on machines that the server itself has network mappings to that it can treat as if they are local files. It certainly won't be able to hack across the network to any client machines hard drive to read a list of files.

Looping through files with Regular expressions ?

Hi,
My Question is:
if i have the following Regular Expression,
String regrex = "tree\\s\\w{1,4}.+\\s=\\s(.*;)";
The file in which i am looking for the string has multiple entries, is it
possible to do another regular expression on the captured group (.*;)
which is in the original Regular expression ?
The text that is captured by the RE is of the type "(1,(2,((3,5),4)));" for
each entry, and different entries in the file have slightly different syntax
is it possible to loop through the file and first of all check for the presence
of the original RE in each entry of the file
and then secondly, check for the presence of another RE on the captured group?
[ e.g. to check for something like, if the captured group has a 1 followed by a 3
followed by a 5 followed by a and so on ].
Thanks Very much for any help, i've been struggling with this for a while!!
Much appreciated
The code that i have so far is as follows:
import java.util.*;
import java.util.regex.*;
import java.io.*;
import java.lang.*;
import javax.swing.*;
public class ExpressReg {
public String Edit;
public ExpressReg(String editorEx){
Edit = editorEx; // Edit = JTextArea
String regrex = "tree\\s\\w{1,4}.+\\s=\\s(.*;)";
//String regrex1 = "(.*;)";
Pattern p = Pattern.compile(regrex);
Matcher m = p.matcher(editorEx); // matcher can have more than one argument!
boolean result = m.find();
if(result){
JOptionPane.showMessageDialog(null, "String Present in Editor");
else if(!result){
JOptionPane.showMessageDialog(null, "String Not Present In Editor");

if i have the following Regular Expression,
String regrex = "tree\\s\\w{1,4}.+\\s=\\s(.*;)";
The file in which i am looking for the string has multiple entries, is it
possible to do another regular expression on the captured group (.*;)
which is in the original Regular expression ?Yes, the capturing group is $1 (the only one) referenced in source code as m.group(1).
m.group() will return entire matching.
simply use this way:
String result = m.group(1);
// your stuff: could be another validation
The text that is captured by the RE is of the type "(1,(2,((3,5),4)));" for
each entry, and different entries in the file have slightly different syntax
is it possible to loop through the file and first of all check for the presence
of the original RE in each entry of the file
and then secondly, check for the presence of another RE on the captured group?Again "Yes", no limits!
Don't need to create another Matcher, just use m.reset(anotherSourceString)..loop using the same pattern.
Note: Take care with ".*" because regex nature is "greedy", be more specific, eg.: "\\d" just matches digits (0-9).
Can you give us some sample of "slight difference" ?

Trying to loop through files

Sorry if this is a simple thing, I just can't seem to get it working. Ugh.
I'm following the example here:
http://www.sqlis.com/sqlis/post/Looping-over-files-with-the-Foreach-Loop.aspx
I got stuck on this section:
The important part of this dialog is highlighted and that is "Expressions". Click on the ellipses and we will be taken through to the next screen where we can start to create the expression. In the screen that follows, from the Property column
drop the list down and choose ConnectionString
In the 'Property Expressions Editor' window, i can't choose Property=ConnectionString. I just don't have it in my list. I'm using Visual Studio Ultimate 2010. The article is discussing SQL Server 2005 SSIS. Maybe something changed
b/w the two versions, or maybe I'm just not doing something right.
This is a big problem, b/c when I try to set the OLEDB, I get this.
Nothing is being feed into the Loop tool, and thus nothing can be mapped to the destination table in my DB.
I thought I could just make up my own, intuitive Expression, as such.
That doesn't do anything at all.
Can someone help me out?
Thanks!!
Knowledge is the only thing that I can give you, and still retain, and we are both better off for it.

So, I cancelled my other project and started over. I’m at this section in the original link that I posted:
The important part of this dialog is highlighted and that is "Expressions". Click on the ellipses and we will be taken through to the next screen where we can start to create the expression. In the screen that follows, from the Property column
drop the list down and choose ConnectionString
The whole problem here is that I don’t have the Property = ConnectionString in the Property Expression Editor window.
This is what I have.
There is no ConnectionString anywhere; it simply doesn't exist.
I did set the flat file source; that's fine now. But I have an exclamation mark in the OLEDB object (that doesn't seem right). No matter what I do, I can't get rid of it.
Knowledge is the only thing that I can give you, and still retain, and we are both better off for it.

SQL Agent Permssions With SSIS for each loop not looping through files

Hi I am Having trouble getting a ssis package to iterate through a file directory using a proxy account set up in Sql Server.
So I have a package that loops over csv files. If I run the package manually or set the sql agent job to run as Sysadmin the pakage runs fine all files are processed.
However if I use the proxy account. the package completes but no files are processed. there are no failures, there is no error handling set up in the control flow. the for each loop container simply does not recognise any files when run under a proxy.
Note: the proxy is set up with credentials to access the folder. the credential is also set up with the server admin server role... still nothing
i'm not sure is this is a ssis or permissions problem?
Any comments will be appreciated

Can you check this and see if you've configured all the steps correctly
http://www.mssqltips.com/sqlservertip/2163/running-a-ssis-package-from-sql-server-agent-using-a-proxy-account/
Also enable logging in package and see if you're getting any error messages obtained in output table/file based on the logging option you chose.
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Is it possible to loop through files in a folder, but only load those with a specific filename?

Hello all. I have a folder with about 100 text files total, but it's really only about 25 different reports, each with multiple quarters. So, for example, it looks like this...
Report A 2014-12-31
Report A 2014-09-30
Report A 2014-06-30
Report A 2014-03-31
Report B 2014-12-31
Report B 2014-09-30
Report B 2014-06-30
Report B 2014-03-31
Report C 2014-12-31
Report C 2014-09-30
Report C 2014-06-30
Report C 2014-03-31
...and so on
I need to load only report B to a table in SQL Sever 2008 R2, but I need to load all quarters for report B. I'm trying to accomplish this using a foreach loop container, but I haven't figured
out hot to tell it to only look at report B and ignore the others. In testing, the loop always starts with report A.
In the process, I also need to capture the date section of the filename in a variable so I can create a derived column with the date to insert into the table.
Any ideas how to accomplish this? I'm trying to avoid putting each report in its own folder because it adds a manual step, but if there's a way to do that using a file system task before running the loop, I'm open to it.
Thanks for any advice you have!
WeeLass

Have you tried specified Report B*.txt for Files : under the Collections tab ?
Narsimha

Loop through files locating specific data sets

Hi there,
I have been given the wonderful task of developing a setup which needs to do the following using JCAPS:
- open and read through various flat files in a folder. These flat files have random data sets in them, where a line starting with 01, marks the start of a data set and 99, marks the end of a data set. 03, marks the line where the account number can be found.
- retrieve the account number from the data sets and verify that against an external Oracle database table.
- if account number is found, then read the data set from the flat file and write the data set to an output file.
- if the account number is not found in the Oracle database table, just discard the dataset and continue with the next data set.
If you have any ideas on how to set this up, that would be much appreciated. No need to spell things out, but if anyone has worked on a scenario like this or similar using JCAPS to do the trick please let me know.
A scenario variant is that, instead of looking up the account number against the oracle database, we can use an if-statement like "if the currency is GBP, EUR, SEK, then take the data set from the input file and write the data set to the output file.
I can create an input OTD to read in the data sets, and an output OTD which creates the output file. There is a blank line between data sets. The structure of a data set looks like this:
01,CITIDIRECT,2978169,080922,0401,04010900,999,,2/
02,2978169,400515,1,080919,0000,USD,2/
03,57787314,USD,010,2191397371,,,015,2191397371,,,030,2191397371,,,040,2191397371,,,045,2191397371,,,060,2191397371,,,072,000,,,074,000,,,100,000,0,,400,000,0,,470,000,0,/
49,13148384226,2/
03,57787322,USD,010,1494730626,,,015,1494730626,,,030,1494730626,,,040,1494730626,,,045,1494730626,,,060,1494730626,,,072,000,,,074,000,,,100,000,0,,400,000,0,,470,000,0,/
49,8968383756,2/
03,57787349,USD,010,423382915,,,015,423382915,,,030,423382915,,,040,423382915,,,045,423382915,,,060,423382915,,,072,000,,,074,000,,,100,000,0,,400,000,0,,470,000,0,/
49,2540297490,2/
98,24657065472,3,8/
99,24657065472,1,10/
Thanks & Kind Regards,
Richard

Yes
1. Have a variable inside SSIS to get folder path. Set path based on your rule using an expression
like
(@[User::ProductName] == "Product" ? "\\....\Src\Product" : (@[User::ProductName] == "Product_NCP" ? \\....\Src\Product_NCP:..))
similary archive
(@[User::ProductName] == "Product" ? "\\....\Src\Product\Archive" : (@[User::ProductName] == "Product_NCP" ? "\\....\Src\Product_NCP\Archive" :..))
Please Mark This As Answer if it solved your issue
Please Vote This As Helpful if it helps to solve your issue
Visakh
My Wiki User Page
My MSDN Page
My Personal Blog
My Facebook Page

Automator - Loop through a text file and process data through a 3rd party software

Just stumbled on Automator the other day (I am a mac n00b) and would like to automate the processing of a text file, line-by-line, using a third party tool. I would like Automator to loop through the text file one line at a time, copy the string and keep as a variable. Next, place the variable data (copied string) into the text field of the 3rd party software for processing. Once the processing is complete, I would like Automator to fetch the next line/string for processing. I see items like "copy from clipboard" and "variables" within the menu but I am not finding much documentation on how to utilizle this tool. Just hear how potentially powerful it is.
The 3rd party software is not a brand name, just something made for me to process text. I may have to use mouse clicks or tabs + [return] to navigate with Automator. A term I heard on Bn Walldie's itunes video series was "scriptable software" for which I don't think this 3rd party app would be.
Kind regards,
jw

Good news and bad news...
The good news is that it should be entirely possible to automate your workflow.
The bad news is that it will be a nightmare to implement via Automator, if it's even possible.
Automator is, essentially a pretty interface on top of AppleScript/Apple Events, and with the pretty interface comes a certain stranglehold on features. Knowing how to boil rice might make you a cook, but understanding flavor profiles and ingredient combinations can make you a chef, and it's the same with AppleScript and Automator. Automator's good at getting you from points A to B but if there are any bumps in the road (e.g. the application you're using isn't scriptable) then it falls apart.
What I'm getting at is that your requirements are pretty simple to implement in AppleScript because you can get 'under the hood' and do exactly what you want, as opposed to Automator's restricted interface.
The tricky part is that if no one else can see this app it's going to be hard to tell you what to do.
I can give you the basics on reading a file and iterating through the lines of text in it, and I can show you how to 'type' text in any given application, but it may be up to you to put the pieces together.
Here's one way of reading a file and working through each line of text:
-- ask the user for a file:
set theFile to (choose file)
-- read the file contents:
set theFileContents to (read file theFile)
-- break out the lines/paragraphs of text:
set theLines to paragraphs of theFileContents
-- now iterate through those lines, one by one:
repeat with eachLine in theLines
-- code to perform for eachLine goes here
end repeat
Once you have a line of text (eachLine in the above example) you can 'type' that into another application via something like:
tell application "AppName" to activate
tell application "System Events"
tell process "AppName"
keystroke eachLine
end tell
end tell
Here the AppleScript is activating the application and using System Events to emulate typing the contents of the eachLine variable into the process. Put this inside your repeat loop and you're almost there.

Looping through an XML file

I got this really great script that loops through some XML files and does stuff based off the content.
What I would like to do now is have it repeat when it gets to a certain field. for example my xml file would look like this.
<xml>
<fileName>nameoffile</fileName>
<userEmail>[email protected]</userEmail>
<commandList>
<item>info here</item>
<item>more info here</item>
<item>yet more info</item>
<item>still more info here</item>
</commandList>
</xml>
then basically i need the applescript to see the <commandList> tag and then repeat for each item.
i can't seem to wrap my head around how to get it to happen.
currently I am using this to extract the normal tags from the xml file
set theXML to choose file
tell application "System Events"
tell XML element 1 of contents of XML file theXML
set the fileName to value of (XML elements whose name is "fileName")
... and so on
end tell
end tell
i believe i have to put an if statment in saying that if the element name == "commandList" then
repeat with item in commandList
my stuff here.
end repeat
but i'm not sure how to build the statement.
thanks for any help.
P

Something like this?
<pre style="
font-family: Monaco, 'Courier New', Courier, monospace;
font-size: 10px;
margin: 0px;
padding: 5px;
border: 1px solid #000000;
width: 720px;
color: #000000;
background-color: #FFEE80;
overflow: auto;"
title="this text can be pasted into the Script Editor">
set theXML to POSIX path of (choose file)
tell application "System Events"
tell XML element 1 of contents of XML file theXML -- root element
set the fileName to value of XML element "fileName"
get value of XML elements of XML element "commandList" -- sub elements
repeat with anItem in the result
log anItem
end repeat
end tell
end tell
</pre>

How to loop through CSV file

Hi,
I want to loop through each column of a CSV file.
And while looping each column, I want to loop each row
starting with the 2st row.
I wrote the code as below, but it is looping through the rows
starting from row 1.
How do I make it start the loop as from row 2 in the CSV ?
(see code below)
Can someone tell me how to do this?
Thx

<cffile action="read" file="C:\Documents and
Settings\user\Desktop\EM-CSV\test.csv" variable="csvfile">

<table border="1">
<cfloop index="index" list="#csvfile#"
delimiters="#chr(10)##chr(13)#">

<tr>
<td><cfoutput>#index#</cfoutput></td>
<td><cfoutput>#listgetAt('#index#',2,
',')#</cfoutput></td>
<td><cfoutput>#listgetAt('#index#',3,
',')#</cfoutput></td>
</tr>
</cfloop>
</table>

Hello, your code works perfectly.
Now I am having a slight problem with it.
I have added the code to check whether a particular cell of
the CSV is blank. (see code below)
But it is giving me error message.
Can you please tell me what am doing wrong?
Thx

<cfset isRowTwoOrLater=false>
<table border="1">
<cfloop index="row" list="#csvfile#"
delimiters="#chr(10)##chr(13)#">
<cfif isRowTwoOrLater>
<tr>
<cfif #listgetAt(row,1, ',')# neq ''> 
<td><cfoutput>#listgetAt(row,1,
',')#</cfoutput></td>
<cfelse>
<td><cfoutput>It is
blank</cfoutput></td>
</cfif>
<td><cfoutput>#listgetAt(row,2,
',')#</cfoutput></td>
<td><cfoutput>#listgetAt(row,3,
',')#</cfoutput></td>
</tr>
<cfelse>
<cfset isRowTwoOrLater = true>
</cfif>
</cfloop>
</table>

Loop through a csv file and return the number of rows in it?

What would be simplest way to loop through a csv file and
return the number of rows in it?
<cffile action="read" file="#filename#" output="#csvstr#"
>
<LOOP THROUGH AND COUNT ROWS>

ListLen(). Use chr(13) as your delimiter

Upload XLS File, Loop through rows query a DB

What I would like to do is enable the user to upload an excel
spreadsheet with one column and many row of IP's. Then put the ips
in a list or array and loop through the list and query a table to
get the IPs that match the list.
Any help would be greatly appreciated.

We have some similar apps except that, instead of uploading a
file, the users copy and paste the column into a text area. Then we
do this:

<cfset
hscnumbers=Replace(form.hscnumbers,chr(13)&chr(10),",","ALL")>

<cfif find(",", hscnumbers) gt 0 and right(hscnumbers, 1)
is ",">
<cfset hscnumbers = left(hscnumbers, len(hscnumbers) -
1)>
</cfif>
And then we have a list to send to the db.

How to loop through xml records from file without ROW , /ROW tags?

I am using dbms_XMLSave.insertXML procedure to insert xml formated record from file. MY xmlformated records does not have open and close ROW tags. I have multiple records in the file.How can I loop through without <ROW>,</ROW> tags?

I am using dbms_XMLSave.insertXML procedure to insert xml formated record from file. MY xmlformated records does not have open and close ROW tags. I have multiple records in the file.How can I loop through without <ROW>,</ROW> tags?

Script code sample for looping through the records from xml data file in formCalc script

Hi
 I have a xml data file which contains a sequence of repeating applicant data like given below
 US
 II
 CEO
 Mr
 111111111
 0000000111
 GuarantorA
 111
 IN
 11111
 WILLIAMS1
 R3
 KENNETH1
 City1GU
 PA
 1934-03-14
 [email protected]
 GU
 R
 113 Lazlo LaneCA
 Suite 3500CA
 OaklandCA
 TX
 11345
 AL
I want to assign a textfield with a value based on the value of coap_flag.
So i need to loop through all the record and check the value of coap_flag and then assign the textfield a value based on that.
I am new to Adobe livecycle...Please help me how it can be done.
I have developed something like this
foreach Item in ($record.applicant[*].coap_flag) do
test.value=Item
if(test.value=="MA")then
concat($record.applicant.first_name,$record.applicant.middle_name)endif
endfor

Using the data you posted in the forum, I copied it a couple of times to give multiple records and used this code to extract the different values that you wanted. I had to wrap it in a <root> node that I called root (to make it valid XML). In my case I wrote the extracted values to a field, but in your case you can do whatever you want with them. Note that this was done in javascript: var currentElement; var obj; //Get the nodes below the root node in the dataDom obj = xfa.datasets.data.root.nodes; //Set an initial value for the textField TextField1.rawValue = "The values of the coap_flag are: "; //Loop through the nodes in the obj set for (i=0; i< obj.length ; i++){ //set the currentElement to the 1st child node currentElement = obj.item(i); //Check to see if it is an applicant node if (currentElement.name == "applicant"){ //It is an applican, now find the coap_flag node value and write it to the text field TextField1.rawValue += "\n" + xfa.resolveNode("xfa.datasets.data.root.applicant[" + i + "]").coap_flag.value; } }

URGENT: Loop through files

Similar Messages

Maybe you are looking for