Concatenating 2 files in Unix and passing as input to SQL loader program

Hi,
I have 2 files file1_DDMMYY.csv and file_2_DDMMYY.csv
I want to insert the 2 files using SQL Loader
I am using the all_directories table to look at the directory path and file name passed for example \test\sdf\test\file_1_DDMMYY.csv
I am presently using INFILE * in the Control File.Does it will take care of the 2 files for loading?Also the file naming convention may vary depending upon the dates.for example it can have file_1_210214.csv or file_1_220214.
Can we using concatenate and call the unix shell script and combine the 2 files to one and load the data using sql loader??
How will be process of calling the shell program and pass the 2 files and combine it to one. (cat file_1_DDMMYY.csv file_2_DDMMYY.csv > file_1_DDMMYY.csv)
Regards

DUPLICATE thread
FTPing multiple files in Server using Unix

Similar Messages

I need to call a batch file from java and pass arguments to that Batch file

Hi,
I need to call a batch file from java and pass arguments to that Batch file.
For example say: The batch file(test.bat) contains this command: mkdir
I need to pass the name of the directory to the batch file as an argument from My Java program.
Runtime.getRuntime().exec("cmd /c start test.bat");
How to pass argument to the .bat file from Java now ?
regards,
Krish
Edited by: Krish4Java on Oct 17, 2007 2:47 PM

Hi Turing,
I am able to pass the argument directly but unable to pass as a String.
For example:
Runtime.getRuntime().exec("cmd /c start test.bat sample ");
When I pass it as a value sample, I am able to receive this value sample in the batch file. Do you know how to pass a String ?
String s1="sample";
Runtime.getRuntime().exec("cmd /c start test.bat s1 ");
s1 gets passed here instead of value sample to the batch file.
Pls let me know if you have a solution.
Thanks,
Krish

Format input for Sql*Loader

I have a problem in formating an input file for Sql*Loader
The file has the following format:
1 Jeff
2 Kyle
3 Tom
1 Lisa
2 Bryan
3 Max
4 Rob
5 Steve
1 Richard
2 Mary
and so on
the file should look as follows to process with Sql*Loader:
1 Jeff 2 Kyle 3 Tom
1 Lisa 2 Bryan 3 Max 4 Rob 5 Steve
1 Richard 2 Mary
any suggestions?
Edited by: royce on Sep 18, 2008 2:08 AM

royce wrote:
I have a problem in formating an input file for Sql*Loader
The file has the following format:
1 Jeff
2 Kyle
3 Tom
1 Lisa
2 Bryan
3 Max
4 Rob
5 Steve
1 Richard
2 Mary
and so on
the file should look as follows to process with Sql*Loader:
1 Jeff 2 Kyle 3 Tom
1 Lisa 2 Bryan 3 Max 4 Rob 5 Steve
1 Richard 2 Mary
any suggestions?
Edited by: royce on Sep 18, 2008 2:08 AMActually, looking at your data again, you don't have a consistent format, so this makes it really difficult for something like SQL*Loader to process. If there were just e.g. 3 rows per record then that would be simple, but you are expecting SQL*Loader to look ahead to determine if there is more data or if it's reached the end of the record.
You would be better to load the data (external tables would probably make it quicker and easier as the data will come in the order as it is specified in the file, which would help as you have no group identifier against the sets of records) as it is and then use SQL to process them.
You haven't specified the resulting table that the data is loaded into. Is that just one single VARCHAR column with all the data concatenated or is it several columns (one for each name)?

How to execute an SSIS package on a scheduled basis from remote server and pass in input files

I have an application server and a db server. My db server has all things SQL Server stored on it (DBMS, SSRS, SSIS, etc.) I have several nightly batch process SSIS packages (dtsx files currently) that will pickup an input file and import them
into the database. I would like to execute all batch processes from my application server as I have quite a few other ones as well that do other stuff outside of SQL Server via powershell. My question is how to do this? Is there away to execute
them remotely via DTexec.exe, should I set them up as Agent jobs and somehow pass in the file names\location (how?), create and SSIS catalog, etc.?
I need to easily be able to see if the packages execute successfully or not and if not capture the detailed information of why they failed from the remote server so I can use that to drive my process flow logic in the batch processes.

Hi Jason,
According to your description, you want to execute a package on a schedule and receive notification when package ends with error in the job.
After testing the issue in my environment, we can directly add the package in a step of a job, then add a schedule and set the Alert and Notification property in the job to achieve your requirement. For more details, please see:
Create a Database Mail in the SSMS.
Right-click the SQL Server Agent services to Enable mail profile, then select the appropriate Mail profile.
Under the Operators folder, create an operator with the correct E-mail name.
Right-click the Jobs folder to add a new job.
In the Steps pane, New a step with SQL Server Integration Services Package Type to run the package.
In the Schedules pane, New a schedule for the job.
In the Alerts pane, New an alert with SQL Server event alert, then enable Notify operators option with an operator in the Response pane.
In the Notifications pane, enable Email option with same operator and When the job fails selection.
Then when the package fails, the job would be failed and we can receive the error message in the mailbox.
Besides, please make sure the account that execute the job has correct permissions for the file, for the folder that contains the file, and for the database.
References:
Configure Database Mail – Send Email From SQL Database
How to setup SQL Server alerts and email operator notifications
Thanks,
Katherine Xiong
If you have any feedback on our support, please click
here.
Katherine Xiong
TechNet Community Support

Printing of PDF files from Unix and Linux

Hi
I am looking for a product (free or commercial) that can print PDF files from Unix (HP-UX, AIX) and Linux system. It must have similar features to the Windows Adobe print driver like setting margins, re-sizing, size to fit, etc.
Thanks
Gil

Hi Gil,
For HPUX and AIX Adobe Reader 7.0.9 is available for download.
For Linux and Solaris, the latest version available is Adobe Reader 8.1.2.
You can download the installers from :
http://www.adobe.com/products/acrobat/readstep2_allversions.html
Regards,
Rishi

Create an API to Launch an LabVIEW Built Executable and Pass it Input Parameters

Hello,
I'm looking for a way to create an API to Launch/Close an executable, created with LabVIEW, which in additional to Launching/Closing tht executable, will also allow me to pass input parameters.
To give you some background, I'm working on a logging utility, basically a background dameon, which I currently have implemented as a LabVIEW packed library and my API is a few VIs to launch that daemon and pass it a filename and a logging rate. Functionally it works just fine however is executes within LabVIEW not as an independent process. So instead of using a packed library, I would like to compile my logging daemon down to an executable but I still need a way to launch it and pass it parameters from an external application (such as Teststand).
I know you can launch executables and pass parameters using windows command lines, but I'm wondering if there is a more direct method such as a DLL that I could call in Teststand? Thanks.
Post CLD and when I'm a CLA when someone asks who I am, I can spin around in my chair and say "I am... the architect."

When Teststand Launches the Logger, it does so by opening a reference to the logger daemon using the "Open VI Reference" primitive and then it launches an instance of the dameon using the "Start Asynchronous Call" node.
This currently, launches the logger within labview not teststand. If I were to directly call the logger daemon VI itself as a step in TestStand, then it could run in a new teststand thread. At that point I would need a way to stop that logger which I should be able to do by storing a reference to its control queue within the teststand thread that it is running in. Since teststand let's you specify VI execution in the runtime engine instead of LabVIEW that might do the job.
The one catch is once the sequence completes, the logger does some cleanup, post processing, etc that depending on the amount of data captured can take some time so if a set of sequences needs to be executed, this could hang up teststand until that post processing is completed. That is one reason why I wanted it to execute outside of testtand so that additonal sequences could continue to run while the daemon finishes up in the background.
But, it's something I'll have to look into.
Post CLD and when I'm a CLA when someone asks who I am, I can spin around in my chair and say "I am... the architect."

Import and process larger data with SQL*Loader and Java resource

Hello,
I have a project to import data from a text file in a schedule. A lager data, with nearly 20,000 record/1 hours.
After that, we have to analysis the data, and export the results into a another database.
I research about SQL*Loader and Java resource to do these task. But I have no experiment about that.
I'm afraid of the huge data, Oracle could be slowdown or the session in Java Resource application could be timeout.
Please tell me some advice about the solution.
Thank you very much.

With '?' mark i mean " How i can link this COL1 with column in csv file ? "
Attilio

Call File Adapter Externally and Pass on File name

HI experts,
We have a requirement where we need to call a file adapter externally to poll for a file.
The File name needs to be passed on to the called Adapter and the adapter will poll for that particular file.
Once it polls we will need to stop it -- in other words the the adapter will poll only when we call it externally.
Any form of inputs / help on this will be greatly appreciated. We will initiate this possibly from a BPM.
Many Thanks,
Himadri

Hey buddy ..
I agree with Praveen... you cannot dynamically change the filename in the sender File CC..\
regards,
arvind R

Calling JSP file from applet and passing a parameter in POST form

Hi,
Can anybody help me. I want to call a JSP page from within a applet and to this JSP page i want to pass the query which the applet has created in POST method.
I want to refresh the applet page with the new JSP page by passing the query object so the jsp page with take this query, and display the resultset
Thanks in advance
JK

Review
URL.openConnection()
and HttpURLConnection

TA26574 Having no success with installation - file is 657k and does nothing accept ask me what program I want to open it with.

Quicktime playback component for windows download & install - Having no success with installation. File says it is Winquicktime MPEG2 - upon clicking it asks what program to open with - any thoughts - I've redownloaded it and tried to have it run vs. download and the same thing happens.

Nope---didn't work. I've owned Macs for about 12 years so although I am brain dead on some things, I do have a working knowledge on most things. I only say that to say this--I did try holding down the mouse and choosing empty trash. It asks if I want to permanently delete what's in there. I say yes--and then I get the same identical message again-----'The operation can't be completed because the item "Firefox 8.0.1.dmg" is in use I can then click stop, or continue.' So apparently that complains the same way it does if I click it up on the menu :)))
As for item owned by---that's not an issue and isn't coming up. User is not a problem either as I am the only user on this system. There is only ONE file in my trash at the moment at that is this dmg file. Nothing Mac. Nothing owned by anyone other than Firefox. The problem seems to be that the dmg file and the original 4.0 FF file are working in tandem with each other--even though I have already drug the new 8.0 globe into the Apps folder and it updated the FF app with the new stuff. If I could force the dmg file to go away, I would do so, but at every turn the system is telling me it can't be done because it seems to think that dmg file is in use---even though everything is shut down and/or ejected. Hey--I'm getting ready to head out and won't be back till evening. I'll check back in this evening. Thank you again for your help.

One Concurrent Program, One SQL LOADER program for 85 different files

I am looking to see if there is a way I can have one concurrent program and one control file to load all 85 files to 85 different tables at once. I really am hoping I don't have to write 85 different control files and 85 different concurrent programs. Can someone point me into the right direction or send examples. Thanks

Hi!
A way might be to have ONE data file that will include all the 85 types.
E.g.
File1|1298|invoice|...
File1|1963|invoice|...
File1|1045|invoice|...
File2|0688|invoice|...
File2|0198|invoice|...
File3|4598|invoice|...
In your control file use
REPLACE INTO TABLE xx_file1_table
WHEN RECORD_TYPE = 'File1'
....<list of fields>
INTO TABLE xx_file2_table
REPLACE
WHEN RECORD_TYPE = File2'
....<list of fields>
The only prob is that your data file size might be very big if u have lots of data to process.
vik

Wesite Login and navigate to reports page and pass parameters to the forms page and download file

Hello,
New to C# scripting in SSIS. Everyday I download data file from a website. I need to schedule a page to include a script to auto download from the website everyday by navigation to reports page and submenu for a particular report. After I click it opens
a webpage where I need to select my criteria and download the file to a table. This is what so far I got
Object mySSISConnection = Dts.Connections["websiteConnectionManager"].AcquireConnection(null);
MessageBox.Show("Success")
I got the success message. After login, I need to navigate to select reports and then from submenu select the everyday report and pass the input parameters to the webpage and download the file and export to a tables. Any help. Not much coding I know. Learning!!
Any help really appreciate it.
Thanks
Jagan

Whoever instructed you to so is not prudent, once the report definition changed the package will break.
This is not the proper data interexchange.
Here is though an example on how to generate a SSRS report and download as a file: http://sandeep-aparajit.blogspot.ca/2010/02/how-to-execute-and-save-ssrs-report.html
And then to load the file into OLEDB destination http://www.daimto.com/ssis-lesson-2-first-package/
Arthur
MyBlog
Twitter

SQL Loader and the bad file

I use SQL Loader to read a file into a table. In my tests a lot of rows are rejected and written to the bad file. But there are no error messages.
Is there a way to find out why the row was rejected.

The Bad File
The bad file contains records that were rejected, either by SQL*Loader or by the Oracle database server. Some of the possible reasons for rejection are discussed in the next sections.
SQL*Loader Rejects
Datafile records are rejected by SQL*Loader when the input format is invalid. For example, if the second enclosure delimiter is missing, or if a delimited field exceeds its maximum length, SQL*Loader rejects the record. Rejected records are placed in the bad file.
Oracle Rejects
After a datafile record is accepted for processing by SQL*Loader, it is sent to the Oracle database server for insertion into a table as a row. If the Oracle database server determines that the row is valid, then the row is inserted into the table. If the row is determined to be invalid, then the record is rejected and SQL*Loader puts it in the bad file. The row may be invalid, for example, because a key is not unique, because a required field is null, or because the field contains invalid data for the Oracle datatype.
YOU WILL get more information
sqlldr help=y
also send your control file syntax
kuljeet pal singh

Naming for Export dmp file in Date and Time

Dear All,
Please advise me how to give the file name in date and time stamp for the export dmp file and it's log file.Suggest me in Oracle 9i version.
for example the file name get like this 020420041155.dmp and 020420041155.log where date and time are 02/04/2004 11:55 respectively...
Kindly let me know the syntax of filename to be given along with the EXP command..
Thanking You,
Ragesh

Hello
I don't think you can get the exp command to automatically name an export for you. The only way I think you would be able to do it is through a shell script or something where you format the file name yourself and pass it to exp. If you wanted to you could generate the command line through a SQL statement and then spool it out to a file i.e.
spool runexp.bat
select 'exp user/pwd@tns file='||TO_CHAR(SYSDATE,'DDMMYYYYHH24MI')||'.dmp tables=(table1,table2)' from dual;
spool offThe second option isn't as flexible as the first but if it's just a couple of exports you have to do, it will probably prove to be less work
HTH
David

How toStore the Date Variable and pass it when the program runs next time??

HI All,
My JDBC program basically needs two command line args. Rabge_Start_Dt and Range_End_Dt. for ex:
2001-05-31 and 2001-06-01 . And my porgram should run every day. Next day the date range will be 2001-06-01 to some date. It means I have to store some how the range_end_dt and pass it as range_start_dt when my program runs the next day.
Problem:
How can I store the Data variable and pass it as an argument to my porgram when It runs next time. Every time my pogram runs It should pick the range start_dt (==range_end_dt of the previuos run) and end_dt I have to go and query some other data base and pass that value to it.
Thanks in advance!!!!

save the value in a file, then read it back in each day. Similar to when a process needs a PID.
-blhqctz

Concatenating 2 files in Unix and passing as input to SQL loader program

Similar Messages

Maybe you are looking for