Invoking Oracle SQL Loader

I am looking at doing some re-factoring on data load process for inventory feed. Current process takes over an hour to process the file.
My thought is to go down this road
1. Using Oracle SQL Loader - load the inventory data into a temp table
2. Using a view to create the differences between ATG Inventory repository and what is in the temp table
3. Using the results to update the ATG Inventory stock levels
So questions are
1. Is it possible to call the Oracle SQL Loader from a ATG service component - if so how?
2. Would it be better/faster/possible to create the difference when loading the temp tables
3. How to create ATG view?

user7047382 wrote:
Hello,
I am trying to load a CSV file located on my C:\ drive on a WIndows XP system into an 'external table'. Everyting used to work correctly when using Oracle XE (iinstalled also locally on my WIndows system).
However, once I am trynig to load the same file into a Oracle 11g R2 database on UNIX, I get the following errr:
ORA-29913: Error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
error opening file ...\...\...nnnnn.log
Please let me know if I can achieve the same functionality I had with Oracle XP.
(Note: I cannot use SQL*Loader approach, I am invoking Oracle stored procedures from VB.Net that are attempting to load data into external tables).
Regards,
M.R.So your database is on a unix box, but the file is on your Windows desktop machine? So .... how is it you are making your file (on your desktop) visible to your database (on a unix box)???????

Similar Messages

Installing Oracle SQL loader in Oracel Client

Hi
Our Customer does not have SQL Loader in Oracle client
I want to add Oracle SQL loader to the Oracle Client.
Is there any solution other than uninstalling the present oracle client and
re-installing the oracle client with SQL loader
Regards
Kandakuru

Thanks a lot Kristian
I will try with the oracle universal installer
Regards
Kandakuru

How can I invoke a sql loader from oracle form?

I'm got a problem on invoking sql loader command from oracle form where the sql loader product has been installed in Window NT.
Thanks for your help!

U can use HOST procedure with NO_SCREEN option.
this will go like
Host('d:\orant\bin\SQLLDR80 USERID=username/password@connect CONTROL=contril_file.CTL LOG=log_file.LOG discard=discard_file.dis bad=bad_file.bad', NO_SCREEN);
Hope this will Work
Good Luck :-)
Naren

Calling oracle SQL Loader from java program

Hi,
I want to insert data into oracle tables from a text files containing fixed length fields. I am using SQLLoader to achieve this. The requirement is to call the SQLLoader within the java program.
Does anyone know how to call SQL Loader from java program?
Thanks,
Varsha

Simply "exec" the sqlldr program with the parameters you need to pass to it.
Runtime.exec (........)
Try to pass all parameters needed including the username and password, and use the option "silent" to avoid output, and the option "log" to have a log file of the modifications that sqlldr has done to the database.

ORACLE SQL-Loader

Hi...
i am having Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production.
Question is:
we have a table 'T' in ABC database.
we need to load data from txt file to tabel T.
here the requirement is we need to skip few columns in this process.
let me go in clear....
data:
A,1234,ap,xyz
B,2345,TN,WER
C,4567,KA,We
D,5678,MH,show
now i want to laod data into T like
col1, col2, col3
A, 1234, ap
B,2345, TN
i need to skip the data after last comma.(at the same time we should not fill with nulls)
How come we achieve?
Thanks,
Pram

Try with Filler option in sql loader
LOAD DATA
INFILE *
INSERT INTO TABLE TEST
Fields terminated by ";" Optionally enclosed by '"'
ENAME,
EMPNO FILLER,
SAL
BEGINDATA
"JONES";7566;3405
"BLAKE";7698;2980
"CLARK";7782;8000
"SCOTT";7788;3430
"KING";7839;6430
"JONES";7566;3405
"JONES";7566;3405
"BLAKE";7698;2980
"CLARK";7782;8000
"SCOTT";7788;3430
"KING";7839;6430
{code}

ORA-12899 error from function invoked from SQL*Loader

I am getting the above error when I call a function from my SQL*Loader script, and I am not seeing what the problem is. As far as I can see, there should be no problem with the field lengths, unless the length of the automatic variable within my function is somehow being set at 30? Here are the details (in the SQL*Loader script, the field of interest is the last one):
====
Error:
====
Record 1: Rejected - Error on table TESTM8.LET_DRIVE_IN_FCLTY, column DIF_CSA_ID.
ORA-12899: value too large for column "TESTM8"."LET_DRIVE_IN_FCLTY"."DIF_CSA_ID" (actual: 30, maximum: 16)
=======
Function:
=======
CREATE OR REPLACE FUNCTION find_MCO_id (di_oid_in DECIMAL)
RETURN CHAR IS mco_id CHAR;
BEGIN
SELECT AOL_MCO_LOC_CD INTO mco_id
FROM CONV_DI_FLCTY
WHERE DIF_INST_ELMNT_OID = di_oid_in;
RETURN TRIM(mco_id);
END;
==============
SQL*Loader Script:
==============
LOAD DATA
INFILE 'LET_DRIVE_IN_FCLTY.TXT'
BADFILE 'LOGS\LET_DRIVE_IN_FCLTY_BADDATA.TXT'
DISCARDFILE 'LOGS\LET_DRIVE_IN_FCLTY_DISCARDDATA.TXT'
REPLACE
INTO TABLE TESTM8.LET_DRIVE_IN_FCLTY
FIELDS TERMINATED BY '~' OPTIONALLY ENCLOSED BY '"'
DIF_DRIVE_IN_OID DECIMAL EXTERNAL,
DIF_FCLTY_TYPE_OID DECIMAL EXTERNAL NULLIF DIF_FCLTY_TYPE_OID = 'NULL',
DIF_INST_ELMNT_OID DECIMAL EXTERNAL,
DIF_PRI_PERSON_OID DECIMAL EXTERNAL NULLIF DIF_PRI_PERSON_OID = 'NULL',
DIF_SEC_PERSON_OID DECIMAL EXTERNAL NULLIF DIF_SEC_PERSON_OID = 'NULL',
DIF_CREATE_TS TIMESTAMP "yyyy-mm-dd-hh24.mi.ss.ff6",
DIF_LAST_UPDATE_TS TIMESTAMP "yyyy-mm-dd-hh24.mi.ss.ff6",
DIF_ADP_ID CHAR NULLIF DIF_ADP_ID = 'NULL',
DIF_CAT_CLAIMS_IND CHAR,
DIF_CAT_DIF_IND CHAR,
DIF_DAYLT_SAVE_IND CHAR,
DIF_OPEN_PT_TM_IND CHAR,
DIF_CSA_ID CONSTANT "find_MCO_id(:DIF_DRIVE_IN_OID)"
============
Table Definitions:
============
SQL> describe CONV_DI_FLCTY;
Name Null? Type
DIF_INST_ELMNT_OID NOT NULL NUMBER(18)
AOL_MCO_LOC_CD NOT NULL VARCHAR2(3)
SQL> describe LET_DRIVE_IN_FCLTY;
Name Null? Type
DIF_DRIVE_IN_OID NOT NULL NUMBER(18)
DIF_INST_ELMNT_OID NOT NULL NUMBER(18)
DIF_FCLTY_TYPE_OID NUMBER(18)
DIF_ADP_ID VARCHAR2(10)
DIF_CAT_DIF_IND NOT NULL VARCHAR2(1)
DIF_CAT_CLAIMS_IND NOT NULL VARCHAR2(1)
DIF_CSA_ID VARCHAR2(16)
DIF_DAYLT_SAVE_IND NOT NULL VARCHAR2(1)
DIF_ORG_ENTY_ID VARCHAR2(16)
DIF_OPEN_PT_TM_IND NOT NULL VARCHAR2(1)
DIF_CREATE_TS NOT NULL DATE
DIF_LAST_UPDATE_TS NOT NULL DATE
DIF_ITM_FCL_MKT_ID NUMBER(18)
DIF_PRI_PERSON_OID NUMBER(18)
DIF_SEC_PERSON_OID NUMBER(18)
=========================
Thanks for any help with this one!

I changed one line of the function to:
RETURN CHAR IS mco_id VARCHAR2(16);
But I still get the same error:
ORA-12899: value too large for column "TESTM8"."LET_DRIVE_IN_FCLTY"."DIF_CSA_ID" (actual: 30, maximum: 16)
I just am not seeing what is being defined as 30 characters. Any ideas much appreciated!

Load Xml Data in oracle (SQL LOADER)

i have written a sql loader script given below....
load data
infile 'contact1.xml' "str '</CONTACT>'"
truncate
into table XmlTest
dummy filler terminated by ">",
Location_id enclosed by "<Location_id>" and "</Location_id>",
fname enclosed by "<fname>" and "</fname>",
lname enclosed by "<lname>" and "</lname>"
the content of the contact1.xml is given below.....
<CONTACT>
<Location_id>1</Location_id>
<fname>Robert</fname>
<lname>Jones</lname>
</CONTACT>
<CONTACT>
<Location_id>1</Location_id>
<fname>Robert</fname>
<lname>Jones</lname>
</CONTACT>
the script works fine for the given xml... but if one of the tag in the xml is changed to below syntax....
<CONTACT Location_id="1">
<fname>Robert</fname>
<lname>Jones</lname>
</CONTACT>
<CONTACT Location_id="1">
<fname>Robert</fname>
<lname>Jones</lname>
</CONTACT>
what modification is required in the script to read such xml...Kindly Help!!

And in what way does this relate to SQL and PL/SQL?
There is a demo of loading XML in Morgan's Library under SQL*Loader.
But as your question is off-topic here ... if the demo does not help you please continue this by starting a thread in the correct forum: Database General.
Thanks.

Oracle sql loader error

options (bindsize=400000)
load data
infile '1377.bmp' "fix 17"
append
concatenate 50000
into table PER_IMAGES
(image_id constant 2004,
image raw(811254),
parent_id constant 1377,
table_name constant "PER_PEOPLE_F")
The above is my control file
The file I am trying to load is a bmp file of size 811254 bytes
unfortunately the size is larger than 64 K hence I have to concatenate it
It cannot be broken into equal pieces
hence I decided to break it into size 50000 bytes each and tried to load 17 pieces and concatenate it as suggested by
metalink
However it does not work
The error message I get is as follows
SQL*Loader-501: Unable to read file (1377.bmp)
SQL*Loader-566: partial record found at end of datafile
SQL*Loader-2026: the load was aborted because SQL Loader cannot continue.
Any clues ?

Hi,
Please see if there documents help.
Note: 1058890.6 - SQL*LOADER-524 USING SQL*LOADER
Note: 105582.1 - SQL*Loader-524 When Loading Images
Regards,
Hussein

Oracle SQL Loader - External Table

This is my code:-
CREATE TABLE GLO_CUST_EXT
(SOURCE_ID CHAR(3),
BUS_DT CHAR(8),
TRAN_CD CHAR(1),
CUST_CD NUMBER(10),
MNEMONIC CHAR(10),
SHORT_NM CHAR(255))
ORGANIZATION external
(TYPE oracle_loader
DEFAULT DIRECTORY Source_dir
ACCESS PARAMETERS
(RECORDS DELIMITED BY NEWLINE Skip 1
badfile bad_dir:'GLO_CUST%a_%p.bad'
LOGFILE log_dir:'GLO_CUST%a_%p.log'
FIELDS TERMINATED BY '|'
(SOURCE_ID ,
BUS_DT ,
TRAN_Cd ,
CUST_CD,
MNEMONIC,
SHORT_NM))
LOCATION ('GBCUS.txt'))
REJECT LIMIT 0;
Question:
Would like how to load the data by selected field?
Example:
I want to all these fields (SOURCE_ID , BUS_DT , TRAN_CD ,
CUST_CD, SHORT_NM) except the MNEMONIC. Thank you.

Mohan Nair,
This is my code:
CREATE TABLE GLO_CUST_EXT5
(SOURCE_ID CHAR(3),
BUS_DT CHAR(8),
TRAN_CD CHAR(1),
CUST_CD NUMBER(10),
MNEMONIC CHAR(10),
SHORT_NM CHAR(255))
ORGANIZATION external
(TYPE oracle_loader
DEFAULT DIRECTORY Source_dir
ACCESS PARAMETERS
(RECORDS DELIMITED BY NEWLINE Skip 1
badfile bad_dir:'GLO_CUST%a_%p.bad'
LOGFILE log_dir:'GLO_CUST%a_%p.log'
FIELDS TERMINATED BY '|'
(SOURCE_ID ,
BUS_DT ,
TRAN_Cd ,
CUST_CD,
MNEMONIC FILLER,
SHORT_NM))
LOCATION ('GBCUS.txt'))
REJECT LIMIT 0;
I'm using Oracle 10g. I execute this code using TOAD version 8.5.0.50.
I can create the external table, but when i used simple select statement
(select * from GLO_CUST_EXT5), i got this error:
ORA-29913: error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
KUP-00554: error encountered while parsing access parameters
KUP-01005: syntax error: found "identifier": expecting one of: "binary_double, binary_float, comma, char, date, defaultif, decimal, double, float, integer, (, nullif, oracle_date, oracle_number, position, raw, recnum, ), unsigned, varrawc, varchar, varraw, varcharc, zoned"
KUP-01008: the bad identifier was: FILLER
KUP-01007: at line 9 column 10
ORA-06512: at "S
Can you help me solve this problem? Thank you.

Invoking SQL Loader from linux - Help Needed

Hi All,
When i tried to invoke the sql loader from linux by using following command
sqlldr username@server/password control=loader.ctl
But its always throws this message
Message 2100 not found; No message file for product=RDBMS, facility=ULMessage 2100 not found; No message file for product=RDBMS, facility=UL
Can somebody help me to fix this issue?

You may need to set your Oracle environment, try this ($ is the command prompt):
$ export ORACLE_SID=orcl
$ . /usr/local/bin/oraenv
$ sqlldr username@server/password control=loader.ctl:p

Cannot get Oracle sequence to be used with SQL Loader direct path load.

I attempted to load approximately 3 million rows from a flat file into a 10g database using SQL Loader direct path load. In order to generate a primary key for each of these rows I used a simple SQL expression which gets the next number of an Oracle sequence and assigned that to my primary key column inside the control file. The strange thing is no primary key was generated for each of these columns as I see the sequence was not advanced. Furthermore when I try to run a query to find the count on those rows which have this column as NOT NULL ,I get the total of all the rows even though on inspection this column is empty in each of the rows.
As far as I know, in the control file for a direct path load I am able to use a SQL Expression that returns simple scalar data which a NEXTVAL on a sequence does. (Oreilly Oracle SQL Loader The Definitive Guide p.184)
Does anybody why my primary key was not generated and furthermore why is this column in a query appear to be NOT NULL when in fact it has nothing in it?

Daniel,
I appreciate your response alot.
Now a follow on. You say that SQL*Loader is the fastest way to get data into Oracle Spatial even though the conventional path. How does SQL*Loader do this? Doesn't it use OCI?
I just can't help but think that coverting my data to SQL*Loader format, and then having it parse it and send it to the database in some form must be slower than me just sending whatever SQL Loader sends to the DB myself using OCI. Am I missing something?
The SQL Loader documentation seems to suggest that SQL*Loader just turns the input into alot of INSERT stateemnts. If so, can't I just do this?
My performance with OCI and INSERT statements isn't very good, but I believe I am doing one transaction per insert. Might I be as well off to concentrate on fine tuning my OCI based code using INSERTs?
I will actually do some time tests myself, but I would appreciate your opinion.
Once again thanks for the great info you have provided.

SQL Loader part of Oracle Client? Seperate install,licensing

I use Oracle SQL Loader on one of my network machines.
The second does not have the SQLLDR.exe in the /bin directory.
First, can I install this component seperately and secondly
what are the licensing implications ?
Thanks

Assuming you are referring to client installation, the other machine where the SQLLDR.EXE is missing seems to be a "runtime" client installation. Oracle client is a free download so there should be no implications for installing an administrator type install on this machine.
If this is not the case, then you should be talking to the sales person about knowing the implications.

Invoke SQL Loader

Hi,
I have an application where I use a SQL Loader to load data onto the table. When i log in as a regular user i try to invoke the SQL Loader on the server. For the credentials to connect to the server like username/Password@database to invoke the sqlldr it looks into a table. We had hard coded the admin username and password while passing these credentials to the server. So irrespective of which user logged in it would load data into the admin.tablename. But right now we want to change that and we want to load data into each users individual table.
For example if its user1 logged in .. when he does the data load it should load data into user1.tablename. So I assume i have to pass his credentials which connecting to the SQL loader instead of the admin. But we dont store any information of the user and their passwords in the application and there is no way we could retrieve password for each user. So if I dont have the password information of the user how would i connect to the server to run the SQL Loader. Could I pass the table name explicitly to the sqlldr instead of the .ctl file? Is there any work around to this as to how I could load data onto individual users tables.
Thanks and Regards

user635059 wrote:
Hi,
I have an application where I use a SQL Loader to load data onto the table. When i log in as a regular user i try to invoke the SQL Loader on the server. For the credentials to connect to the server like username/Password@database to invoke the sqlldr it looks into a table. We had hard coded the admin username and password while passing these credentials to the server. So irrespective of which user logged in it would load data into the admin.tablename. But right now we want to change that and we want to load data into each users individual table.
Well, since you hard coded the admin username, that admin username has INSERT ANY TABLE, yes? So all you need to do is create SQL*Loader control file specifying OWNER.TABLENAME as load table. For example, control file is:
load data
into table u1.example
fields terminated by ',' optionally enclosed by '"'
(col1 char(5),
col2 char(7))
{code}
Data file is:
{code}
hello,world,|
james,bond,|
{code}
Now:
{code}
SQL> show user
USER is "SCOTT"
SQL> create table u1.example(col1 varchar2(10),col2 varchar2(10))
2 /
Table created.
SQL> host sqlldr scott/tiger data=c:\temp\example.txt control=c:\temp\example.ctl
SQL> select * from u1.example
2 /
COL1       COL2
hello      world
james      bond
SQL>
{code}
SY.

SQL Loader and Java

Hi,
I am using a Java Stored Procedure to invoke a SQL Loader process. The RDBMS Version is 8.1.7 on HP-UX 11. I invoke the procedure by calling: exec runcommand('sqlldr user=scott/tiger@orcl control=/home/mydir/ctlfile.ctl log=/home/mydir/logfile.log direct=true errors=550')
where runcommand is the name of the java stored procedure.
The SQL Loader process returns a value of 3 which is the return value for an Operating System Error. I am unable to find any errors related to the Operating System. Is there any particular environment variable which needs to be set before running the process.
I was able to run the same Java Stored Procedure on Personal Oracle on Windows XP without any problems.
TIA,
Ramesh

Hi,
Make sure that the path for data file in control file is correct.
Then it serves your purpose.
Otherwise, give full path to "sqlldr", then run it.
Please let me know the result.
Thanks
Srinivasa Rao

Different log file name in the Control file of SQL Loader

Dear all,
I get every day 3 log files with ftp from a Solaris Server to a Windows 2000 Server machine. In this Windows machine, we have an Oracle Database 9.2. These log files are in the following format: in<date>.log i.e. in20070429.log.
I would like to load this log file's data to an Oracle table every day and I would like to use SQL Loader for this job.
The problem is that the log file name is different every day.
How can I give this variable log file name in the Control file, which is used for the SQL Loader?
file.ctl
LOAD DATA
INFILE 'D:\gbal\in<date>.log'
APPEND INTO TABLE CHAT_SL
FIELDS TERMINATED BY WHITESPACE
TRAILING NULLCOLS
(SL1 DATE "Mon DD, YYYY HH:MI:SS FF3AM",
SL2 char,
SL3 DATE "Mon DD, YYYY HH:MI:SS FF3AM",
SL4 char,
SL5 char,
SL6 char,
SL7 char,
SL8 char,
SL9 char,
SL10 char,
SL11 char,
SL12 char,
SL13 char,
SL14 char,
SL15 char)
Do you have any better idea about this issue?
I thought of renaming the log file to an instant name, such as in.log, but how can I distinguish the desired log file, from the other two?
Thank you very much in advance.
Giorgos Baliotis

I don't have a direct solution for your problem.
However if you invoke the SQL loader from an Oracle stored procedure, it is possible to dynamically set control\log file.
# Grant previleges to the user to execute command prompt statements
BEGIN
dbms_java.grant_permission('bc4186ol','java.io.FilePermission','C:\windows\system32\cmd.exe','execute');
END;
* Procedure to execute Operating system commands using PL\SQL(Oracle script making use of Java packages
CREATE OR REPLACE AND COMPILE JAVA SOURCE NAMED "Host" AS
import java.io.*;
public class Host {
public static void executeCommand(String command) {
try {
String[] finalCommand;
finalCommand = new String[4];
finalCommand[0] = "C:\\windows\\system32\\cmd.exe";
finalCommand[1] = "/y";
finalCommand[2] = "/c";
finalCommand[3] = command;
final Process pr = Runtime.getRuntime().exec(finalCommand);
new Thread(new Runnable() {
public void run() {
try {
BufferedReader br_in = new BufferedReader(new InputStreamReader(pr.getInputStream()));
String buff = null;
while ((buff = br_in.readLine()) != null) {
System.out.println("Process out :" + buff);
try {Thread.sleep(100); } catch(Exception e) {}
catch (IOException ioe) {
System.out.println("Exception caught printing process output.");
ioe.printStackTrace();
}).start();
new Thread(new Runnable() {
public void run() {
try {
BufferedReader br_err = new BufferedReader(new InputStreamReader(pr.getErrorStream()));
String buff = null;
while ((buff = br_err.readLine()) != null) {
System.out.println("Process err :" + buff);
try {Thread.sleep(100); } catch(Exception e) {}
catch (IOException ioe) {
System.out.println("Exception caught printing process error.");
ioe.printStackTrace();
}).start();
catch (Exception ex) {
System.out.println(ex.getLocalizedMessage());
public static boolean isWindows() {
if (System.getProperty("os.name").toLowerCase().indexOf("windows") != -1)
return true;
else
return false;
* Oracle wrapper to call the above procedure
CREATE OR REPLACE PROCEDURE Host_Command (p_command IN VARCHAR2)
AS LANGUAGE JAVA
NAME 'Host.executeCommand (java.lang.String)';
* Now invoke the procedure with an operating system command(Execyte SQL-loader)
* The execution of script would ensure the Prod mapping data file is loaded to PROD_5005_710_MAP table
* Change the control\log\discard\bad files as apropriate
BEGIN
Host_Command (p_command => 'sqlldr system/tiburon@orcl control=C:\anupama\emp_join'||1||'.ctl log=C:\anupama\ond_lists.log');
END;Does that help you?
Regards,
Bhagat

Invoking Oracle SQL Loader

Similar Messages

Maybe you are looking for