ORACLE SQL-Loader

Hi...
i am having Oracle Database 11g Enterprise Edition Release 11.2.0.2.0 - 64bit Production.
Question is:
we have a table 'T' in ABC database.
we need to load data from txt file to tabel T.
here the requirement is we need to skip few columns in this process.
let me go in clear....
data:
A,1234,ap,xyz
B,2345,TN,WER
C,4567,KA,We
D,5678,MH,show
now i want to laod data into T like
col1, col2, col3
A, 1234, ap
B,2345, TN
i need to skip the data after last comma.(at the same time we should not fill with nulls)
How come we achieve?
Thanks,
Pram

Try with Filler option in sql loader
LOAD DATA
INFILE *
INSERT INTO TABLE TEST
Fields terminated by ";" Optionally enclosed by '"'
ENAME,
EMPNO FILLER,
SAL
BEGINDATA
"JONES";7566;3405
"BLAKE";7698;2980
"CLARK";7782;8000
"SCOTT";7788;3430
"KING";7839;6430
"JONES";7566;3405
"JONES";7566;3405
"BLAKE";7698;2980
"CLARK";7782;8000
"SCOTT";7788;3430
"KING";7839;6430
{code}

Similar Messages

Invoking Oracle SQL Loader

I am looking at doing some re-factoring on data load process for inventory feed. Current process takes over an hour to process the file.
My thought is to go down this road
1. Using Oracle SQL Loader - load the inventory data into a temp table
2. Using a view to create the differences between ATG Inventory repository and what is in the temp table
3. Using the results to update the ATG Inventory stock levels
So questions are
1. Is it possible to call the Oracle SQL Loader from a ATG service component - if so how?
2. Would it be better/faster/possible to create the difference when loading the temp tables
3. How to create ATG view?

user7047382 wrote:
Hello,
I am trying to load a CSV file located on my C:\ drive on a WIndows XP system into an 'external table'. Everyting used to work correctly when using Oracle XE (iinstalled also locally on my WIndows system).
However, once I am trynig to load the same file into a Oracle 11g R2 database on UNIX, I get the following errr:
ORA-29913: Error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
error opening file ...\...\...nnnnn.log
Please let me know if I can achieve the same functionality I had with Oracle XP.
(Note: I cannot use SQL*Loader approach, I am invoking Oracle stored procedures from VB.Net that are attempting to load data into external tables).
Regards,
M.R.So your database is on a unix box, but the file is on your Windows desktop machine? So .... how is it you are making your file (on your desktop) visible to your database (on a unix box)???????

Installing Oracle SQL loader in Oracel Client

Hi
Our Customer does not have SQL Loader in Oracle client
I want to add Oracle SQL loader to the Oracle Client.
Is there any solution other than uninstalling the present oracle client and
re-installing the oracle client with SQL loader
Regards
Kandakuru

Thanks a lot Kristian
I will try with the oracle universal installer
Regards
Kandakuru

Calling oracle SQL Loader from java program

Hi,
I want to insert data into oracle tables from a text files containing fixed length fields. I am using SQLLoader to achieve this. The requirement is to call the SQLLoader within the java program.
Does anyone know how to call SQL Loader from java program?
Thanks,
Varsha

Simply "exec" the sqlldr program with the parameters you need to pass to it.
Runtime.exec (........)
Try to pass all parameters needed including the username and password, and use the option "silent" to avoid output, and the option "log" to have a log file of the modifications that sqlldr has done to the database.

Load Xml Data in oracle (SQL LOADER)

i have written a sql loader script given below....
load data
infile 'contact1.xml' "str '</CONTACT>'"
truncate
into table XmlTest
dummy filler terminated by ">",
Location_id enclosed by "<Location_id>" and "</Location_id>",
fname enclosed by "<fname>" and "</fname>",
lname enclosed by "<lname>" and "</lname>"
the content of the contact1.xml is given below.....
<CONTACT>
<Location_id>1</Location_id>
<fname>Robert</fname>
<lname>Jones</lname>
</CONTACT>
<CONTACT>
<Location_id>1</Location_id>
<fname>Robert</fname>
<lname>Jones</lname>
</CONTACT>
the script works fine for the given xml... but if one of the tag in the xml is changed to below syntax....
<CONTACT Location_id="1">
<fname>Robert</fname>
<lname>Jones</lname>
</CONTACT>
<CONTACT Location_id="1">
<fname>Robert</fname>
<lname>Jones</lname>
</CONTACT>
what modification is required in the script to read such xml...Kindly Help!!

And in what way does this relate to SQL and PL/SQL?
There is a demo of loading XML in Morgan's Library under SQL*Loader.
But as your question is off-topic here ... if the demo does not help you please continue this by starting a thread in the correct forum: Database General.
Thanks.

Oracle sql loader error

options (bindsize=400000)
load data
infile '1377.bmp' "fix 17"
append
concatenate 50000
into table PER_IMAGES
(image_id constant 2004,
image raw(811254),
parent_id constant 1377,
table_name constant "PER_PEOPLE_F")
The above is my control file
The file I am trying to load is a bmp file of size 811254 bytes
unfortunately the size is larger than 64 K hence I have to concatenate it
It cannot be broken into equal pieces
hence I decided to break it into size 50000 bytes each and tried to load 17 pieces and concatenate it as suggested by
metalink
However it does not work
The error message I get is as follows
SQL*Loader-501: Unable to read file (1377.bmp)
SQL*Loader-566: partial record found at end of datafile
SQL*Loader-2026: the load was aborted because SQL Loader cannot continue.
Any clues ?

Hi,
Please see if there documents help.
Note: 1058890.6 - SQL*LOADER-524 USING SQL*LOADER
Note: 105582.1 - SQL*Loader-524 When Loading Images
Regards,
Hussein

Oracle SQL Loader - External Table

This is my code:-
CREATE TABLE GLO_CUST_EXT
(SOURCE_ID CHAR(3),
BUS_DT CHAR(8),
TRAN_CD CHAR(1),
CUST_CD NUMBER(10),
MNEMONIC CHAR(10),
SHORT_NM CHAR(255))
ORGANIZATION external
(TYPE oracle_loader
DEFAULT DIRECTORY Source_dir
ACCESS PARAMETERS
(RECORDS DELIMITED BY NEWLINE Skip 1
badfile bad_dir:'GLO_CUST%a_%p.bad'
LOGFILE log_dir:'GLO_CUST%a_%p.log'
FIELDS TERMINATED BY '|'
(SOURCE_ID ,
BUS_DT ,
TRAN_Cd ,
CUST_CD,
MNEMONIC,
SHORT_NM))
LOCATION ('GBCUS.txt'))
REJECT LIMIT 0;
Question:
Would like how to load the data by selected field?
Example:
I want to all these fields (SOURCE_ID , BUS_DT , TRAN_CD ,
CUST_CD, SHORT_NM) except the MNEMONIC. Thank you.

Mohan Nair,
This is my code:
CREATE TABLE GLO_CUST_EXT5
(SOURCE_ID CHAR(3),
BUS_DT CHAR(8),
TRAN_CD CHAR(1),
CUST_CD NUMBER(10),
MNEMONIC CHAR(10),
SHORT_NM CHAR(255))
ORGANIZATION external
(TYPE oracle_loader
DEFAULT DIRECTORY Source_dir
ACCESS PARAMETERS
(RECORDS DELIMITED BY NEWLINE Skip 1
badfile bad_dir:'GLO_CUST%a_%p.bad'
LOGFILE log_dir:'GLO_CUST%a_%p.log'
FIELDS TERMINATED BY '|'
(SOURCE_ID ,
BUS_DT ,
TRAN_Cd ,
CUST_CD,
MNEMONIC FILLER,
SHORT_NM))
LOCATION ('GBCUS.txt'))
REJECT LIMIT 0;
I'm using Oracle 10g. I execute this code using TOAD version 8.5.0.50.
I can create the external table, but when i used simple select statement
(select * from GLO_CUST_EXT5), i got this error:
ORA-29913: error in executing ODCIEXTTABLEOPEN callout
ORA-29400: data cartridge error
KUP-00554: error encountered while parsing access parameters
KUP-01005: syntax error: found "identifier": expecting one of: "binary_double, binary_float, comma, char, date, defaultif, decimal, double, float, integer, (, nullif, oracle_date, oracle_number, position, raw, recnum, ), unsigned, varrawc, varchar, varraw, varcharc, zoned"
KUP-01008: the bad identifier was: FILLER
KUP-01007: at line 9 column 10
ORA-06512: at "S
Can you help me solve this problem? Thank you.

Cannot get Oracle sequence to be used with SQL Loader direct path load.

I attempted to load approximately 3 million rows from a flat file into a 10g database using SQL Loader direct path load. In order to generate a primary key for each of these rows I used a simple SQL expression which gets the next number of an Oracle sequence and assigned that to my primary key column inside the control file. The strange thing is no primary key was generated for each of these columns as I see the sequence was not advanced. Furthermore when I try to run a query to find the count on those rows which have this column as NOT NULL ,I get the total of all the rows even though on inspection this column is empty in each of the rows.
As far as I know, in the control file for a direct path load I am able to use a SQL Expression that returns simple scalar data which a NEXTVAL on a sequence does. (Oreilly Oracle SQL Loader The Definitive Guide p.184)
Does anybody why my primary key was not generated and furthermore why is this column in a query appear to be NOT NULL when in fact it has nothing in it?

Daniel,
I appreciate your response alot.
Now a follow on. You say that SQL*Loader is the fastest way to get data into Oracle Spatial even though the conventional path. How does SQL*Loader do this? Doesn't it use OCI?
I just can't help but think that coverting my data to SQL*Loader format, and then having it parse it and send it to the database in some form must be slower than me just sending whatever SQL Loader sends to the DB myself using OCI. Am I missing something?
The SQL Loader documentation seems to suggest that SQL*Loader just turns the input into alot of INSERT stateemnts. If so, can't I just do this?
My performance with OCI and INSERT statements isn't very good, but I believe I am doing one transaction per insert. Might I be as well off to concentrate on fine tuning my OCI based code using INSERTs?
I will actually do some time tests myself, but I would appreciate your opinion.
Once again thanks for the great info you have provided.

SQL Loader part of Oracle Client? Seperate install,licensing

I use Oracle SQL Loader on one of my network machines.
The second does not have the SQLLDR.exe in the /bin directory.
First, can I install this component seperately and secondly
what are the licensing implications ?
Thanks

Assuming you are referring to client installation, the other machine where the SQLLDR.EXE is missing seems to be a "runtime" client installation. Oracle client is a free download so there should be no implications for installing an administrator type install on this machine.
If this is not the case, then you should be talking to the sales person about knowing the implications.

SQL*Loader and multiple files

Hello, am tasked with loading tables with 21+ million rows. Will SQL*Loader perform better with one large file or many smaller files? Is there any ideal file size for optimal performance? Thank you
David

Don, when I tried to loada 21M row table using direct, I get the following messages:
Record 2373: Rejected - Error on table STAGE_CUSTOMER.
ORA-03113: end-of-file on communication channel
SQL*Loader-926: OCI error while uldlfca:OCIDirPathColArrayLoadStream for table STAGE_CUSTOMER
SQL*Loader-2026: the load was aborted because SQL Loader cannot continue.
SQL*Loader-925: Error while uldlgs: OCIStmtExecute (ptc_hp)
ORA-03114: not connected to ORACLE
SQL*Loader-925: Error while uldlgs: OCIStmtFetch (ptc_hp)
ORA-24338: statement handle not executed
Here is the SQL*Loader log:
SQL*Loader: Release 9.2.0.1.0 - Production on Thu Apr 26 15:38:29 2007
Copyright (c) 1982, 2002, Oracle Corporation. All rights reserved.
Control File: stage_customer.ctl
Character Set UTF8 specified for all input.
First primary datafile stage_Customer_20070301.csv has a
utf8 byte order mark in it.
Data File: stage_Customer_20070301.csv
Bad File: stage_Customer_20070301.bad
Discard File: none specified
(Allow all discards)
Number to load: ALL
Number to skip: 0
Errors allowed: 1000
Continuation: none specified
Path used: Direct
Silent options: FEEDBACK
Table STAGE_CUSTOMER, loaded from every logical record.
Insert option in effect for this table: APPEND
TRAILING NULLCOLS option in effect
Column Name Position Len Term Encl Datatype
ROW_ID SEQUENCE (MAX, 1)
CUSTOMER_ACCT_NUM FIRST * , O(") CHARACTER
IS_DELETED NEXT * , O(") CHARACTER
SQL string for column : "CASE WHEN UPPER(:Is_Deleted) IN ('FALSE','0') THEN 0 ELSE 1 END"
NAME_PREFIX NEXT * , O(") CHARACTER
FIRST_NAME NEXT * , O(") CHARACTER
MIDDLE_NAME NEXT * , O(") CHARACTER
LAST_NAME NEXT * , O(") CHARACTER
NAME_SUFFIX NEXT * , O(") CHARACTER
NICK_NAME NEXT * , O(") CHARACTER
ALT_FIRST_NAME NEXT * , O(") CHARACTER
ALT_LAST_NAME NEXT * , O(") CHARACTER
MARKETING_SOURCE_ID NEXT * , O(") CHARACTER
HOME_PHONE NEXT * , O(") CHARACTER
WORK_PHONE NEXT * , O(") CHARACTER
MOBILE_PHONE NEXT * , O(") CHARACTER
ALTERNATE_PHONE NEXT * , O(") CHARACTER
EMAIL_ADDR NEXT * , O(") CHARACTER
ALT_EMAIL_ADDR NEXT * , O(") CHARACTER
BIRTH_DATE NEXT * , O(") CHARACTER
SQL string for column : "TRUNC(TO_DATE(:Birth_Date, 'MM/DD/YYYY HH24:MI:SS'))"
SALES_CHANNEL_ID NEXT * , O(") CHARACTER
SQL string for column : "decode(:Sales_Channel_id,NULL,NULL,NULL)"
ASSOCIATE_NUMBER NEXT * , O(") CHARACTER
ALT_ASSOCIATE_NUMBER NEXT * , O(") CHARACTER
UPDATE_LOCATION_CD NEXT * , O(") CHARACTER
UPDATE_DATE NEXT * , O(") CHARACTER
SQL string for column : "TRUNC(TO_DATE(:Update_Date, 'MM/DD/YYYY HH24:MI:SS'))"
CUSTOMER_LOGIN_NAME NEXT * , O(") CHARACTER
DISCOUNT_CD NEXT * , O(") CHARACTER
DISCOUNT_PERCENT NEXT * , O(") CHARACTER
BUSINESS_NAME NEXT * , O(") CHARACTER
POS_TAX_FLAG NEXT * , O(") CHARACTER
POS_TAX_PROMPT NEXT * , O(") CHARACTER
SQL string for column : "CASE WHEN UPPER(:POS_TAX_PROMPT) IN ('FALSE','0') THEN 0 ELSE 1 END"
POS_DEFAULT_TAX_ID NEXT * , O(") CHARACTER
POS_TAX_ID_EXPIRATION_DATE NEXT * , O(") CHARACTER
POS_AUTHORIZED_USER_FLAG NEXT * , O(") CHARACTER
SQL string for column : "CASE WHEN UPPER(:POS_AUTHORIZED_USER_FLAG) IN ('FALSE','0') THEN 0 ELSE 1 END"
POS_ALLOW_PURCHASE_ORDER_FLAG NEXT * , O(") CHARACTER
SQL string for column : "CASE WHEN UPPER(:POS_ALLOW_PURCHASE_ORDER_FLAG) IN ('FALSE','0') THEN 0 ELSE 1 END"
ADDRESS1 NEXT * , O(") CHARACTER
ADDRESS2 NEXT * , O(") CHARACTER
ADDRESS3 NEXT * , O(") CHARACTER
CITY NEXT * , O(") CHARACTER
STATE_CD NEXT * , O(") CHARACTER
POSTAL_CD NEXT * , O(") CHARACTER
COUNTRY_CD NEXT * , O(") CHARACTER
ALLOW_UPDATE NEXT * , O(") CHARACTER
SQL string for column : "CASE WHEN UPPER(:ALLOW_UPDATE) IN ('FALSE','0') THEN 0 ELSE 1 END"
ACTION_CODE NEXT * , O(") CHARACTER
SQL string for column : "CASE WHEN UPPER(:action_code) IN ('FALSE','0') THEN 0 ELSE 1 END"
ACCOUNT_TYPE_ID NEXT * , O(") CHARACTER
LOCALE_CD NEXT * , O(") CHARACTER
SQL string for column : "CASE WHEN :Locale_CD IS NOT NULL AND :Locale_CD LIKE '__-__' THEN :Locale_CD ELSE 'en-US' END"
IS_READY_FOR_PROCESSING CONSTANT
Value is '1'
IS_BUSINESS CONSTANT
Value is '0'
HAD_ERRORS CONSTANT
Value is '0'
Record 2373: Rejected - Error on table STAGE_CUSTOMER.
ORA-03113: end-of-file on communication channel
SQL*Loader-926: OCI error while uldlfca:OCIDirPathColArrayLoadStream for table STAGE_CUSTOMER
SQL*Loader-2026: the load was aborted because SQL Loader cannot continue.
SQL*Loader-925: Error while uldlgs: OCIStmtExecute (ptc_hp)
ORA-03114: not connected to ORACLE
SQL*Loader-925: Error while uldlgs: OCIStmtFetch (ptc_hp)
ORA-24338: statement handle not executed
Table STAGE_CUSTOMER:
0 Rows successfully loaded.
1 Row not loaded due to data errors.
0 Rows not loaded because all WHEN clauses were failed.
0 Rows not loaded because all fields were null.
Bind array size not used in direct path.
Column array rows : 5000
Stream buffer bytes: 256000
Read buffer bytes: 1048576
Total logical records skipped: 0
Total logical records read: 3469
Total logical records rejected: 1
Total logical records discarded: 0
Direct path multithreading optimization is disabled
Run began on Thu Apr 26 15:38:29 2007
Run ended on Thu Apr 26 15:38:30 2007
Elapsed time was: 00:00:01.18
CPU time was: 00:00:00.32

Sql loader unable to read from pipe

Hi All:
I'm using named pipe along with Oracle SQL*Loader to load some 20 millions rows into database.
The source of the pipe is from a Java application which write to the pipe using simple FileOutputStream.
It can be observed that the Oracle SQL*Loader need to wait a lot on the Java application to produce enough data for loading.
The waiting is fine. However, the Oracle SQL*Loader always exist after loading about 1 million rows with output like:
SQL*Loader-501: Unable to read file (upipe.dat)
SQL*Loader-560: error reading file
SQL*Loader-2026: the load was aborted because SQL Loader cannot continue.
And in this case, the Java will throw IOException with information:
Exception in thread "main" java.io.IOException: Broken pipe
at java.io.FileOutputStream.writeBytes(Native Method)
at java.io.FileOutputStream.write(FileOutputStream.java:284)
It runs on Linux environment with 11g database.
Any idea why this will happen?

check
SQLLDR NOT LOADING ALL DATA IN DAT FILE : SQL*Loader-510/SQL*Loader-2026 [ID 741100.1]

Issues using Oracle SQL server Developer migration work bench

Hi all,
We are trying to migrate the application databases from SQL server 2000 to Oracle 10g using Oracle SQL Developer 1.2.1.32.13:
Following is the list of issues that we faced while trying out this migration on dev environment.
1. The data migration was successful for only around 90 tables out of the total 166 tables present. No error message was logged for the rest of the tables but still it was completed.
2. Some of the tables which had got the data inserted did not have the full data. Only some of the rows were inserted for these tables. Error message was logged only for few of the rows and not all.
3. Few error messages were logged which said problems about “Inserting ' ' into column <tablename>.<columnname>”. There was no such constraint in the target database that the particular column can not be null or can not have only a space. Please check the logs for the same error messages.
4. The status box at the end of migration had shown only 3 errors.
5. The total data for migration was around 500MB. The time taken for migration was around 75 minutes. Are there any optimization techniques that will improve the performance?
Please note that there were no Foreign Key references for the source schema or target schema.
Any pointers/info/resolutions related to above mentioned issues will be much useful for us.
Thanks,

Hi Adam,
There are 2 sets of scripts created for you.
1) For SQL Servers BCP to dump out the data to dat files
2) For Oracles SQL*Loader to load the dat files
You run the SQL Server BCP scripts on the machine with SQL Server.
The dat files will be dumped out on that server.
You can then move the dat files to your Oracle server.
Then run the Oracle SQL*Loader scripts to load the dat files into Oracle.
Give it a go and follow the doc and viewlets.
Your Questions:
So the datadump from the source location would be saved on my local disk?it will be saved on the same machine you run the bcp scripts from. Usually the same machine SQL Server is on, because you require SQL Server BCP tool.
So once it is migrated to the destination database will that dump be created automatically? Or do I need to modify the script to take care of this?I dont know what you mean by this, hopefully above clears things up.
The only modifications you need to make to the scripts are adding in the databasename username password servername. These are outlined in the scripts themselves. I would want to do something fancy like dump the dat files to a different directory, then you can modify the scripts, but you should understand what they do first.
Most people would have 500MB of space on their discs , so I can see the problem creating these dat files . The same goes for your 30 GB database.
I hope this helps, but as always you wont get a good idea of how it works until you give it a go.
Regards,
Dermot.

SQL*Loader-500 Issue

Hello
Using Oracle 11g, I am trying to load a table from data in csv files with oracle SQL Loader,
table : purchase
control file : purchase.ctl
Even if I am giving the right path for control file I still get the error :
SQL*Loader-500: Unable to open file (purchase.dat)
SQL*Loader-553: file not found
SQL*Loader-509: System error: The system cannot find the file specifiedSo why is SQL Loader looking for the file purchase.dat??
Any help is appreciated

Talend is the right solution to load data. Now about your problem, have you configured Talend in order to transfer the data? Because Talend can easily transfer the files.
Maybe you might be able to go to the Talend website to get more information there: http://www.talend.com/

SQL Loader and ^M character

Hi Experts
Please I need help with this problem:
I am migrating data from a Solid Database to Oracle, I am using Flat Files to do that.
1.- I download the data to flat files from Solid
2.- I move the files to Oracle server
3.- I upload the data to Oracle
Now, I have done the 90% of the data base, but I have found some tables that has description columns and in this description the users writes enters, so when I try to upload the data to Oracle SQL loader cannot recognize this characters.
Example:
'25','0.','5.','0.','0.','0.','0.','0.','0.','0.','0.','0.','0.','',''
'26','0.','2.','0.','0.','0.','0.','3.','0.','0.','0.','0.','0.','',''
'27','0.','1.','0.','0.','0.','0.','0.','0.','0.','0.','0.','0.','',''
'28','0.','1.','0.','0.','0.','0.','0.','0.','0.','0.','0.','0.','',''
'29','0.','38.','0.','0.','0.','0.','0.','0.','0.','0.','0.','0.','',''
'30','0.','13.','0.','0.','0.','0.','0.','6.','0.','6.','0.','0.','|SE RECHAZA B20CS50SNW ^M
^M
SE RECHAZAN CINCO PZAS ^M
DOS MOD. HSC15I41EH,DOS MOD. HSK15I41EH |Agregó: 06/06/2009 12:22:50
|','DEV. A PROV.'
'31','0.','50.','0.','0.','0.','0.','0.','0.','0.','0.','0.','0.','',''
'32','0.','9.','0.','0.','0.','0.','0.','0.','0.','0.','0.','0.','',''
'33','0.','2.','0.','0.','0.','0.','0.','0.','0.','0.','0.','0.','',''
How can I solve this ?
Kind regards
J.A

2.- I move the files to Oracle server Open and see the file at this level, you may find the junk characters appended at every line. This occurs due to file transfer. (if so which mode you used while transfering the file?)
Workaround:
Try moving files through Binary mode
Rgd
KSG

SQL Loader Error ORA-03113

Hi All,
I am getting the following error when running sql loader. The SQL Loader Version we are using is Release 9.2.0.5.0. I am using the DIRECT option for SQL Loader as well. Thanks in advance.
SQL*Loader-961: Error calling once/load finishing for table "TABLE_EX"
ORA-03113: end-of-file on communication channel
SQL*Loader-2026: the load was aborted because SQL Loader cannot continue.
SQL*Loader-925: Error while uldlgs: OCIStmtExecute (ptc_hp)
ORA-03114: not connected to ORACLE
SQL*Loader-925: Error while uldlgs: OCIStmtFetch (ptc_hp)
ORA-24338: statement handle not executed

You hit Bug 3531336
Run the script catcio.sql from $ORACLE_HOME/rdbms/admin directory.
Run this in sys schema.
And then load the data with sqlloader.

ORACLE SQL-Loader

Similar Messages

Maybe you are looking for