SQL Loader help requested

Have a sqlloader job that is loading date columns into a table. Then the source of the data sends the wrong data '11000000' in the YYYYMMDD format and the load fails. Does anyone know how to make Oracle assume the null value in all cases when there is an invalid date (like 20060230, 20061131 in YYYYMMDD format)?
We have used the nullif statement but it only works for known issues that are specified and we want it to work for all dates that are invalid.
Thanks in advance.

How about creating your own function and using that instead?
http://groups.google.co.uk/group/comp.databases.oracle.misc/browse_thread/thread/a72362f8c32bdf21/ff350590a1fa7948?lnk=st&q=function+SQL*Loader&rnum=2&hl=en#ff350590a1fa7948

Similar Messages

SQL * Loader help

Dear All,
I have installed a oracle database 9.2.at my home. And I want to use a sql loader.
How should i invoke and use the sql loader.
Please help in this regards.
Thanks,
Sid.

This doc contains usefull info and examples:
http://www.orafaq.com/wiki/SQL*Loader_FAQ

Sql Loader - Concurrent request id issue!

Hello there:
I want to load request id in my sql loader script please advice how can I do.
Below is my scipt file.
LOAD DATA
INFILE '${CINT_TOP}/uploads/f_cost/inprocess.dat'
BADFILE '/tmp/inprocess.CFL.bad'
INTO TABLE cost_temp REPLACE
FIELDS TERMINATED BY ',' OPTIONALLY ENCLOSED BY "'"
(ITEM_COST DECIMAL EXTERNAL,
CURRENCY CHAR,
EFFECTIVITY_DATE DATE 'DD-MON-YYYY',
ITEM_NUMBER CHAR,
ORGANIZATION_ID CHAR,
COST_TYPE_ID CHAR,
SEQUENCE_ID CHAR
Data file:
51.24,USD,'30-JUL-2007',6346339,304,1001,fnd_global.conc_request_id
100.5,USD,'30-JUL-2007',299150,304,1001,fnd_global.conc_request_id
Thanks,
Zeeshan

I did get same error in my log file.
LOAD DATA
INFILE '${CINT_TOP}/uploads/f_cost/inprocess.dat'
BADFILE '/tmp/inprocess.CFL.bad'
INTO TABLE cost_temp REPLACE
FIELDS TERMINATED BY ',' OPTIONALLY ENCLOSED BY "'"
(ITEM_COST          DECIMAL EXTERNAL,
CURRENCY          CHAR,
EFFECTIVITY_DATE DATE 'DD-MON-YYYY',
ITEM_NUMBER     CHAR,
ORGANIZATION_ID CHAR,
COST_TYPE_ID CHAR,
SEQUENCE_ID     CHAR "fnd_global.conc_request_id"
Column SEQUENCE_ID had SQL string
"fnd_global.conc_request_id"
applied to it.
Record 1: Rejected - Error on table "CINT"."COST_TEMP", column SEQUENCE_ID.
Column not found before end of logical record (use TRAILING NULLCOLS)
Record 2: Rejected - Error on table "CINT"."COST_TEMP", column SEQUENCE_ID.
Column not found before end of logical record (use TRAILING NULLCOLS)
Table "CINT"."COST_TEMP":
0 Rows successfully loaded.
2 Rows not loaded due to data errors.
0 Rows not loaded because all WHEN clauses were failed.
0 Rows not loaded because all fields were null.
I need you advice please.
Regards,
Zeeshan

Sql loader help needed urgent

Hi,
I normally get a csv having data as
column1 ;columnb;columnc;
13 ; 12 ; 13 ;
11 ;13 ;33;
as the table where it needs to go is say table
xys( a number, b number , c number).
so the control file is fairly simple ...
But from now I need to restrict data entry if the change in format happens in the csv
say if it is like
column2;column1;column3,
12,13;12;
11;13;14;
or say the csv like
column1;column2;column3;column4;
11;13;14;15;
111;134;14;12;
in both cases sql loader should not run and throw the error saying the reason in the log.
how do i manage it in the control file `???
any ideas???
regards
Message was edited by:
SHUBH

Hello,
do you only need to check the first line of the file if it contains a line like
column1;column2;column3 ?
If yes, maybe a small script like this could be a starting point:
You have to replace "column1;column2;column3" with the header information that's valid and instead of file1 in the CURRENTSTRING=... Line write the name of your input file.
I hope this helps. (But maybe some of the experts here knows a way to do the verification checks with SQLLDR, so maybe its worth to wait a little bit :)
#!/bin/ksh
VALIDSTRING="column1;column2;column3"
CURRENTSTRING=`head -n 1 file1`
if [[ $VALIDSTRING == $CURRENTSTRING ]]
then
echo "They match."
else
echo "They dont match."
fi
--

SQL Loader Help in 10g

Hello,
Is it possible to forcefully abort the sql loader when a value is not present? I've the data file like this
1|XXX123|XXX|20121121||
4|XXX123|XXX|||
5|XXX123|XXX||1|
5|XXX123|XXX||2|
5|XXX123|XXX|||
9|XXX123|XXX|||
Template:
record type|batch number|batch desc|date|detail line num|others
1,4,5,9 are the record types, if you see this line 5|XXX123|XXX||1| .. 1 represents a detail line number, My requirement is if the detail line number is null for record type 5 then I want to abort the sqlloader.
Is it possible?
Edited by: 940838 on Nov 21, 2012 11:54 PM

940838 wrote:
I think i am not clear in my requirement...
The question was how to abort the loader if the detail line number is not present in record type 5. It is however normal that detail line num is not mandatory for other record types. any insights.Hi,
you have been clear and I have made a quick test. Unfortunately you cannot do such check in SQL*Loader as the WHEN clause in control file does not allow any OR.
Even if you add this check using a constraint in your table and specify the maximum number of errors to be 0, SQL*Loader will load the records up to that error.
Let me show you an example:
1) create the table with a constraint that for record_type 5 detail_line_number cannot be null.
CREATE TABLE test
   record_type    INTEGER
, batch_number   VARCHAR2 (10)
, batch_desc     VARCHAR2 (10)
, batch_date     DATE
, detail_line_num INTEGER
, other          VARCHAR2 (10)
ALTER TABLE test
ADD CONSTRAINT check_rec_5
     CHECK (   record_type = 5 AND detail_line_num IS NOT NULL
            OR record_type != 5) ENABLE;
            In this table you will not be able to load rows having record_type=5 and detail_line_num NULL as this will be considered as an error.
Let's prepare your input file:
1|XXX123|XXX|20121121||
4|XXX123|XXX|||
5|XXX123|XXX||1|
5|XXX123|XXX|||
5|XXX123|XXX|||
9|XXX123|XXX|||
1|XXX123|XXX|20121121||
4|XXX123|XXX|||
5|XXX123|XXX||1|
5|XXX123|XXX||2|
5|XXX123|XXX|||
9|XXX123|XXX|||1|XXX123|XXX|20121121||
4|XXX123|XXX|||
5|XXX123|XXX||1|
5|XXX123|XXX||2|
5|XXX123|XXX|||
9|XXX123|XXX|||1|XXX123|XXX|20121121||
4|XXX123|XXX|||
5|XXX123|XXX||1|
5|XXX123|XXX||2|As you can see the input file has the fourth line with record_type = 5 and detail_line_num NULL. This will be an error for the constraint.
Here the control file I have used:
--test.ctl
load data
INFILE 'test.dat'
APPEND
INTO TABLE test
FIELDS TERMINATED BY '|'
TRAILING NULLCOLS
record_type     ,
batch_number    ,
batch_desc      ,
batch_date      Date 'YYYYMMDD',
detail_line_num ,
other
)If I try to execute the SQL*Loader and ask to stop at first error in this way:
sqlldr userid=yourname/yourpass@yourdb control=test.ctl errors=0 rows=100SQL*Loader will load only 3 records because it encounters an error at line 4 and having specified errors=0 will not continue to load. Actually the process will continue until it reach the commit point (100 rows in this case) but it will not load any record after the error nor continue to read the file.
So if I check the table
SELECT * FROM test;
RECORD_TYPE BATCH_NUMBER BATCH_DESC BATCH_DATE            DETAIL_LINE_NUM OTHER
          1 XXX123       XXX        21-11-2012 00:00:00
          4 XXX123       XXX
          5 XXX123       XXX                                            1           You will see only records until you have reached the error.
This cannot be avoided as documented in SQL*Loader reference manual:
<h3>Load Discontinued Because Maximum Number of Errors Exceeded</h3>
If the maximum number of errors is exceeded, SQL*Loader stops loading records into any table and the work done to that point is committed. As you can see SQL*Loader abort the processing but it will anyway commit the records until that error.
One alternative solution is to create an external table in Oracle and do all the checks you want before copying your external table into a database table, as BluShadow suggested.
Regards.
Al

Sql*loader help needed!!

I am loading data using the SQLLDR utility of Oracle. I defined one column as seq. I am loading the data, it is working properly but next column is not loaded correctly.
Problem :
First Character in the second column was missing. Please help me how to correct the ctl file.
Table:
CREATE TABLE SEQ_TAB1 (
A_ID NUMBER (10) NOT NULL,
A_NAME VARCHAR2 (25) NOT NULL,
A_TYPE VARCHAR2(25)
Seqence : t_seq1 (a_id)
Data file:
Alabama,first
Alaska,ice
California,hot
Texas,time
CTL file :
LOAD DATA
APPEND INTO TABLE seq_tab1
a_id "t_seq1.nextval" ,
a_name char terminated by "," ,
a_type char terminated by ","
Command :
sqlldr username/password@service_name control=ctl_file log=log_file data=data_file
The following way data has been loaded into the table.
1,labama,first
2,laska,ice
3,alifornia,hot
4,exas,time

Try with position specified for the a_name column....
CTL file :
LOAD DATA
APPEND INTO TABLE seq_tab1
a_id "t_seq1.nextval" ,
a_name position(1) char terminated by "," ,
a_type position(*) char terminated by ","
I am loading data using the SQLLDR utility of Oracle. I defined one column as seq. I am loading the data, it is working properly but next column is not loaded correctly.
Problem :
First Character in the second column was missing. Please help me how to correct the ctl file.
Table:
CREATE TABLE SEQ_TAB1 (
A_ID NUMBER (10) NOT NULL,
A_NAME VARCHAR2 (25) NOT NULL,
A_TYPE VARCHAR2(25)
Seqence : t_seq1 (a_id)
Data file:
Alabama,first
Alaska,ice
California,hot
Texas,time
CTL file :
LOAD DATA
APPEND INTO TABLE seq_tab1
a_id "t_seq1.nextval" ,
a_name char terminated by "," ,
a_type char terminated by ","
Command :
sqlldr username/password@service_name control=ctl_file log=log_file data=data_file
The following way data has been loaded into the table.
1,labama,first
2,laska,ice
3,alifornia,hot
4,exas,time

SQL Loader Help required

HI Team,
I have requirement to load data in to table using sqlloader, as i am having three level's(Header, Detail, Trailer')
first two position of data file represents the level like
00-Header
01 to 98 -Detail
99 -Trailer
each level will have different data structure and we should insert in to the same table
i Have created table like
CREATE TABLE APPS.XXD_TEST1
AA NUMBER,
TEST12 VARCHAR2(10 BYTE),
testdt VARCHAR2(10 BYTE),
testtr VARCHAR2(10 BYTE),
RECORD_ID NUMBER
and created sequence for record_id column
--CREATE SEQUENCE APPS.XXD_TEST1_S
i have data in the data file like below, i want to load the data in the same order
000012
010012
010012
020012
030012
990012
000013
010013
020013
030013
990013
i was using the folowwing control file
LOAD DATA
INFILE Test
APPEND
INTO TABLE xxd_test1
WHEN (1:2) = '00'
TRAILING NULLCOLS
test12 POSITION(3:6) CHAR,
aa POSITION(1:2) INTEGER EXTERNAL "lpad(:aa,2,'0')",
record_id "xxd_test1_s.nextval"
INTO TABLE xxd_test1
WHEN (1:2) != '99' and (1:2) !='00'
TRAILING NULLCOLS
testdt POSITION(3:6) CHAR,
aa POSITION(1:2) INTEGER EXTERNAL "lpad(:aa,2,'0')",
record_id "xxd_test1_s.nextval"
INTO TABLE xxd_test1
WHEN (1:2) ='99'
TRAILING NULLCOLS
testtr POSITION(3:6) CHAR,
aa POSITION(1:2) INTEGER EXTERNAL ,
record_id "xxd_test1_s.nextval"
But it was inserted in the following order
000012
000013
010012
010012
020012
020013
030012
030013
990012
990013
Please help me with the solution.
Thanks
Sriram.

Hi Karthick,
we can do the order by caluse if we are having any column common to all the three levels
here, for me record_type(first two positions) is the only common. but they may be duplicated in the file.
Sample Data file
000012
01
01
02
03
99
000013
01
02
03
99
(first two positions represent the heirarchy like 00-header,(01-10)-Detail, 99-Trailer)
this is sample file,it(detail,trailer) contains some extra fields also...but nothing is common to the header, detail and trailer.Can we generate any value which is common to the three levels? with respective to the header value!
Looking for you solution..
Regards,
Sriram.

Help needed in SQL Loader

Hi,
Am using SQL Loader to insert rows in a table.
I have 5 cols in table A. But the data is not present in all cols always.
Have used TRAILING NULLCOLS but with no help.. few rows are inserted and for many others it throws "ORA-01841: (full) year must be between -4713 and +9999, and not be 0" error
(because the value is null in that particular column position)
How do I handle such cases.Please help asap.
FYI -
CONTROL FILE
load data
infile '/home/krkanth/test_spam_20070513.dat'
BADFILE 'sample.bad'
DISCARDFILE 'sample.dsc'
into table spam_rule_stats
fields terminated by "\t"
optionally enclosed by '"'
TRAILING NULLCOLS
(MAIL_DATE date 'yyyymmdd hh24:mi:ss', METRIC_TYPE, HEURISTIC_TYPE, HEURISTIC_VALUE, REJECTION_COUNT,
RULE_START_DATE DATE 'yyyymmdd hh24:mi:ss',
RULE_END_DATE date 'yyyymmdd hh24:mi:ss',SOURCE)
Am getting error Rejected - Error on table SPAM_RULE_STATS, column RULE_END_DATE.
ORA-01841: (full) year must be between -4713 and +9999, and not be 0
SAMPLE DATA
20070513 RULE SENDER [email protected] 534 20070214 22:02:56
SnA_ALERTS
20070513 RULE SENDER [email protected] 6 20070503 21:19:36 200
70518 21:19:36 RULE_EXTENSIONS
20070513 RULE SENDER [email protected] 519 20061105 05:40:44 SnA
_ALERTS
20070513 RULE SENDER [email protected] 332 20070509 02:44:51 20070524 02
:44:51 JASD_HP_AUTOREJECT
20070513 RULE SENDER [email protected] 928 20070512 14:49:14 20070527 14:49:14 JAS
D_HP_AUTOREJECT
20070513 RULE SENDER [email protected] 19875 20070507 22:30:01 20070522 22
:30:01 RULE_EXTENSIONS
20070513 RULE SENDER [email protected] 3 20070509 09:08:38 20070524 09:08:38
JASD_HP_AUTOREJECT
20070513 RULE SENDER [email protected] 10 20070503 21:19:36 200
70518 21:19:36 RULE_EXTENSIONS
20070513 RULE SENDER [email protected] 4 20070506 04:39:48 20070521 04
:39:48 JASD_HP_AUTOREJECT
Thanks.

not sure if this will work but you may want to give it a try:
change from:
(MAIL_DATE date 'yyyymmdd hh24:mi:ss'
to:
(MAIL_DATE date 'yyyymmdd'since the first data on your file does not have the timestamps

Help in sql loader loading a large datafile.

Hi All
Could some one help me in loading the xls file which is about 250MB AND got about 2981807 rows into a database table
i try to open the XLS file it just opened with 65000 records only but i have lot more records in it.
thanks in advance

hi i user the sql loader but the file is too big to handel like the file is not opened in notepad or xls sheet...
is there any other way to split the large file

SQL LOADER ;;; PLEASE HELP ME

Hi EveryBody,
I have useless lines in my file csv which I do not want to load in my Oracle table,
1- some one knows a means to leave the control file of SQL LOADER to load that the data which I want?
2- Another thing I want to insert my lines in the file
csv that under a condition that the sum of the lines
of a column amount in the file csv is different than 0 ?
for example:
date|amount |Currency
2006-05-19 18:35:53|12.74|Euro
2006-05-19 18:35:53|23.24|CAD
Thanks,
Regards,

Executing this script :
CREATE TABLE admin_ext_emmanuel
(NUMS     VARCHAR2(200)     ,
NB_UNIT     NUMBER     ,
REVENUE     NUMBER
ORGANIZATION EXTERNAL
TYPE ORACLE_LOADER
DEFAULT DIRECTORY admin_dat_dir
ACCESS PARAMETERS
records delimited by newline
badfile admin_bad_dir:'emmanuel%a_%p.bad'
logfile admin_log_dir:'emmanuel%a_%p.log'
fields terminated by ';'
missing field values are null
( employee_id, first_name, last_name, job_id, manager_id,
hire_date char date_format date mask "dd-mon-yyyy",
salary, commission_pct, department_id, email
LOCATION ('20060619_emmanuel_01.csv')
PARALLEL
REJECT LIMIT UNLIMITED
I have these errors :
ORA-29913 : error in executing ODCIEXTTABLEOPEN callout
ORA-29400 : data catridge error
KUP-04043 : table column not found in external source : NUMS
ORA-06512 : at "SYS.ORACLE_LOADER" , line 19
can u help please?

SQL Loader : Trim and Decode functions help please

Hi,
I have to load data from a flat file, for some columns i need to use TRIM and DECODE functions.It is a pipe delimited file.
I get syntax errors (one is below) same error listed for TRIM.
SQL*Loader-350: Syntax error at line xx.
Expecting "," or ")", found "DECODE".
===========
,FINAL_BILL_DATE CHAR(30) "TRIM(:FINAL_BILL_DATE)"
,BUSINESS_ID "DECODE(:BUSINESS_ID,'B',1,'C',2,'E',3,'G',4,'O',5,'R',6,'T',7,'U',8,'H',9,-1)"
Can anyone please help.
Thanks
Cherrish

Hello Cherrish.
The error you are receiving leads me to believe that at some point prior to the DECODE on the line for BUSINESS_ID, probably some line even before the FINAL_BILL_DATE line, there a syntactical error causing the quotes before the DECODE to actually terminate some other syntax. Without all of the lines that could actually contribute to this, including the header details, this is the best I can advise.
Hope this helps,
Luke
Please mark the answer as helpful or answered if it is so. If not, provide additional details.
Always try to provide create table and insert table statements to help the forum members help you better.

Need help, Trouble in uploading records using sql loader in Forms 6i

Hi,
I am trying to develop a screen for uploading records to a table by using a ctl file, batch file and sql loader.
Env: Forms 6i, Oracle 8
Table to be updated is: shy_upload_table
My TSN entry looks similar to this,
TEST_AXA.CNB.COM =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = 11.23.11.123)(PORT = 1234))
(CONNECT_DATA =
(SID = axdabc)
My intention is whenever i press the upload_button, I should truncate the table and upload it with the contents of the file.
In the when-button-pressed event of the upload_button I have the following code. always I am able to truncate the table but am not able to upload it with the contents of the file. Can any of you help me fix this problem ?
declare
     var_control varchar2(256);
     VAR_DATA VARCHAR2(256);
     VAR_OUTPUT VARCHAR2(500);
     var_filename varchar2(256);
     str varchar2(50);
     cnt number;
begin
     FORMS_DDL('TRUNCATE TABLE shy_upload_table ');
     select count(*) into cnt from shy_upload_table;
     message('count '||cnt);
     MESSAGE('');
If NOT form_success Then
     MESSAGE('Upload Failed');
     MESSAGE('Upload Failed');
else
     set_item_property('DISPLAY_PB',enabled,property_true);
--when ever i run, i am able to see the display_pb enabled. it means form_success is true.
end if;
     var_filename := :txt_filename;
--I have tried with each of the below option,
--sqlldr userid/[email protected] control=F:\ERP\file_upload.ctl
--sqlldr userid/password@axdabc control=F:\ERP\file_upload.ctl
--sqlldr userid/password@TEST_AXA.CNB.COM control=F:\ERP\file_upload.ctl
     VAR_DATA :='data=' || var_filename ;
     VAR_OUTPUT := var_control|| ' ' ||VAR_DATA;
     host('F:\a.bat');
end;
batch file contents...
# I have tried with each of the below options
sqlldr userid/[email protected] control=F:\ERP\file_upload.ctl data=F:\ERP\sample.txt log=F:\ERP\x.log bad=F:\ERP\x.bad
#sqlldr userid/password@axdabc control=F:\ERP\file_upload.ctl data=F:\ERP\sample.txt log=F:\ERP\x.log bad=F:\ERP\x.bad
#sqlldr userid/password@TEST_AXA.CNB.COM control=F:\ERP\file_upload.ctl data=F:\ERP\sample.txt log=F:\ERP\x.log bad=F:\ERP\x.bad
pause
Thanks
vish

Hi Francois,
Thanks for responding, I am not very sure of what you want me to try out.
When I double click the batch file containing the below, the record gets inserted in the table. Only when using my form and trying to upload, it fails to insert the record.
batch file contents...
#sqlldr userid/password@TEST_AXA.CNB.COM control=F:\ERP\file_upload.ctl data=F:\ERP\sample.txt log=F:\ERP\x.log bad=F:\ERP\x.bad
pause
Thanks
Vish

Help in calling sql loader and an oracle procedure in a script

Hi Guru's
please help me in writing an unix script which will call sql loader and also an oracle procedure..
i wrote an script which is as follows.
!/bin/sh
clear
#export ORACLE_SID='HOBS2'
sqlldr USERID=load/ps94mfo16 CONTROL=test_nica.ctl LOG=test_nica.log
retcode=`echo $?`
case "$retcode" in
0) echo "SQL*Loader execution successful" ;;
1) echo "SQL*Loader execution exited with EX_FAIL, see logfile" ;;
2) echo "SQL*Loader execution exited with EX_WARN, see logfile" ;;
3) echo "SQL*Loader execution encountered a fatal error" ;;
*) echo "unknown return code";;
esac
sqlplus USERID=load/ps94mfo16 << EOF
EXEC DO_TEST_SHELL_SCRIPT
it is loading the data in to an oracle table
but the procedure is not executed..
any valuable suggestion is highly appriciated..
Cheers

multiple duplicate threads:
to call an oracle procedure and sql loader in an unix script
Re: Can some one help he sql loader issue.

Help with SQL LOADER

I have a data file that looks like:
REC001;TO_NAME;TO_ADDR;TO_PHONE
REC002;ITEM_ID1;DATE_DELIVERED1
REC002;ITEM_ID2;DATE_DELIVERED2
REC002;ITEM_ID3;DATE_DELIVERED3
REC002;ITEM_ID4;DATE_DELIVERED4
i want to load this in the Database using SQL LOADER in this format:
NAME | ADDR | PHONE | ITEM | DATE DELIVERED
TO_NAME TO_ADDR TO_PHONE ITEM_ID1 DATE_DELIVERED1
TO_NAME TO_ADDR TO_PHONE ITEM_ID2 DATE_DELIVERED2
TO_NAME TO_ADDR TO_PHONE ITEM_ID3 DATE_DELIVERED3
TO_NAME TO_ADDR TO_PHONE ITEM_ID4 DATE_DELIVERED4
Basically i want the name, addr, phone from REC001 to be repeated every time i load REC002.
Any help on how to do this.

The subject of this forum is AQ.
AQ <> SQL*Loader
Please delete this post and post in Database - General
When you do include full version information and format your post using PRE tags (explained in the FAQ).

Help with sql loader charsets

I was wondering if anyone could assist me with a sql loader question. I am trying to use it to load some hungarian data. It always turns the Ő character into an upside down question mark. I understand that it is because the database doesn't understand what that character is. Can someone help me find out how to resolve that? The database is UTF-8. If I paste the character in to the application, it takes it. I have tried all kinds of values for the CHARSET parameter in the .ctl file, but nothing seems to work....

I believe we are using iso 8859-1.
I am having a difficult time thinking that it could be we don't have the appropriate installations - because if we paste it in via the oracle application we can see it in a form. If we sql load that same character and look at it in an oracle form, we see the question marks.
i've looked at many of the documents on tahiti already, and found some helpful stuff, but no explanation for the problem i am having so far :)

SQL Loader help requested

Similar Messages

Maybe you are looking for