SQL Loader Help required

HI Team,
I have requirement to load data in to table using sqlloader, as i am having three level's(Header, Detail, Trailer')
first two position of data file represents the level like
00-Header
01 to 98 -Detail
99 -Trailer
each level will have different data structure and we should insert in to the same table
i Have created table like
CREATE TABLE APPS.XXD_TEST1
AA NUMBER,
TEST12 VARCHAR2(10 BYTE),
testdt VARCHAR2(10 BYTE),
testtr VARCHAR2(10 BYTE),
RECORD_ID NUMBER
and created sequence for record_id column
--CREATE SEQUENCE APPS.XXD_TEST1_S
i have data in the data file like below, i want to load the data in the same order
000012
010012
010012
020012
030012
990012
000013
010013
020013
030013
990013
i was using the folowwing control file
LOAD DATA
INFILE Test
APPEND
INTO TABLE xxd_test1
WHEN (1:2) = '00'
TRAILING NULLCOLS
test12 POSITION(3:6) CHAR,
aa POSITION(1:2) INTEGER EXTERNAL "lpad(:aa,2,'0')",
record_id "xxd_test1_s.nextval"
INTO TABLE xxd_test1
WHEN (1:2) != '99' and (1:2) !='00'
TRAILING NULLCOLS
testdt POSITION(3:6) CHAR,
aa POSITION(1:2) INTEGER EXTERNAL "lpad(:aa,2,'0')",
record_id "xxd_test1_s.nextval"
INTO TABLE xxd_test1
WHEN (1:2) ='99'
TRAILING NULLCOLS
testtr POSITION(3:6) CHAR,
aa POSITION(1:2) INTEGER EXTERNAL ,
record_id "xxd_test1_s.nextval"
But it was inserted in the following order
000012
000013
010012
010012
020012
020013
030012
030013
990012
990013
Please help me with the solution.
Thanks
Sriram.

Hi Karthick,
we can do the order by caluse if we are having any column common to all the three levels
here, for me record_type(first two positions) is the only common. but they may be duplicated in the file.
Sample Data file
000012
01
01
02
03
99
000013
01
02
03
99
(first two positions represent the heirarchy like 00-header,(01-10)-Detail, 99-Trailer)
this is sample file,it(detail,trailer) contains some extra fields also...but nothing is common to the header, detail and trailer.Can we generate any value which is common to the three levels? with respective to the header value!
Looking for you solution..
Regards,
Sriram.

Similar Messages

SQL Loader Help in 10g

Hello,
Is it possible to forcefully abort the sql loader when a value is not present? I've the data file like this
1|XXX123|XXX|20121121||
4|XXX123|XXX|||
5|XXX123|XXX||1|
5|XXX123|XXX||2|
5|XXX123|XXX|||
9|XXX123|XXX|||
Template:
record type|batch number|batch desc|date|detail line num|others
1,4,5,9 are the record types, if you see this line 5|XXX123|XXX||1| .. 1 represents a detail line number, My requirement is if the detail line number is null for record type 5 then I want to abort the sqlloader.
Is it possible?
Edited by: 940838 on Nov 21, 2012 11:54 PM

940838 wrote:
I think i am not clear in my requirement...
The question was how to abort the loader if the detail line number is not present in record type 5. It is however normal that detail line num is not mandatory for other record types. any insights.Hi,
you have been clear and I have made a quick test. Unfortunately you cannot do such check in SQL*Loader as the WHEN clause in control file does not allow any OR.
Even if you add this check using a constraint in your table and specify the maximum number of errors to be 0, SQL*Loader will load the records up to that error.
Let me show you an example:
1) create the table with a constraint that for record_type 5 detail_line_number cannot be null.
CREATE TABLE test
   record_type    INTEGER
, batch_number   VARCHAR2 (10)
, batch_desc     VARCHAR2 (10)
, batch_date     DATE
, detail_line_num INTEGER
, other          VARCHAR2 (10)
ALTER TABLE test
ADD CONSTRAINT check_rec_5
     CHECK (   record_type = 5 AND detail_line_num IS NOT NULL
            OR record_type != 5) ENABLE;
            In this table you will not be able to load rows having record_type=5 and detail_line_num NULL as this will be considered as an error.
Let's prepare your input file:
1|XXX123|XXX|20121121||
4|XXX123|XXX|||
5|XXX123|XXX||1|
5|XXX123|XXX|||
5|XXX123|XXX|||
9|XXX123|XXX|||
1|XXX123|XXX|20121121||
4|XXX123|XXX|||
5|XXX123|XXX||1|
5|XXX123|XXX||2|
5|XXX123|XXX|||
9|XXX123|XXX|||1|XXX123|XXX|20121121||
4|XXX123|XXX|||
5|XXX123|XXX||1|
5|XXX123|XXX||2|
5|XXX123|XXX|||
9|XXX123|XXX|||1|XXX123|XXX|20121121||
4|XXX123|XXX|||
5|XXX123|XXX||1|
5|XXX123|XXX||2|As you can see the input file has the fourth line with record_type = 5 and detail_line_num NULL. This will be an error for the constraint.
Here the control file I have used:
--test.ctl
load data
INFILE 'test.dat'
APPEND
INTO TABLE test
FIELDS TERMINATED BY '|'
TRAILING NULLCOLS
record_type     ,
batch_number    ,
batch_desc      ,
batch_date      Date 'YYYYMMDD',
detail_line_num ,
other
)If I try to execute the SQL*Loader and ask to stop at first error in this way:
sqlldr userid=yourname/yourpass@yourdb control=test.ctl errors=0 rows=100SQL*Loader will load only 3 records because it encounters an error at line 4 and having specified errors=0 will not continue to load. Actually the process will continue until it reach the commit point (100 rows in this case) but it will not load any record after the error nor continue to read the file.
So if I check the table
SELECT * FROM test;
RECORD_TYPE BATCH_NUMBER BATCH_DESC BATCH_DATE            DETAIL_LINE_NUM OTHER
          1 XXX123       XXX        21-11-2012 00:00:00
          4 XXX123       XXX
          5 XXX123       XXX                                            1           You will see only records until you have reached the error.
This cannot be avoided as documented in SQL*Loader reference manual:
<h3>Load Discontinued Because Maximum Number of Errors Exceeded</h3>
If the maximum number of errors is exceeded, SQL*Loader stops loading records into any table and the work done to that point is committed. As you can see SQL*Loader abort the processing but it will anyway commit the records until that error.
One alternative solution is to create an external table in Oracle and do all the checks you want before copying your external table into a database table, as BluShadow suggested.
Regards.
Al

SQL * Loader help

Dear All,
I have installed a oracle database 9.2.at my home. And I want to use a sql loader.
How should i invoke and use the sql loader.
Please help in this regards.
Thanks,
Sid.

This doc contains usefull info and examples:
http://www.orafaq.com/wiki/SQL*Loader_FAQ

Sql loader help needed urgent

Hi,
I normally get a csv having data as
column1 ;columnb;columnc;
13 ; 12 ; 13 ;
11 ;13 ;33;
as the table where it needs to go is say table
xys( a number, b number , c number).
so the control file is fairly simple ...
But from now I need to restrict data entry if the change in format happens in the csv
say if it is like
column2;column1;column3,
12,13;12;
11;13;14;
or say the csv like
column1;column2;column3;column4;
11;13;14;15;
111;134;14;12;
in both cases sql loader should not run and throw the error saying the reason in the log.
how do i manage it in the control file `???
any ideas???
regards
Message was edited by:
SHUBH

Hello,
do you only need to check the first line of the file if it contains a line like
column1;column2;column3 ?
If yes, maybe a small script like this could be a starting point:
You have to replace "column1;column2;column3" with the header information that's valid and instead of file1 in the CURRENTSTRING=... Line write the name of your input file.
I hope this helps. (But maybe some of the experts here knows a way to do the verification checks with SQLLDR, so maybe its worth to wait a little bit :)
#!/bin/ksh
VALIDSTRING="column1;column2;column3"
CURRENTSTRING=`head -n 1 file1`
if [[ $VALIDSTRING == $CURRENTSTRING ]]
then
echo "They match."
else
echo "They dont match."
fi
--

SQL Loader help requested

Have a sqlloader job that is loading date columns into a table. Then the source of the data sends the wrong data '11000000' in the YYYYMMDD format and the load fails. Does anyone know how to make Oracle assume the null value in all cases when there is an invalid date (like 20060230, 20061131 in YYYYMMDD format)?
We have used the nullif statement but it only works for known issues that are specified and we want it to work for all dates that are invalid.
Thanks in advance.

How about creating your own function and using that instead?
http://groups.google.co.uk/group/comp.databases.oracle.misc/browse_thread/thread/a72362f8c32bdf21/ff350590a1fa7948?lnk=st&q=function+SQL*Loader&rnum=2&hl=en#ff350590a1fa7948

Importing 30 tables into one SQL Table (Help Required)

Dear Experts,
I am new in SQL server, actually i need to gather 30 different excel file in one sql server table and i have imported all excel file in different databases, all tables have 186 different columns and datatypes. I couldnt change data type while conversion.
Now all columns have different data type which are occupying extra space in my database.
Now the problem is that i need to convert all databases into one database or table. Although i have created a table but i dont have idea how to import all table into one table and defining datatype in new table while importing the old tables.
Please help me in this matter or if any body has skype or any other chatting id please do let me know so that i may explain it better.
Thanking you in advance.
Best Regards,
SQL_beginner

There are several things you can try. If you have SSIS, take a look at this.
http://www.singhvikash.in/2013/06/ssis-how-to-load-multiple-excel-files.html
https://www.simple-talk.com/sql/ssis/importing-excel-data-into-sql-server-via-ssis-questions-you-were-too-shy-to-ask/
Also, if your files have virtually the same name, like files with dates in the name, you can loop through files in your folder, and increment the loop with each run through.
DECLARE @intFlag
INT
SET @intFlag
= 1
WHILE (@intFlag
<=30)
BEGIN
PRINT @intFlag
declare @fullpath1
varchar(1000)
select @fullpath1
= '''\\path to your files\'
+ convert(varchar,
getdate()- @intFlag
, 112)
+ '_your-text-file-name.txt'''
declare @cmd1
nvarchar(1000)
select @cmd1
= 'bulk insert [dbo].[your-table-name] from '
+ @fullpath1 +
' with (FIELDTERMINATOR = ''\t'', FIRSTROW = 2, ROWTERMINATOR=''0x0a'')'
exec (@cmd1)
SET @intFlag
= @intFlag + 1
END
GO
Knowledge is the only thing that I can give you, and still retain, and we are both better off for it.

Pl/sql code help required

i have 3 string like below
string1 varchar2(3000) := ' fonction code=''33'' and the limit for the subfunction is 300. it may have function_code=''100'' ) ) ) )';
string2 varchar2(2000):='function_code=''100''';
string3 varchar2(3000);requirement is
if i found string2 in string1 preceded by four brackets ,example function_code=''100'' ) ) ) )' then
i have replace to replace the 4th bracket with
function code is null )the string1 now will be
' fonction code=''33'' and the limit for the subfunction is 300. it may have function_code=''100'' ) ) ) function code is null )Pls help
NOte: bracket may or may not have spaces between them
S

SQL> declare
2 string1 varchar2(3000) := 'AND NOT ( ( ( FUNCTION_CODE = ''88'' ) OR ( FUNCTION_CODE = ''21'' ) OR ( FUNCTION_CODE = ''51'' ) OR ( FUNCTION_CODE = ''85'' ) ) ) )' ;
3 string2 varchar2(2000):='FUNCTION_CODE = ''85''';
4 string3 varchar2(3000);
5 begin
6 string3 :=regexp_replace(string1,'^(.*)('||string2||')(([[:blank:]]?\)[[:blank:]]?){3})([[:blank:]]?\))(.*)$','\1\2\3function code is null\4\5');
7 dbms_output.put_line(string3);
8 end;
9 /
AND NOT ( ( ( FUNCTION_CODE = '88' ) OR ( FUNCTION_CODE = '21' ) OR ( FUNCTION_CODE = '51' ) OR (
FUNCTION_CODE = '85' ) ) ) function code is null ) )
PL/SQL procedure successfully completed.Best regards
Maxim

Sql*loader help needed!!

I am loading data using the SQLLDR utility of Oracle. I defined one column as seq. I am loading the data, it is working properly but next column is not loaded correctly.
Problem :
First Character in the second column was missing. Please help me how to correct the ctl file.
Table:
CREATE TABLE SEQ_TAB1 (
A_ID NUMBER (10) NOT NULL,
A_NAME VARCHAR2 (25) NOT NULL,
A_TYPE VARCHAR2(25)
Seqence : t_seq1 (a_id)
Data file:
Alabama,first
Alaska,ice
California,hot
Texas,time
CTL file :
LOAD DATA
APPEND INTO TABLE seq_tab1
a_id "t_seq1.nextval" ,
a_name char terminated by "," ,
a_type char terminated by ","
Command :
sqlldr username/password@service_name control=ctl_file log=log_file data=data_file
The following way data has been loaded into the table.
1,labama,first
2,laska,ice
3,alifornia,hot
4,exas,time

Try with position specified for the a_name column....
CTL file :
LOAD DATA
APPEND INTO TABLE seq_tab1
a_id "t_seq1.nextval" ,
a_name position(1) char terminated by "," ,
a_type position(*) char terminated by ","
I am loading data using the SQLLDR utility of Oracle. I defined one column as seq. I am loading the data, it is working properly but next column is not loaded correctly.
Problem :
First Character in the second column was missing. Please help me how to correct the ctl file.
Table:
CREATE TABLE SEQ_TAB1 (
A_ID NUMBER (10) NOT NULL,
A_NAME VARCHAR2 (25) NOT NULL,
A_TYPE VARCHAR2(25)
Seqence : t_seq1 (a_id)
Data file:
Alabama,first
Alaska,ice
California,hot
Texas,time
CTL file :
LOAD DATA
APPEND INTO TABLE seq_tab1
a_id "t_seq1.nextval" ,
a_name char terminated by "," ,
a_type char terminated by ","
Command :
sqlldr username/password@service_name control=ctl_file log=log_file data=data_file
The following way data has been loaded into the table.
1,labama,first
2,laska,ice
3,alifornia,hot
4,exas,time

Convert decode oracle pl/sq to ms sql and help required on logic

I have below oracle query need to converted to ms sql. I also want to add a record into journal table when a
insert portion is executed "caseidinserted" and update portion executed then "caseidupdate".
Update table1 target
set curr =
decode(
    select efforts from (
   select source.efforts efforts
   from
       SELECT    a.aid,a.efforts,ab.lcs
           FROM    CIP a, DC ab
           WHERE   a id = ab.id
           AND   a.id = @id
   ) source
   where target.caseid = @caseidupd
   and target.aid = source.aid
    ) tmp, 0, tmp.efforts, curr
modi = getdate( )
where exists
select 1
from table1 tgt
where tgt.aid = target.aid
and tgt.caseid = @caseidupd
insert into table1 values(caseid, aid, modi)
   select @caseidupd, source.aid, getdate()
   from
       SELECT    a.aid,a.efforts,ab.lcs
           FROM    CIP a, DC ab
           WHERE   a id = ab.id
           AND   a.id = @id
   ) source
   where not exists
       select 1
       from table1 target
       where target.aid = source.aid
       and target.caseid = @caseidupd
something like this...
INSERT (caseid,aid,modi)
select @caseidupd,'appupdated'+source.aid,getdate()
INSERT (caseid,aid,modi)
select (@caseidupd,'appinserted'+source.aid,getdate()

Hello,
I am not familiar with Oracle Function. If I understand correctly, you can MERGE to perform INSERT and UPDATE operations on a table in a single statement. Please refer to the following statements:
MERGE INTO table1 AS Target
USING (select @caseidupd, source.aid, getdate()
from
SELECT a.aid,a.efforts,ab.lcs
FROM CIP a, DC ab
WHERE a id = ab.id
AND a.id = @id
) As Source (caseidupd,aid,date )
ON Target.aid = source.aid and target.caseid =source.caseidupd
WHEN MATCHED THEN
UPDATE SET Target.curr=...,--query for get values
Target.modi=getdate()
WHEN NOT MATCHED BY TARGET THEN
INSERT (caseid,aid,modi) values (caseidupd,'appupdated'+source.aid,getdate())
Reference:http://msdn.microsoft.com/en-us/library/bb510625.aspx
Regards,
Fanny Liu
Fanny Liu
TechNet Community Support

Dynamic PL/SQL - Urgent help required

Hi there
I am trying to write a packaged function which takes the table name and column name as arguments and build a pl/sql table which the function returns.
Please do find the code below:
Create or Replace Package Pk_valid_values
is
TYPE list_rec is record ( lc_list_desc varchar2(50));
TYPE list_tab is TABLE of list_rec
index by binary_integer;
FUNCTION Fn_fetch_values
( p_table_name varchar2,
p_column_name varchar2 )
return list_tab;
End Pk_valid_values;
Create or Replace Package Body Pk_valid_values
as
FUNCTION Fn_fetch_values
( p_table_name varchar2,
p_column_name varchar2 )
return list_tab
is
l_values Pk_valid_values.list_tab;
i binary_integer := 0;
lc_element varchar2(50);
ln_dummy number;
v_cursor integer;
lc_string varchar2(2000);
ln_count number;
BEGIN
ln_count := Pk_count_record.Count_record(p_table_name);
v_cursor := dbms_sql.open_cursor;
lc_string := 'begin select p_column_name into :felement from '||
p_table_name||' ; end;';
dbms_sql.parse( v_cursor,
lc_string,
dbms_sql.native );
dbms_sql.bind_variable( v_cursor,
':felement',
lc_element );
ln_dummy := dbms_sql.execute( v_cursor );
for i in 1..ln_count loop
dbms_sql.variable_value( v_cursor,
':felement',
lc_element );
l_values(i) := lc_element;
end loop;
dbms_sql.close_cursor( v_cursor );
return( l_values );
END Fn_fetch_values;
End Pk_valid_values;
I get an error "PLS-00382: expression is of wrong type" when I try to create this package.
Could anyone please let me know where I have gone wrong?
I have really burst my heads against this.
Thanks in advance
Rajeev

Hi,
I think it is that you declare a PL/SQL block, not a cursor.
Try to replace :
lc_string := 'begin select p_column_name into :felement from '||
p_table_name||' ; end;';
with :
lc_string := 'select ' || p_column_name || ' from ' || p_table_name;
Or an easier way :
declare
TYPE RefCurTyp IS REF CURSOR;
cr RefCurTyp;
lc_element varchar2(50);
begin
OPEN cr FOR 'select ' || p_column_name || ' from ' || p_table_name;
LOOP
FETCH cr INTO lc_element;
EXIT WHEN cr%NOTFOUND;
END LOOP;
CLOSE cr;
end;
/Uffe

SQL Join help required!

Hi all
I need help with a join.
If you click the image link below, I need to find a way to join table 1 and table 2 to get table3:
http://img229.imageshack.us/img229/1401/83192078uq8.jpg
Help would be very much appreciated!
Thanks in advance.

with Table1 as(select 1234 as ProjectID,'Smith' as LastName from dual
union select 1234,'Maria' from dual
union select 1234,'Victo' from dual),
Table2 as (select 1234 as ProjectID,200 as Val from dual
union select 1234,300 from dual
union select 1234,400 from dual)
select nvl(a.ProjectID,b.ProjectID) as ProjectID,a.LastName,b.Val
from Table1 a full join Table2 b
    on 1=0;
PROJECTID LASTN VAL
     1234 Maria null
     1234 Smith null
     1234 Victo null
     1234 null    200
     1234 null    300
     1234 null    400

SQL*LOADER/SQL usage in Migration

I have very limited migration requirements. I DO NOT need to
migrate a database. I DO need to change some SQL and BCP load
scripts from SQL-SERVER 6.5 to their equivalents in ORACLE 8.0.5.
For this limited purpose, should I proceed to handcode these, or
would the workbench be of use to me?
Thanks for your help.
null

The migration workbench does, as part of the migration,
generate the BCP and SQL*Loader files required to migrate a
database. However, since you already have the BCP files created
then the Workbench would not actually be able to just generate
the other side of the picture (the SQL*Loader files). I can
suggest the following to you :
1. Perhaps use the Workbench to run a tiny migration that would
show you how we generate the SQL*Loader scripts. It is fairly
straight forward however we need to do some manipulation on
dates.
2. There is a chapter on SQL*Loader as part of the Oracle8i
documentation set.
Chapter 3 "SQL*Loader Concepts"
Oracle8i Utilities, Release 8.1.5
A67792-01
Regards,
Marie
Raja Marla (guest) wrote:
: I have very limited migration requirements. I DO NOT need to
: migrate a database. I DO need to change some SQL and BCP
load
: scripts from SQL-SERVER 6.5 to their equivalents in ORACLE
8.0.5.
: For this limited purpose, should I proceed to handcode these,
or
: would the workbench be of use to me?
: Thanks for your help.
Oracle Technology Network
http://technet.oracle.com
null

Primary key population through sequence using SQL loader

Hi Experts,
Is it possible to populate primary key column using a sequence while trying to load the data through SQL loader?
Requirement is like that..
Flat file contains 4 fields and I need to populate 5th Column which will be primary key and will be from one sequence available in database.
Regards,
SKP

http://download.oracle.com/docs/cd/B19306_01/server.102/b14215/ldr_field_list.htm#sthref1274
Alternatively, you could load data, then populate the required column with unique values using sequence and then add primary key constraint.

Help required in SQL Loader

Is it possible to load a single target file from multiple flat file sequentially using SQL Loader?
Example -
Table structure -
<Emp_id><Emp_Name><Dept_id><Total_sales><Commission>
<Emp_id><Emp_Name><Dept_id> column will be load from Emp_master flat file
<Total_sales> column will be load from sales flat file - there will be two fields emp_id and total_sales
<Commission> column will be load from commission flat file - there will be two fields emp_id and commission.
I have tried this to merge these three flat file and create a single flat file, but in my real requirement i found it is quite tedious.
Is there any other approach?
Thanks in Advance

You can load into 3 temporary tables and insert into main table using a query
OR
You can use shell script (I hope UNIX environment) to merge the files
There is no direct way to load the data for same row from multiple files using SQL * Loader

Help required to build SQL loader control file

I have a table, That we need to load using SQL loader.
table structure is --
<emp_id>,<first_name>,<middle_name>,<last_name>,<sal>
The structure of flat file is like below,
<emp_id>|<emp_name>|<sal>
<emp_name> field can contain space to define first name, middle name and last name,
if no space is there means we only need to load first name. and one space means First and last name should load.
Sample flat file--
1001|Ram|10000
1002|Syam Kumar Sharma|20000
1003|Jadu Prashad|15000
Please help me out to build the control file.
Thanks in Advance

Means, can use DBMS_SCHEDULER for loading data ?Yes, you can create procedures for that and let the scheduler execute them on the desired interval
(you can even execute OS commands through DBMS_SCHEDULER).
Read about it here:
http://www.oracle.com/pls/db102/search?word=DBMS_SCHEDULER&partno=
http://www.oracle-base.com/articles/10g/Scheduler10g.php
By the way, instead of using sqlloader why not switch to using external tables?
http://asktom.oracle.com/pls/asktom/f?p=100:11:0::::P11_QUESTION_ID:6611962171229
http://www.oracle-base.com/articles/9i/SQLNewFeatures9i.php#ExternalTables
A few other approaches (pre 10g)
http://asktom.oracle.com/pls/asktom/f?p=100:11:0::::P11_QUESTION_ID:2048340300346698595
http://asktom.oracle.com/pls/asktom/f?p=100:11:0::::P11_QUESTION_ID:3084681089099

SQL Loader Help required

Similar Messages

Maybe you are looking for