Function for column validation in SQl Loader control file.

Hello Gurus,
We have an requirement to create a function to validate all date and number columns in control file, and return 0/1 accordingly to valid_column which is last column . I have developed the function which accepts the number and date type columns as parameter and return Y/N. My question is, is there any way so that the function could be created without passing any parameter to it?
If yes, then how to call the function in control file?
I have been searching since a while on Google to find out any solution but could find out.
Using Oracle 11g Enterprise Edition Release 11.2.0.1.0
Thanks!
Edited by: Sush on Jul 5, 2012 2:23 AM
Edited by: Sush on Jul 5, 2012 4:16 AM
Edited by: Sush on Jul 5, 2012 7:28 AM

Hi Srini,
I have gone through this document and i couldn’t find out any solution. That’s why i was seeking help from you Gurus.
Thanks for your help, i think i have learnt few new things abt SQL Loader by studying this document :)
Thanks!

Similar Messages

Filtering column values in sql loader control file

Hi all,
i have a file that contains data such as
111 Test ####### #testme juio# ###
as you can see, the data is fix length and separate by spaces
some field will have value such as ### and some column will contain alpha numeric with some # such as juio#
i am trying to write a ctl file that read the data using position. ex position 1-3 will get 111 and 4-8 for example gets Test and so on.
what i am trying to do is when a column value contain all # then i want to set to null. if a value contain alpha-numeric and # then load that value
ex. ####### will translate to null. #testme will be load it as it is since it contain alphanumeric
can someone help me write a ctl file that read the field by position and apply null to value that contain all #. again, if a field contain # and alphanumeric such as juio#, then that value should be loaded as is. it is only when the value contain all # it should be set to null
Th

You do it without it constant
--sample data file
1,2,,
3,4,,
LOAD DATA
INFILE 'D:\d.csv'
INTO TABLE ABC
FIELDS TERMINATED BY ","
( A,
B,
C sysdate,
D "USER"
)Edited by: J99 on Jul 23, 2009 12:14 PM
OR use to avoid extra ',' in datafile.
--sample data file
1,2
3,4
LOAD DATA
INFILE 'D:\d.csv'
INTO TABLE ABC
FIELDS TERMINATED BY "," TRAILING NULLCOLS
( A,
B,
C sysdate,
D "USER"
)

Parameters / Variables in SQL Loader Control File

Here's my problem, I have created SQL Loader control file (ctl) to load a file of employees. This loader program is registered in Oracle Applications. What I want is to pass a parameter derived from the profile like the user name of the one who executed the loader program and pass it to the loader program so that the user name info is included in the loading
example
input data
123456,John,Smith
654321,Jane,Doe
loaded data
123456,John,Smith,03-JUL-2009,USER13
654321,Jane,Doe,03-JUL-2009,USER13
the sysdate is easy because it can be defined in the column but what I really want to achieve is a parameter passed to the ctl file.
Thanks in advance.

Dear user!
Please have a look at this thread.
{thread:id=915277}
In the last three posts I explain how to use a shellscript with AWK and SED to pass parameters to a controlfile.
Please feel free to post again if you have some questions regarding my explanatory notes.
Yours sincerely
Florian W.

Define variable in SQL Loader Control File

Hi,
I have an input file where the first line is the header record, followed by the detail records. For the processing, I do not need to store the fields of the header record but I need a date field from this header record and store in as part of the detail record in an oracle record row.
Is it possible to define a variable within the sql loader control file to store the value that I need in memory then use it when I do the sql insert by the sql loader?
Thanks for any advice.

Not sure that you can. But if your on unix/linux/mac its easy enough to write a shell script to populates the variables in a template file that you can then use as the ctl file. The perl template toolkit could be an option for that as well

Importing already-made SQL*Loader control files in OWB 10g

Hi all,
Suppose that I have a certain amount of already hand-made SQL*Loader control files, say 50 or so.
Each of these control files have a variable quantity of fields.
I feel really lazy, so I would like to know if it is possible to import directly these control files instead of re-typing them in the design center. That would save me a lot of time.
Thanks !
Burgy

Hi Burgy
One option is to use the sqlloader option to generate an external table from the SQLLoader control file (search for generate_only in the sqlloader documentation). If you define the external table in the database you can reverse engineer this into OWB.
Cheers
David

Add "Trailing Nullcolls" to sql loader control files generated by OWB

Hi gurus,
I've got a problem loading data with SQL Loader. I need to add the parameter "trailing nullcols" into the SQL Loader control file generated by OWB. I don't want to do this by saving the skript on my hard disk and run it manually, so any ideas where I can put this parameter? I am using OWB 10.1 on a windows 2000 machine.
Thanks
Stephan

Hi,
I found the solution to problem.
1; Select the mapping where you map your source flat file to a table.
2; Right click on the mapping and select "configure"
3; Go Sources and Targets -> YOUR_TABLE_NAME -> SQL*Loader Parameters
4; Set Trailing Nullcols = true :-)
Thank you to anyone looking at this problem.
Greetings
Stephan

SQL-Loader Control file for Tab-delimited fields

i want to import a text-file with TAB-DELIMITED fields and a line-break + return at the end of each record.
a want to do this by sql-loader and a control file.
please, can someone give me the statement:
e.g.
load data
infile 'exaple.txt' .......
(...field1, field2,....)
thank you very much

Case Study 3: Loading a Delimited, Free-Format File
http://otn.oracle.com/pls/db92/db92.to_URL?urlname=http:%2F%2Fdownload-west.oracle.com%2Fdocs%2Fcd%2FB10501_01%2Fserver.920%2Fa96652%2Fch10.htm%231006907
Modify the example and use 'terminated by whitespace' instead
For more information on TERMINATED Fields see
http://otn.oracle.com/pls/db92/db92.to_URL?remark=drilldown&urlname=http:%2F%2Fdownload-west.oracle.com%2Fdocs%2Fcd%2FB10501_01%2Fserver.920%2Fa96652%2Fch06.htm%231013838

SQL*LOADER control file for Multiple Tables

Dear DBA's
I am loading data throgh SQL*LOADER in Oracle. I have some problem, While
Inserting data into multiple table I have created single Control file in
following way which is giving me error, Data is stored in seprate fileswith
tablename.dat, So each tables data is stored in seprate .DAT file. So Iwant to
insert data from single control file taking data from .dat multiple files into
multiple tables. Is it possible?? or some different method
Please help me as early as possiable.
Thanks & Regards
Shailesh
CREATE TABLE T1 (
L1 VARCHAR2(10),
L2 NUMBER(10),
L4 NUMBER(10),
MYDATE DATE);
CREATE TABLE T2 (
L1 VARCHAR2(10),
L2 NUMBER(10),
L3 LONG,
L4 NUMBER(10),
MYDATE DATE)
CONTROL FILE :-
UNRECOVERABLE LOAD DATA
INFILE 't2.dat'
INSERT INTO TABLE t2
FIELDS TERMINATED BY ','
OPTIONALLY ENCLOSED BY '"'
TRAILING NULLCOLS
( l1 char,l2 char,l4 char,mydate date,l3 char(2000000))
INFILE 't1.dat'
INSERT INTO TABLE t1
FIELDS TERMINATED BY ','
OPTIONALLYENCLOSED BY '"'
TRAILING NULLCOLS
( f1 char,f2 char,f4 char))
T2.DAT
Raju,14,1,09-NOV-2000,"Has a powerful data parsing,engine which putslittle
limitation on the format of the data in thedatafile."
Manu,14,2,09-NOV-2000,"Can load data from multiple datafiles, during the same
load session. "
T1.DAT
Raj,14,1,09-NOV-2000
Mau,14,2,09-NOV-2000
null

Hi,
I tried to use your control file and got numerous erros.
try using seperate control files:
T1.CTL:
LOAD DATA
INFILE 'D:\T2.dat'
INSERT INTO TABLE t2
( l1 char,l2 char,l4 char,mydate date,l3 char(20000))
T2.CTL
LOAD DATA
INFILE 'D:\T1.dat'
INSERT INTO TABLE t1
( l1 char,l2 char,l4 char,mydate date)

SQL LOADER CONTROL FILE

hi,
Can one call procedures and functions inside a control file in SQL Loader ...alternatively how can one use case inside a control file ...
How to implement the the following code in a control file:
SELECT CASE
WHEN INSTR(UPPER(returnname),'SCHEDULE') > 0 THEN 'S'
WHEN INSTR(UPPER(returnname),'RETURN') > 0 THEN 'R'
WHEN INSTR(UPPER(RETURNNAME),'BREAKDOWN') > 0 THEN 'B'
ELSE returnname
END
AS returns
FROM tableexample
Please let me know ..

regarding your first question :
data_file TT.dat :
SCHEDULE
RETURN
BREAKDOWN
HOLIDAY
WEEKEND
schedule
return
breakdown
holiday
weekend
control_file TT.ctl :
load data
insert
into table dummy_test
(TEXT position(01:20) char
,TEXT_b position(01:20) char " decode(upper(:TEXT),'SCHEDULE','S','RETURN','R','BREAKDOWN','B',:TEXT) "
parameter_file TT.par :
userid=user/password
DATA=TT.dat
CONTROL=TT.ctl
ERRORS=99999
load file into table :
sqlldr parfile=TT.par
log-file TT.log :
SQL*Loader: Release 8.1.6.2.0 - Production on Thu Feb 26 16:01:23 2004
(c) Copyright 1999 Oracle Corporation. All rights reserved.
Control File: TT.ctl
Data File: TT.dat
Bad File: TT.bad
Discard File: none specified
(Allow all discards)
Number to load: ALL
Number to skip: 0
Errors allowed: 99999
Bind array: 64 rows, maximum of 65536 bytes
Continuation: none specified
Path used: Conventional
Table DUMMY_TEST, loaded from every logical record.
Insert option in effect for this table: INSERT
Column Name Position Len Term Encl Datatype
TEXT 1:20 20 CHARACTER
TEXT_B 1:20 20 CHARACTER
SQL string for column : " decode(upper(:TEXT),'SCHEDULE','S','RETURN','R','BREAKDOWN','B',:TEXT) "
Table DUMMY_TEST:
10 Rows successfully loaded.
0 Rows not loaded due to data errors.
0 Rows not loaded because all WHEN clauses were failed.
0 Rows not loaded because all fields were null.
Space allocated for bind array: 2816 bytes(64 rows)
Space allocated for memory besides bind array: 0 bytes
Total logical records skipped: 0
Total logical records read: 10
Total logical records rejected: 0
Total logical records discarded: 0
Run began on Thu Feb 26 16:01:23 2004
Run ended on Thu Feb 26 16:01:23 2004
Elapsed time was: 00:00:00.58
CPU time was: 00:00:00.10
SQL > select * from dummy_test ;
TEXT TEXT_B
SCHEDULE S
RETURN R
BREAKDOWN B
HOLIDAY HOLIDAY
WEEKEND WEEKEND
schedule S
return R
breakdown B
holiday holiday
weekend weekend
10 rows selected.
SQL>
Does it solve your problem ?
Regards,
Rainer

How to use Conditional statements in SQL Loader control file

Hi,
I am using sql loader to load a flat file to the table. I am using control file for this purpose as show below:
LOAD
INTO TABLE store_shrink
TRUNCATE
FIELDS TERMINATED BY " "
TRAILING NULLCOLS
SITE_ID char,
ST_SHRINK char,
ST_REVENUE char,
SHRINK_PR char ":ST_SHRINK/:ST_REVENUE"
My question is this. If in the flat file the value of 'ST_REVENUE' is '0', then I want 'SHRINK_PR' to be '0' as well, and skip the calculation (:st_shrink/:st_revenue).
How to achieve this with the conditional statement or using any Oracle function?
Any help or suggestion is greatly appreciated.
Thanks in advance.

Hi there,
I tried the following in my above query and it doesn't work somehow. Anyone has an idea? I have been on internet throughout but to no avail. Please help:
LOAD
INTO TABLE store_shrink
TRUNCATE
FIELDS TERMINATED BY " "
TRAILING NULLCOLS
SITE_ID char,
ST_SHRINK char,
ST_REVENUE char,
SHRINK_PR char "case (when :st_revenue<>'0.00' then :SHRINK_PR=:ST_SHRINK/:ST_REVENUE else :SHRINK_PR='0.00') end"
)

SQL Loader Control File configuration

Hi,
I'm writing loader scripts for a Consulting team to use to load standard format files for customers. I want to be able to support different field separators without having to create copies of the control files for each separator variant.
e.g.
LOAD DATA
INFILE "%IMPPATH%\BaseProd.txt"
BADFILE "%IMPPATH%\BaseProd.bad"
DISCARDFILE "%IMPPATH%\\BaseProd.dsc"
INSERT INTO TABLE
          IMPORT_PRODUCT
     FIELDS TERMINATED BY ','
     OPTIONALLY ENCLOSED BY '"'
     TRAILING NULLCOLS
(      PROD_CD      "UPPER(:PROD_CD)",
     PROD_DESCRP,
     SELL_PRICE)
I'd like to be able to specify a %variable% for the FILEDS TERMINATED BY value. (The %IMPPATH% works a treat for the location of the file.)
Anyone know how to achieve this?
Thanks in advance.

I have tried
SET MYSEPARATOR=,
and
FIELDS TERMINATED BY '%MYSEPARATOR%'
I then get the message in the LOG file
Column Name Position Len Term Encl Datatype
PROD_CD FIRST * O(") CHARACTER
Terminator string : '%MYSEPARATOR%'
It appears to be looking for the complete string %MYSEPARATOR% as the separator!
I have also tried
SET MYSEPARATOR=','
and
FIELDS TERMINATED BY %MYSEPARATOR%
which gives the error
SQL*Loader-350: Syntax error at line 9.
Illegal combination of non-alphanumeric characters
FIELDS TERMINATED BY %MYSEPARATOR%
^

SQL Loader Control file help!!!

Hi All,
I was in the process of writing a control file for sql loader for an activity i am performing and would appreciate inputs from you all.
I have a table patient containing 44 columns, i have a column 'SEC_LANG_NAME' in which i have to insert data from a excel file.
The excel file contains 3 columns, PATIENT_ID, NAME,SEC_LANG_NAME, i just want to load the values present in 'SEC_LANG_NAME' column in excel file into the 'SEC_LANG_NAME' coulmn in the patient table using sqlloader and the condition is that PATIENT_ID in excel file should be equal to PATIENT_ID in the patient table.
as a first step i am converting this excel into a csv file, and then will shoot the sqlldr once i am done with control file, can someone please help me with the format of control file for this activity.
thanks in advance,
regards,
Edited by: user10243788 on Jan 3, 2010 12:09 AM

Hello user10243788.
It appears that your intent is to load data into an existing table that contains the key data and is only lacking a column of information. SQL*Loader itself is not built to do this; what it can do is load records to tables. You will have to use a two-step approach similar to what Srini has suggested. 1) If your process is able to be run local to the database server, an external table is a great option. If your process is instead run remote to the database server, SQL*Loader will allow you to load your data file to a table. 2) You will need to run a process to update the PATIENT table.
Here is a start of a control file based on the details that you've providedLOAD DATA
REPLACE
INTO patient_enhance
FIELDS TERMINATED BY ","
( patient_id
, name FILLER
, sec_lang_name)Hope this helps,
Luke
Please mark the answer as helpful or answered if it is so. If not, provide additional details.
Always try to provide create table and insert table statements to help the forum members help you better.
Edited by: Luke Mackey on Jan 5, 2010 12:30 PM
oops, will have to load patient_id to do the update

SQL Loader Control File Recoverable Option in Oracle 9i

We are migrating from Oracle 8 to Oracle 9i. We are running some of the SQL*Loader scripts. The control file uses "OPTIONS (UNRECOVERABLE)" option, which is working fine with Orace 8 whereas it is not working in
Oracle 9i. Are these options "RECOVERABLE/UNRECOVERABLE" removed from Oracle 9i. If yes, why ? Or do we have an alternate option for the same.
Thanks in advance.
Balaji

974647 wrote:
my requirement is that for the remaining 2 columns, i want to insert text 'COLUMN_DROPPED' in backend table.Rest 8 columns should be populated as usual.First of all it is only possible if remaining 2 column datatype is string (char/nchar, varchar2/nvarchar2, clob/nclob) and are at least 14 characters. The rest is easy. Just modify last 2 fields in control file:
column9 constant 'COLUMN_DROPPED',
column10 constant 'COLUMN_DROPPED'SY.

Use of WHEN in SQL Loader Control File

Does anyone know of a way, using the CTL file below, to NOT LOAD (i.e. discard) any record where field G is null -OR- substr(G,1,3)='CON'+ (the first 3 characters of field G are "CON")?
The WHEN clause seems very limited in what it can test and all my attempts to use a compound condition, much less the SUBSTR function, have failed. The documentation indicates that only very simple conditions can be specified.
(Oracle 10g, Unix)
Thanks
LOAD DATA
TRUNCATE
INTO TABLE TEST_TABLE
WHEN (G <> '')
FIELDS TERMINATED BY "^"
TRAILING NULLCOLS
A ,
B FILLER,
C FILLER,
D FILLER,
E FILLER,
F FILLER,
G "LTRIM(:G,'0')",
H FILLER,
I FILLER,
J FILLER,
K SYSDATE,
L CONSTANT "SQLLDR"
)

Hello MTM.
The WHEN clause in SQL*Loader, despite what you might read, doesn't seem to evaluate the value of the column you specify after SQL clauses are processed. Therefore, the only way you can guarantee to NOT LOAD a record is by using a function to raise an application error when the column data meets your criteria. You'll need to do some basic comparisons between bad data and discarded data in the bad data file to isolate these.
You can still discard the null data using (replace ne with greater and less than)WHEN (g ne '')Hope this helps,
Luke
Please mark the answer as helpful or answered if it is so. If not, provide additional details.
Always try to provide create table and insert table statements to help the forum members help you better.

Using constant values in SQL Loader control file

Hi,
I have a requirement where I need to migrate the data of 6 tables from MS Access into Oracle data base. I have written SQL Loader scripts so that I can create CSV files based on MS Access data and then migrate into Oracle. But in Oracle tables we have 4 common columns like Create_By, Created_Date,Updated_By and Update_Date, and those fields should be taken care by system. So, basically system should update login user ID and sysdate values in respective columns. My question here is, I do not have above mentioned common columns in MS Access tables. So, can I hard code those values in control file by saying
Created_By CONSTANT user,
Create_Date CONSTANT TO_CHAR(SYSDATE,'MM/DD/YYYY HH24:MI:SS'),
Updated_By CONSTANT user,
Updated_Date CONSTANT TO_CHAR(SYSDATE,'MM/DD/YYYY HH24:MI:SS')
Please let me know your valuable suggestions.

You do it without it constant
--sample data file
1,2,,
3,4,,
LOAD DATA
INFILE 'D:\d.csv'
INTO TABLE ABC
FIELDS TERMINATED BY ","
( A,
B,
C sysdate,
D "USER"
)Edited by: J99 on Jul 23, 2009 12:14 PM
OR use to avoid extra ',' in datafile.
--sample data file
1,2
3,4
LOAD DATA
INFILE 'D:\d.csv'
INTO TABLE ABC
FIELDS TERMINATED BY "," TRAILING NULLCOLS
( A,
B,
C sysdate,
D "USER"
)

Function for column validation in SQl Loader control file.

Similar Messages

Maybe you are looking for