Creating a dynamic sqlldr control file

Hi,
I am in need of creating a dynamic sqlldr control file that will check the flat file, delimiter and load the data in a table. The table is having all the columns but the flat file can vary time to time.
looking forward for your valuable suggestions.
Regards
Rajib.

You may want to post more explicit requirements if you want sample code. For example, what the file looks like, what variations are allowed, what variations are disallowed, an example control file that would be output, etc. Specifying the precise language you're using (there are many different shell scripting languages) would also help.
In my experience, though, this sort of thing is almost always a one-off-- examples don't tend to be particularly helpful because every set of requirements tends to be very particular. If you have a full understanding of the requirements, and a decent understanding of your scripting language, I doubt it would take more than half a day to knock something together.
Justin

Similar Messages

How to dynamically create sqlldr control file using stored procedure

I am trying to dynamically create the control file (.ctl) and execute the same using a stored procedure.I would be passing the file name as a parameter to this procedure. How do I go about doing this?
The control file has the following structure. The file name (mktg) varies and is passed as an input to the stored procedure.
SPOOL mktg.ctl
LOAD DATA
INFILE 'mktg.csv'
INTO TABLE staging
FIELDS TERMINATED BY ','
TRAILING NULLCOLS
(COMPANY_NAME,
ADDRESS,
CITY,
STATE,
ZIP)
SPOOL OFF ;
sqlldr scott/tiger CONTROL= mktg.ctl LOG=mktg.log BAD=mktg.bad

We are using oracle 9i rel 2.
I have not had much success with the creation of log and bad files using external tables when they are being used within a dynamic sql.
Plz check this:
Re: problems related to data loads from excel, CSV files into an oracle 9i db

Whwn to create a standby control file?

Hi All ,
I want to setup a standby database for my Production DB.
I have a doubt, can we create a Standby by control file when the Primary database is up and running(read-write) mode. or else it is must to be in mount state only ?
Please advise.
Thanks.

Hello;
I do it like this: (And then copy the STANDBY.ctl to the Standby system and rename)
SQL>startup mount;
SQL>alter database create standby controlfile as 'STANDBY.ctl';
This command will fail is STANDBY.ctl exists.
See step 8 of my cliff notes here:
http://www.visi.com/~mseberg/data_guard_on_oracle_10_step_by_step.html
Or Step 7 if Oracle 11 here:
http://www.visi.com/~mseberg/data_guard_on_oracle_11_step_by_step.html
Best Regards
mseberg

SQL LDR Control file date format

Hi All
I need to Insert date with time using sqlldr.
In my data file am getting date value as 20110103 10:27:44.
In control file am doing like this
creation_date "decode(:creation_date, 'null', null, 0,null,to_date(:creation_date, 'YYYYMMDD HH24:MI:SS'))
This is inserting only date Ex: 1/3/2011 but I need to insert date with time ex:1/3/2011 10:27:44 AM
Please advice
Thanks
Raj
Edited by: user632682 on Feb 15, 2011 10:37 AM

Raj,
Doesn't make any sense to have date as 0, so either you should use null or sysdate. You can write a function and use it in your sqlldr control file. This is just an example and you can write this anyway
# sqlldr control file
Creation_date DATE 'YYYYMMDD HH24.MI.SS' "format_date(:creation_date)"
CREATE OR REPLACE FUNCTION format_date(i_date in DATE)
RETURN DATE
IS
BEGIN
if (i_date is NULL or i_date = 0 ) then
i_date := sysdate;
end if;
return i_date;
END format_date;Regards

Control file for United States Geometry

Has anyone built a control file to load all of the United States? I have tried dumping all of the STATES GEOM data out of the Demo, but to clean it up and use it in a control file to load it into a new table I need to dump it into Excel. Excel hits its limit on column numbers when trying to create the Row for Alaska.
does anyone have any other ideas on how I can do this.
Thanks in advance!
-Scott

Hi again Richard,
Again dumping the GEOM data from STATES table in the demo
the output looks like this:
Arizona AZ
SDO_GEOMETRY(3, NULL, NULL, SDO_ELEM_INFO_ARRAY(1, 3, 1), SDO_ORDINATE_ARRAY(-114.0498, 37.000423, -113.48438, 37, -112.8986, 37.000401, -112.5396, 37.000683 ........................etc..
To format the data from the demo so I can create a bulk load control file, it needs to be in the form of:
BEGINDATA
2003|Arizona|AZ|-112.5396|37.000683|-112|37.000977|-111.41205|37.001514|-111.13302|/
etc.....
this is what I am trying to accomplish, and why I would need Excel, or another tool, to help with the correct formatting.
The reason for this is that the GEOM data needs to be loaded into a different table on a different server, I only have the demo running on my local machine. I need to create this control file so I can create my own table on the production server and develop from that version of the database.
Hope that clears things up, thanks again.
-Scott

How to add other 2 control files at ASM in linux RAC

Hi Experts,
I am new for RAC .
the vendor build a RAC for us. I found there are only one control file in system.
we use oracle 10.2.0.4 at ASM with RAC in redhat linux 5.
how to add 2 additional control file to ASM for RAC ?
Please provide a procedur in detail.
Thanks
Jim

Hi damorgan & Friends,
I could not find some infomration to add control into ASM . I can do this job( see below procedure) in no ASM .
My question, our database locates at ASM and control file with a system auto-number ( fully qualified filename ) as
+DATA1/SALE/controlfile/current.256.690290159
How do I physical copy and rename other 2 contril file in directory and modify location in pfile?
I saw some paper to use request as an alias (such as +dgroup2/control/ctl.f). i can not image to copy/rename control.
Please help me!!
Thanks
Jim
========added control file for no ASM database and works=====================
1)
SQL> create pfile from spfile;
File created.
2)
SQL> show parameter control_file
NAME TYPE VALUE
control_file_record_keep_time integer 7
control_files string C:\ORADATA\ORCL\CONTROL01.CTL
3)
SQL> shutdown immediate
Database closed.
Database dismounted.
ORACLE instance shut down.
4) modify pfile add additional control file2/3 as
control_files='C:\Oradata\ORCL\control01.ctl','C:\Oradata\ORCL\control02.ctl','C:\Oradata\ORCL\control03.ctl'
and physical copy control01.ctl and raname as control02.ctl,control03.ctl
5)
SQL> startup pfile='C:\oracle\product\10.2.0\db_2\database\initORCL.ora';
ORACLE instance started.
Total System Global Area 167772160 bytes
Fixed Size 1247900 bytes
Variable Size 62915940 bytes
Database Buffers 100663296 bytes
Redo Buffers 2945024 bytes
Database mounted.
Database opened.er database mount;
6)
SQL> Create spfile from pfile='C:\oracle\product\10.2.0\db_2\database\initORCL.ora';
File created.
7) check control file info under pfile environment
SQL> show parameter control_file
NAME TYPE VALUE
control_file_record_keep_time integer 7
control_files string C:\ORADATA\ORCL\CONTROL01.CTL,
C:\ORADATA\ORCL\CONTROL02.CTL
, C:\ORADATA\ORCL\CONTROL03.CT
L
8)SQL> shutdown immediate
Database closed.
Database dismounted.
ORACLE instance shut down.
9) startup as spfile environment.
SQL> startup
ORACLE instance started.
Total System Global Area 167772160 bytes
Fixed Size 1247900 bytes
Variable Size 62915940 bytes
Database Buffers 100663296 bytes
Redo Buffers 2945024 bytes
Database mounted.
Database opened.
10) check control info for spfile environment
SQL> show parameter spfile
NAME TYPE VALUE
spfile string C:\ORACLE\PRODUCT\10.2.0\DB_2\
DATABASE\SPFILEORCL.ORA
SQL> show parameter control_file
NAME TYPE VALUE
control_file_record_keep_time integer 7
control_files string C:\ORADATA\ORCL\CONTROL01.CTL,
C:\ORADATA\ORCL\CONTROL02.CTL
, C:\ORADATA\ORCL\CONTROL03.CT
L

How to change destination table dynamically in configuration file in ssis?

hello,
i have a package i am having one data flow task.in data flow task i have one source and one destination.source and destination are different.i have created xml configuration file by configuring source and destination connection
strings.
now i want to change destination in the same server to different database with out opening the package.i want to directly change in the config file.we can change it by modifying configured value proerty and intial catalogue value.but if the table is not
existed in the changed database.how we can create it dynamically.

HI jiri Neoral,
thanks for reply,as you said above process by this we can do change only databasename.if in my destination database,the table which i used in package is not existed,can we create it dynamically
using config file.later changing table name is possible?
For that you need to have a step in SSIS package prior to data flow task to check if table exists and if not create it
You can use execute sql task with query like below
IF OBJECT_ID('TableName') IS NULL
CREATE TABLE TableName
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Restrictions for using sql commands and operators in loader control file

Hi ,
It suppose that there is a lot of restrictions and limitations when using sql commands and operators in the loader control files, same as it seems I cannot use (or) when with case statement, also it seems there is certain length for the case,
So guys, what are the common limitations and restrictions to be avoided in the loader control file ?
Your efforts are highly appreciated
Ash

Hi Ash,
if you need to do more complicated logic its better to define the file to be loaded as an external table. You can then use any sql function you like against the external table rather than messing around with what you can and can;t do in a sqlldr control file.
You can use the external_table option of sqldr to generate the definition.
Regards,
Harry
http://dbaharrison.blogspot.com/

SQL Loader Control File configuration

Hi,
I'm writing loader scripts for a Consulting team to use to load standard format files for customers. I want to be able to support different field separators without having to create copies of the control files for each separator variant.
e.g.
LOAD DATA
INFILE "%IMPPATH%\BaseProd.txt"
BADFILE "%IMPPATH%\BaseProd.bad"
DISCARDFILE "%IMPPATH%\\BaseProd.dsc"
INSERT INTO TABLE
          IMPORT_PRODUCT
     FIELDS TERMINATED BY ','
     OPTIONALLY ENCLOSED BY '"'
     TRAILING NULLCOLS
(      PROD_CD      "UPPER(:PROD_CD)",
     PROD_DESCRP,
     SELL_PRICE)
I'd like to be able to specify a %variable% for the FILEDS TERMINATED BY value. (The %IMPPATH% works a treat for the location of the file.)
Anyone know how to achieve this?
Thanks in advance.

I have tried
SET MYSEPARATOR=,
and
FIELDS TERMINATED BY '%MYSEPARATOR%'
I then get the message in the LOG file
Column Name Position Len Term Encl Datatype
PROD_CD FIRST * O(") CHARACTER
Terminator string : '%MYSEPARATOR%'
It appears to be looking for the complete string %MYSEPARATOR% as the separator!
I have also tried
SET MYSEPARATOR=','
and
FIELDS TERMINATED BY %MYSEPARATOR%
which gives the error
SQL*Loader-350: Syntax error at line 9.
Illegal combination of non-alphanumeric characters
FIELDS TERMINATED BY %MYSEPARATOR%
^

Strange Corrupt Block Error in Control File not in CONTROL_FILES

When in RMAN connected to the TARGET and CATALOG I issue a RESYNC CATALOG I get this error:
RMAN> RESYNC CATALOG;
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03009: failure of resync command on default channel at 08/17/2009 10:36:59
ORA-00227: corrupt block detected in control file: (block 15, # blocks 1)
ORA-00202: control file: 'E:\ORACLE\PRODUCT\10.2.0\DATABASE\SNCFEBIZ01PD.ORA'
RMAN>
This control file is in the Oracle Windows default dir but I am not using it and did not create it.
My control files listed in the init.ora are:
SQL> show parameter control
NAME TYPE VALUE
control_file_record_keep_time integer 7
control_files string E:\ORACLE\ORADATA\EBIZ01PD\CNT
RL01.DBF, D:\ORACLE\ORADATA\EB
IZ01PD\CNTRL02.DBF, E:\ORACLE\
ORADATA\EBIZ01PD\CNTRL03.DBF
Any idea why this is happening?

That is a SNAPSHOT CONTROLFILE, created by RMAN as a copy of the current controlfile.
Wonder how and why the copy is corrupted ? Check the timestamp of the file to see when it was created. A RESYNC will always create a fresh Snapshot Controlfile.
See http://download.oracle.com/docs/cd/B19306_01/backup.102/b14191/rcmarchi.htm#sthref65

Problem in control file created through LKM File to Oracle (SQLLDR)

I have a fixed file ABC.txt & it has three fields/columns of length ,C1:= 4, C2 :=10 & C3:=6 & I have to use LKM File to Oracle (SQLLDR) to load data into oracle target table.
I recieved the following error at step CALL SQLLDR in the KM
"org.apache.bsf.BSFException: exception from Jython: Traceback (innermost last):
File "<string>", line 3, in ?"
Then I checked the control file log & found that the position start value & end value was not defined in control file which is created automatically by LKM
SQL*Loader-350: Syntax error at line 14.
Expecting positive integer, found ":".
     C1_C1     POSITION(:), "
The control file created by ODI is & it's missing the position value.
OPTIONS (
     SKIP=0,
     ERRORS=0,
     DIRECT=FALSE
LOAD DATA
INFILE "C:/SNAPON/EOL.txt"
BADFILE "C:/SNAPON/ABC.bad"
DISCARDFILE "C:/SNAPON/ABC.dsc"
DISCARDMAX 1
INTO TABLE SNAPON_W.C$_0ABC
     C1_C1     POSITION(:),
     C2_C2     POSITION(:),
     C3_C3     POSITION(:)
Does any one know why the position value is not created in the control file .
Edited by: neeraj_singh on Mar 3, 2011 1:25 AM

Hi Neeraj,
It is happening because you have not selected the mapping execution area as STAGUING .
Open your interface , click on each and every column of your target datastore , make sure the "Execute On" is marked on "Staging Area".
Then run your interface.
Thanks,
Sutirtha

Problem in creating control files

Hi
I am using oracle 9i
I want to import the excel sheet data into the database.
Please let me know how to create the control file for sql loader.
For that i created control file using the following code
set echo off ver off feed off pages 0
accept tname prompt 'Enter Name of Table: '
accept dformat prompt 'Enter Format to Use for Date Columns: '
spool &tname..ctl
select 'LOAD DATA'|| chr (10) ||
'INFILE ''' || lower (table_name) || '.dat''' || chr (10) ||
'INTO TABLE '|| table_name || chr (10)||
'FIELDS TERMINATED BY '','''||chr (10)||
'TRAILING NULLCOLS' || chr (10) || '('
from user_tables
where table_name = upper ('&tname');
select decode (rownum, 1, ' ', ' , ') ||
rpad (column_name, 33, ' ') ||
decode (data_type,
'VARCHAR2', 'CHAR NULLIF ('||column_name||'=BLANKS)',
'FLOAT', 'DECIMAL EXTERNAL NULLIF('||column_name||'=BLANKS)',
'NUMBER', decode (data_precision, 0,
'INTEGER EXTERNAL NULLIF ('||column_name||
'=BLANKS)', decode (data_scale, 0,
'INTEGER EXTERNAL NULLIF ('||
column_name||'=BLANKS)',
'DECIMAL EXTERNAL NULLIF ('||
column_name||'=BLANKS)')),
'DATE', 'DATE "&dformat" NULLIF ('||column_name||'=BLANKS)', null)
from user_tab_columns
where table_name = upper ('&tname')
order by column_id;
select ')'
from dual;
spool off
and after then i have written in the commond prompt like
C:\sqlldr username/password@host controlfile
then it is giving like this
Commit point reached - logical record count 1
Any Help?
Thank you

What does it say in the .log file?
What records are in the .bad file?
How many records in the data file - if 1 then it's all good.
Excel often puts column headings in the .csv file - you may need to SKIP the first record (look it up in the docs).
Don't hard code the filename into the control file - it's easier to do that when you load:
sqlldr u/p control=controlfile data=datafileRead carefully what FLOAT and DECIMAL mean. Unless you are dealing with binary datatypes (you aren't) you probably don't need these. Only DATE needs careful treatment.
Also, consider pulling the data in using an external table (if it is on the Oracle server already). Again, look it up in the docs - you'll still have to get the control definition right...
Regards Nigel

Constant variable in control file - sqlldr

Hi all,
Is there a way to create a dynamic constant variable within the control file?
I'm trying to load from a csv file but need just 2 values from the 1st row, as a constant for the inserts for the rest of the rows.
How/can I use a variable and assign this value to it and use that variable inside the control file?
For example: (first character: 1=header, 2=content)
.csv file:
1,constant1,constant2
2,data11,data12
2,data21,data22
2,data31,data32
2,data41,data42
table:
col1 col2 col3 col4
data11 data12 constant1 constant2
data21 data22 constant1 constant2
data31 data32 constant1 constant2
data41 data42 constant1 constant2
Thank you soo much for your help
Edited by: user9215527 on Nov 15, 2011 8:08 PM
Edited by: user9215527 on Nov 15, 2011 8:11 PM
Edited by: user9215527 on Nov 17, 2011 9:48 AM

I am thinking about the following:
1. Load the data into 2 separate tables (header and content)
2. Update the content with the constant value from header.
Question:
Is there any other better way that I can do? Like can those 2 steps be done in a single control file?
Pls help.
====================================================
Step 1:
load data
infile 'test.txt'
append
into table zz_test_hdr
when (1:1) = '1'
( constant_1 POSITION(2:12) ,
constant_2 POSITION(13:23))
into table zz_test
when (1:1) = '2'
( col_1 POSITION(2:11),
col_2 POSITION(12:22))
Step 2:
update zz_test
set (col_3, col_4) = (select constant_1,constant_2 from zz_test_hdr);
=============================================

Sqlldr and control file

Howdy:
I'm running Oracle 9i (9.0.2) on Redhat Linux 7.3.
I am trying to append data from a flat file into a
table where one of the field is timestamp(6).
The data has fractional seconds and looks like so:
[snip data]
2002-12-08 22:29:38.216712
[snip data]
I want to use sqlldr to load the data, but when
I try to create the control file, I am getting
errors telling me my method is wrong.
In my control file, I am trying to do things like:
[snip versions of the 'UPDATED' timestamp field]
* UPDATED TIMESTAMP "YYYY-MM-DD HH24:MI:SS"
* UPDATED TIMESTAMP "YYYY-MM-DD HH24:MI:SS.FFF"
* UPDATED POSITION(132:151)"TO_DATE(:UPDATED, 'YYYY-MM-DD HH24:MI:SS')"
[snip versions ...]
I am having no success.
Can someone give an example of how to create
a control file for sqlldr when defining a
timestamp field with fractional seconds six
digits past the decimal?
Thanks!
-X

--update:
--this is pretty much for my notes (as i'm
--sure i will need this info again).
--i have figured out how to fix my problem.
--re-cap:
--so, i'm running Oracle 9i (9.2.0) on Redhat Linux 7.2 as
--you know. I want to append my data from a flat file
--into a table that i've created. i also want to use SQLLDR
--to do it. i have create a bunch of scripts to do this
--and i was close - the problem was that in one of the
--fields (table) was a TIMESTAMP field and i couldn't
--figure out how to create a control file to say 'hey, there
--is a timestamp field in there and it has fractions in
--the seconds area ... 6 decimal places over'.
--so, this is what my table looks like:
[snip table]
SQL> describe hmp_dates
Name Null? Type
CONTRACT CHAR(12)
MBR_NUM CHAR(2)
DATE DATE
EVENT_ID NUMBER(38)
VALUE VARCHAR2(50)
RESULT VARCHAR2(50)
UPDATED TIMESTAMP(6) WITH TIME ZONE
USERNAME VARCHAR2(50)
CLAIM VARCHAR2(50)
[snip table]
--this is what my data looks like:
[snip data]
xxxxxxxxx |02|2000-05-31|38|\N|\N|2002-12-08 22:29:38.216712|ADMIN|\N
xxxxxxxxx | |1999-06-06|38|\N|\N|2002-12-08 22:29:38.216712|ADMIN|\N
xxxxxxxxx | |1998-12-28|38|\N|\N|2002-12-08 22:29:38.216712|ADMIN|\N
xxxxxxxxx | |1999-12-03|38|\N|\N|2002-12-08 22:29:38.216712|ADMIN|\N
[snip data]
--this is what my control file looks like:
[snip control]
LOAD DATA
INFILE '/var/local/table_backup/hmp_dates_03July2003.txt'
APPEND
INTO TABLE HMP_DATES
FIELDS TERMINATED BY '|' OPTIONALLY ENCLOSED BY '"'
CONTRACT,
MBR_NUM,
"DATE" DATE "YYYY-MM-DD",
EVENT_ID,
VALUE,
RESULT,
UPDATED TIMESTAMP WITH TIME ZONE 'YYYY-MM-DD HH24:MI:SSXFF', *****
USERNAME,
CLAIM
[snip control]
--please note the astrisks. that is the elfin goodness. (SSXFF to denote precision
--seconds).
--hopes this helps someone besides me.
-X

Error while creating control file

hi
i am getting following error while creating controll file
QL> shutdown
Database closed.
Database dismounted.
ORACLE instance shut down.
SQL> startup nomount
ORACLE instance started.
Total System Global Area 629145600 bytes
Fixed Size                  1250548 bytes
Variable Size             171969292 bytes
Database Buffers          452984832 bytes
Redo Buffers                2940928 bytes
SQL> @c:\study\rose\c.sql
SP2-0042: unknown command "DATAFILE" - rest of line ignored.
SP2-0734: unknown command beginning "'C:\ORACLE..." - rest of line ignored.
SP2-0734: unknown command beginning "'C:\ORACLE..." - rest of line ignored.
SP2-0734: unknown command beginning "CHARACTER ..." - rest of line ignored.
SP2-0044: For a list of known commands enter HELP
and to leave enter EXIT.
1 CREATE CONTROLFILE SET DATABASE "ROSE" RESETLOGS froce logging NOARCHIVELOG
2      MAXLOGFILES 32
3      MAXLOGMEMBERS 2
4      MAXDATAFILES 32
5      MAXINSTANCES 16
6      MAXLOGHISTORY 1752
7 LOGFILE
8 GROUP 1 'C:\oracle\product\10.2.0\oradata\rose\LOG1ROSE.ORA' SIZE 50M,
9    GROUP 2 'C:\oracle\product\10.2.0\oradata\rose\LOG2ROSE.ORA' SIZE 50M,
10   GROUP 3 'C:\oracle\product\10.2.0\oradata\rose\LOG06.LOG' SIZE 25M,
11*   GROUP 4 'C:\oracle\product\10.2.0\oradata\rose\LOG07.LOG' SIZE 25M
SQL>

CHETAN YADAV wrote:
hi
i am getting following error while creating controll file
QL> shutdown
Database closed.
Database dismounted.
ORACLE instance shut down.
SQL> startup nomount
ORACLE instance started.
Total System Global Area 629145600 bytes
Fixed Size                  1250548 bytes
Variable Size             171969292 bytes
Database Buffers          452984832 bytes
Redo Buffers                2940928 bytes
SQL> @c:\study\rose\c.sqlWe can't debug what we can't see. And what we can't see is the contents of "c:\study\rose\c.sql".
SP2-0042: unknown command "DATAFILE" - rest of line ignored.
SP2-0734: unknown command beginning "'C:\ORACLE..." - rest of line ignored.
SP2-0734: unknown command beginning "'C:\ORACLE..." - rest of line ignored.
SP2-0734: unknown command beginning "CHARACTER ..." - rest of line ignored.
SP2-0044: For a list of known commands enter HELP
and to leave enter EXIT.
1 CREATE CONTROLFILE SET DATABASE "ROSE" RESETLOGS froce logging NOARCHIVELOG
2 MAXLOGFILES 32
3 MAXLOGMEMBERS 2
4 MAXDATAFILES 32
5 MAXINSTANCES 16
6 MAXLOGHISTORY 1752
7 LOGFILE
8 GROUP 1 'C:\oracle\product\10.2.0\oradata\rose\LOG1ROSE.ORA' SIZE 50M,
9 GROUP 2 'C:\oracle\product\10.2.0\oradata\rose\LOG2ROSE.ORA' SIZE 50M,
10 GROUP 3 'C:\oracle\product\10.2.0\oradata\rose\LOG06.LOG' SIZE 25M,
11* GROUP 4 'C:\oracle\product\10.2.0\oradata\rose\LOG07.LOG' SIZE 25M
SQL>

Creating a dynamic sqlldr control file

Similar Messages

Maybe you are looking for