SQL Loader newbie's question.

Hi all,
I have a delimiter file, e.g. data.dat, that contains the titles of each of the columns on the first row. Subsequent rows contain real column information/data. I didn't know how to create a control file, e.g. data.ctl, to create the table, its columns, and its data.
Currently, I got to create it manually, e.g.: table, columns, and used sql*loader to load in the data. Is there a better way to do this? Thank you very much for your help.

Yes, Sir. My external data is arranged as followed, e.g.:
"x","y","z"
"1","2","3"
"2","3","4"
"3","4","5"
where x, y, and z are the titles of the columns, not the data. My data are "1","2",...
Thank you very much for your response.

Similar Messages

Sql loader - skip record question

I am running Oracle 9 and using sql loader to import text file into table. Can sql loader skips the record which contain blank line or carriage return? Do I need to set up with options? Please advise me how. Thanks.

http://docs.oracle.com/cd/B10500_01/server.920/a96652/ch05.htm
http://www.orafaq.com/wiki/SQL*Loader_FAQ

Sql loader control file question.

I have a text file (t.txt) which contains a record types AAA and AAB to input fixed width data into a table (t) AAA_NO, AAA_TYPE, AAB_DESC.
Control file (control_t) contents:
load data infile '/path/t.txt'
insert into table t
when ((1:3) = 'AAA' )
AAA_NO position (4:14) CHAR,
AAA_TYPE postion (15:27) CHAR
Works prefectly, but I need to add another set of data from the same t.txt file with record type AAB. I attempted to add this into the same control file:
into table t
when (1:3) = 'AAB'
AAB_DESC position (28:128) CHAR
It fails naturally. How would I include the addtional record type data into the same table after AAA_NO and AAA_TYPE have already been inserted? Do I need to include the AAA_NO in the second insert (AAB_DESC)? Should I create another temp table to store only the AAA_NO and AAB_DESC and then insert that data into table t after the loader is done? Or can this be completed in the same control file?

Thanks again for the assistance, this is a tough one to fix. I am new to sqlloader.
The temp table creation is causing some serious errors, so I am back to trying to fix sqlloader to get the job done. the apt.txt file contains records that each row of a new record starts with either 'APT' or 'ATT'. Here is the details of what I am trying to do.
crtl file:
load data
infile '/path/apt.txt
insert
into table t_hld
when ((1:3) = 'APT')
apt_no position (4:14) CHAR,
apt_type position (15:27) CHAR,
apt_id position (28:31) CHAR
The next section is the problem where I am inserting apt_sked into the same table t_hld as above because it has a different record qualifier its ATT and not APT.
insert
into table t_hld
when (1:3) = 'ATT'
apt_no position (4:14) CHAR,
apt_sked position (16:126) CHAR
The positions of the data using fixed is working, I can insert the apt_sked data into another temp table instead of t_hld and it works. It's just when I attempt to place the ATT apt_sked data into the t_hld table after the APT data has been loaded into the t_hld table....I tried APPEND instead of INSERT, but that does not work.
The APT_NO's of the data are all the same- it is the qualifier for the records (Primary Key attribute- however I do not have it established since it is a temp table concept).
I am stuck trying to get the data in the t_hld table, everything works when I do not try to put the ATT apt_sked data into t_hld- everything is valid. And placing the ATT apt_sked data into a different temp table works perfectly- but I can't find a way to create an update to t_hld from this temp table without errors. So I am trying to go back to sqlloader to get this done- any thoughts or questions?
Thanks a billion!
Shawn

Fields terminated by (SQL loader, external table) question?

Hello.
I have a txt file which looks like:
Columns:
A..........B.........C...........D.........E..............F.............G...........H
739.......P.........0002......05........25012006..25012006..5...........data group
. = space
There are different number of spaces between columns.
What must i use in FIELDS TERMINATED BY to import this?
Thanks.

So, don't use FIELDS TERMINATED BY, but, as Ino suggested, fixed format, something like
LOAD DATA
TRUNCATE INTO TABLE <table name>
(a position(1:10),
b position(11:20),
c position(21:30),
d position(31:40),
e position(41:48) date "ddmmyyyy",
f position(51:58) date "ddmmyyyy",
g position(61:72),
h position(73:92))

Using SQL Loader in more than one table

Hi all,
I have a new question for those who have used SQL Loader. I
have never used it and I just know that I need a control file to
tell SQL Loader what is my flat file layout and what table the
information goes to. My problem is: my flat file has information
that goes to two tables in my schema. Those files are very big
(aprox 280Mb) and I would like to read them just once. Can I do
this with SQL Loader?
Other question, is that the fastest way to import data from
flat files becouse I am using PERL and it takes aprox. 9 hours
to import 10 of those files. I could use UTL_FILE to read it but
I heard that SQL Loader was better.
Thanks for your cooperation
(Robocop)
Marcelo Lopes
Rio de Janeiro - Brazil

SQL*Loader is the fastest way to load, particularly in direct parallel mode, and can certainly load to multiple tables.
>
My advice would be to have a look at the examples given in the Oracle Utilities guide, there is one for loading to multiple
tables, which I have pasted below.
>
-- Loads EMP records from first 23 characters
-- Creates and loads PROJ records for each PROJNO listed
-- for each employee
LOAD DATA
INFILE ’ulcase5.dat’
BADFILE ’ulcase5.bad’
DISCARDFILE ’ulcase5.dsc’
REPLACE
INTO TABLE emp
(empno POSITION(1:4) INTEGER EXTERNAL,
ename POSITION(6:15) CHAR,
deptno POSITION(17:18) CHAR,
mgr POSITION(20:23) INTEGER EXTERNAL)
INTO TABLE proj
-- PROJ has two columns, both not null: EMPNO and PROJNO
WHEN projno != ’ ’
(empno POSITION(1:4) INTEGER EXTERNAL,
projno POSITION(25:27) INTEGER EXTERNAL) -- 1st proj
INTO TABLE proj
WHEN projno != ’ ’
(empno POSITION(1:4) INTEGER EXTERNAL,
projno POSITION(29:31 INTEGER EXTERNAL) -- 2nd proj
INTO TABLE proj
WHEN projno != ’ ’
(empno POSITION(1:4) INTEGER EXTERNAL,
projno POSITION(33:35) INTEGER EXTERNAL) -- 3rd proj
see the documentation for a complete explanation of the configuration.
Thanks, I will read it.

2 sql loader questions

Hello,
I am going to be performing a data load with sql loader on approx 60 tables. For each table I have one csv and one ctl file. I'd like to run a file that will batch all the ctl files into one... is this possible? So that the person who has to load all this data into dev, test and prod doesn't have to go through the tedious process of running all the ctl files independantly.
My second question is about the log file. Can I specify in the ctl file where the log file will go? I'm specifying my infile and badfile, but I can't find the syntax to specify the log.
TIA,
Janice

Hi Janice,
Following is for specifing log file
$ORACLE_HOME/bin/sqlload userid=$ORACLE_PW control=$LDRCTL data=$complete_file_critical_parts discard=$LDRDSC bad=$LDRBAD log=$LDRLOG errors=10000000 skip=1
Prashant

Dumb question re Sql Loader in XP Client

Hi all,
I have a rather silly question. Previously I've worked exclusively in a Unix environment, but now find myself in XP.
I've done the full install of the Windows client for XP, but SQL*Loader is missing. I've RTFM'd, but can't find the necessary section. How do I get sql*loader installed in the XP environment?
Thanks (and apologies) in advance

IF you are talking of the 9i version, there should be the three database install disks (that contain both the database and the client tools). When you run the installer from the first disk from this set, you will have the option of installing the client tools (including SQL*Loader).
http://www.oracle.com/technology/software/products/database/oracle10g/index.html
http://www.oracle.com/technology/software/products/oracle9i/htdocs/winsoft.html

Sql*loader question

Hi Experts,
In a flat file 50000 records are there.
In that one record is having problem so that from that record
the remaing records are not loading to oracle tables.
Could you please help me to load the remaing records,
after the record which is having problem.
The data is loading using sql*loader
Please help me .
Thanks in advance.

It looks ok!
But it will only work when table HR_DTLS is empty.
If you want to append rows in a non empty table you should change it to
LOAD DATA
INFILE 'c:\test.txt'
APPEND
INTO TABLE hr_dtls
FIELDS TERMINATED BY ','
OPTIONALLY ENCLOSED BY '"'
(sid,sname)
{code}
If you want to define a file for bad records (that can't be insertet for any reasons) you can change it to
{code}
LOAD DATA
INFILE 'c:\test.txt'
BADFILE 'c:\test.bad'
APPEND
INTO TABLE hr_dtls
FIELDS TERMINATED BY ','
OPTIONALLY ENCLOSED BY '"'
(sid,sname)

SQL LOADER LPAD CONTROL FILE QUESTION

Hi, inthe flat file
company_cd is "1" or "01"
and center_cd is 3 digits... ex: "493"
in the table the userid coulmn should be 6 digits
currently i am getting this as userid in the table
"010493" is right, because company_cd is "01"
"10493" is not right, because company_cd is "1"
if company_cd is 2 digits(01) i am getting 6 digits userid which is OK
but when company_cd is singile digit(1) i am getting 5 digits userid
I NEED TO LPAD with 0 in the front when company_cd is "1"any suggetions ???????
***********This is the code i am using currently in the CTL file for userid**********
,USERID "CONCAT(substr(trim(:company_cd),1,2),lpad(trim(:center_cd),4,0))"
.......Thank You..........
Edited by: phani_Marella on Aug 28, 2012 11:12 AM

Now where does company 'coz' come from all of a sudden?
I'm sure you read {message:id=9360002} , hence my confusion.
Anyway, the SQL*Loader forum is @ Export/Import/SQL Loader & External Tables

Question about 'direct' parameter in sql loader utility

Hi eveyone,
Today I was asked what the advantages and disadvantages of 'direct' parameter of sql loader.
In my opinion, if swithing direct on, oracle use direct path load.
And it has no difference from the append hind in insert statement.
The core merits are less redo hence faster.
The main shortcoming is since little redo generated, we have to ask DBA to back up the data according to the rules immediately after the loading.
Does my answer make sense or not? Plesae help to point out the important things I missed.
best regards,
Leon

Hi,
Direct path Export is much faster than conventional path Export because the data is read from disk into the buffer cache and rows are transferred directly to the Export client.
Some conditions to use DIRECT parameter are,
1. The Export parameter BUFFER applies only to conventional path Exports. For direct path Export, use the RECORDLENGTH parameter to specify the size of the buffer that Export uses for writing to the export file.
2. You cannot use direct path when exporting in tablespace mode (TRANSPORT_TABLESPACES=Y).
3. The QUERY parameter cannot be specified in a direct path Export.
Thanks

Question for SQL Loader / IMP /EXPORT

hi all,
i just describe my example first : -
TABLE A have five columns.
a_column,b_column,c_column,d_column,e_column.
and have 1000 records.
i want to remove c_column & e_column and add f_column.
on TABLE A. which method (SQL Loader or IMP/EXP) is good suggestion for export & import data before take above action.
boris

Export/Import is the most appropiate solution for the task that you want to carry out because SQL*Loader is designed to load data into the database from flat files.
Regarding how to drop the two columns , you can do it
directly if you are working in 9i setting both columns as
unused after drop unused columns in the table.
Complete reference for those utilities:
http://download-uk.oracle.com/docs/cd/B10501_01/server.920/a96652.pdf
Joel P�rez

How can we tell if SQL*Loader is working on a TABLE?

We have a process that requires comparing batches with LDAP information. Instead of using an LDAP lookup tool, we get a nightly directory file, and import the two COLUMNs we want via SQL*Loader (REPLACE) into an IOT. Out of three cases, two just check the first COLUMN, and the third needs the second COLUMN as well.
We did not think of using External TABLEs, because we cannot store files on the DB server itself.
The question arises, what to do while the file is being imported. The file is just under 300M, so it takes a minute or so to replace all the data. We found SQL*Loader waits until a transaction is finished before starting, but a query against the TABLE only waits while it is actually importing the data. At the beginning of SQL*Loader's process, however, a query against the TABLE returns no rows.
The solution we are trying right now is, to have the process that starts SQL*Loader flip a flag in another TABLE denoting that it is unavailable. When it is done, it flips it back, and notes the date. Then, the process that queries the information, exits if the flag is currently 'N'.
The problem, is, what if SQL*Loader starts inbetween the check of the flag, and the query against the TABLE. How do we guarantee that it is still not being imported.
I can think of three solutions:
1) LOCK the ldap information TABLE before checking the flag.
2) LOCK the record that the process starting SQL*Loader flips.
3) Add a clause to the query against the TABLE checks that there are records in the TABLE (AND EXISTS(SELECT * FROM ldap_information).
The problem with 3) is that the process has already tagged the batches (via a COLUMN). It could, technically reset them afterwards, but that seems a bit backwards.

Just out of curiosity, are you aware that Oracle supplies a DBMS_LDAP package for pulling information from LDAP sources? It would obviously be relatively easy to have a single transaction that deletes the existing data, loads the new data via DBMS_LDAP, and commits, which would get around the problem you're having with SQL*Loader truncating the table.
You could also have SQL*Loader load the data into a staging table and then have a second process either MERGE the changes from the staging table into the real table (again in a transactionally consistent manner) or just delete and insert the data.
Justin

How do i map one field to another in control file via SQL Loader

Can someone please reply back to this question
Hi,
I have a flat file (student.dat delimiter %~| ) using control file (student.ctl) through sql loader. Here are the details.
student.dat
student_id, student_firstname, gender, student_lastName, student_newId
101%~|abc%~|F %~|xyz%~|110%~|
Corresponding table
Student (
Student_ID,
Student_FN,
Gender,
Student_LN
Question:
How do i map student_newId field to student_id field in STUDENT DB table so that new id should be inserted in student_id column. How do i specify the mapping in control file. I dont want to create a new column in student table. Please let me know the best way to do this.
Can someone please reply back to this question.
My approach:
In control file i will sepecify the below, Is this a best approach?. Do we have any othe way?
STUDENT_ID *(:STUDENT_NEWID)*,
STUDENT_FN,
GENDER,
STUDENT_LNAME,
STUDENT_NEWID BOUNDFILLER
Thanks
Sunil
Edited by: 993112 on Mar 13, 2013 12:28 AM
Edited by: 993112 on Mar 13, 2013 12:30 AM
Edited by: 993112 on Mar 13, 2013 12:31 AM
Edited by: 993112 on Mar 18, 2013 2:52 AM

OK, ok...
Here is the sample data:
101%~|abc%~|F %~|xyz%~|110%~|
102%~|def%~|M %~|pqr%~|120%~|
103%~|ghi%~|M %~|stu%~|130%~|
104%~|jkl%~|F %~|vwx%~|140%~|
105%~|mno%~|F %~|yza%~|150%~|Here is the control file:
LOAD DATA
INFILE student.dat
TRUNCATE INTO TABLE STUDENT
FIELDS TERMINATED BY '%~|' TRAILING NULLCOLS
student_old FILLER
, student_fn
, gender
, student_ln
, student_id
)And here is the execution:
SQL> CREATE TABLE student
2 (
3    student_id   NUMBER
4 , student_fn   VARCHAR2 (10)
5 , gender       VARCHAR2 (2)
6 , student_ln   VARCHAR2 (10)
7 );
Table created.
SQL>
SQL> !sqlldr / control=student.ctl
SQL*Loader: Release 11.2.0.3.0 - Production on Tue Mar 19 14:37:31 2013
Copyright (c) 1982, 2011, Oracle and/or its affiliates. All rights reserved.
Commit point reached - logical record count 5
SQL> select * from student;
STUDENT_ID STUDENT_FN                     GENDER STUDENT_LN
       110 abc                            F      xyz
       120 def                            M      pqr
       130 ghi                            M      stu
       140 jkl                            F      vwx
       150 mno                            F      yza
SQL>:p

Loading data with sql loader

Hi Experts,
I have a file with the following format. I have to insert the data of those files in a table. I can use SQL Loader to load those files.
My question is I need to schedule the upload of those files. Can i incorporate sql loader in a procedure?
Agent Id|Agent Type|Create Date|Termination CDC|Activation CDC|Deactivation CDC|Agent IdX|Agent Status|Status Date|Status Reason Code|Update CDC|Update Serial|Update User|New Owner Agent Id|Previous Owner Agent Id|Agent Name|Primary Address1|Primary Address2|Primary Address3|Secondary Address1|Secondary Address2|Secondary Address3| Primary City|Primary State|Primary Zip|Primary Zip Suffix|Primary Country|Secondary City|Secondary State|Secondary Zip|Secondary Zip Suffix|Secondary Country|Phone Number|Fax number|Mobile Number|Business Type|Field Rep|Bill to Chain Id|Mon Open Time|Mon Close Time|Tue Open Time|Tue Close Time|Wed Open Time|Wed Close Time|Thu Open Time|Thu Close Time|Fri Open Time|Fri Close Time|Sat Open Time|Sat Close Time|Sun Open Time|Sun Close Time|Zone Id|Line Charge Class|Chain Id|Chain Code| Primary Contact Name| Primary Contact Title| Primary Contact Phone|Secondary Contact Name|Secondary Contact Title|Secondary Contact Phone|Tertiary contact Name|Tertiary Contact Title|Tertiary Contact Phone| Bank Id| Bank Account Id| bank Account Type| Bank Account Date| EFT Flag| Fund Limit|Invoicable|TaxCode|Tax Id|Sales Tax|Service Charge|Instant Cashing Type|Instant Telsel Rep| Instant Number of Bins| Instant Number Itvms| InstantCredit Limit|Auto Reorder| Instant Terminal Reorder| Instant Telsel Reorder| Instant Teleset Active CDC| Instant Initial Distribution|Auto Telsel Schedule| Instant Auto Settle| Instant Call Day| Instant Call Week| Instant Call Cycle| Instant Order Restriction| Instant Delivery Flag| Instant Account Type| Instant Settle Class| Region|County|Territory|Route|Chain Statement|Master Agent Id| Minority Owned| Tax Name| State Tax Id|Mailing Name| Bank Account Name| DSR
0|1|0|0|0|0|0|1|0|0|302|0|0|0|0|||||||||||||||||||||0|0|0|||||||||||||||0|0|0|||||||||||||0|-2145916800|0|0|0|0||0|0|0|0|0|0|0|0|0|0|0|0|0|0|1|0|0|0|0|0|0|0|0|0||0|0|0|||||
1|1|1256213087|0|-39081|-39081|1|2|1256213087|999|302|0|0|0|0|Pseudo Outlet||||||||MU|||MU||MU|||MU||||0|0|1|06:00|23:59|06:00|23:59|06:00|23:59|06:00|23:59|06:00|23:59|06:00|23:59|06:00|23:59|0|0|0|||||||||||||
{code)
Edited by: Kevin CK on 02-Feb-2010 03:28

Yes sorry about that mishap
Agent Id|Agent Type|Create Date|Termination CDC|Activation CDC|Deactivation CDC|Agent IdX|Agent Status|Status Date|Status Reason Code|Update CDC|Update Serial|Update User|New Owner Agent Id|Previous Owner Agent Id|Agent Name|Primary Address1|Primary Address2|Primary Address3|Secondary Address1|Secondary Address2|Secondary Address3| Primary City|Primary State|Primary Zip|Primary Zip Suffix|Primary Country|Secondary City|Secondary State|Secondary Zip|Secondary Zip Suffix|Secondary Country|Phone Number|Fax number|Mobile Number|Business Type|Field Rep|Bill to Chain Id|Mon Open Time|Mon Close Time|Tue Open Time|Tue Close Time|Wed Open Time|Wed Close Time|Thu Open Time|Thu Close Time|Fri Open Time|Fri Close Time|Sat Open Time|Sat Close Time|Sun Open Time|Sun Close Time|Zone Id|Line Charge Class|Chain Id|Chain Code| Primary Contact Name| Primary Contact Title| Primary Contact Phone|Secondary Contact Name|Secondary Contact Title|Secondary Contact Phone|Tertiary contact Name|Tertiary Contact Title|Tertiary Contact Phone| Bank Id| Bank Account Id| bank Account Type| Bank Account Date| EFT Flag| Fund Limit|Invoicable|TaxCode|Tax Id|Sales Tax|Service Charge|Instant Cashing Type|Instant Telsel Rep| Instant Number of Bins| Instant Number Itvms| InstantCredit Limit|Auto Reorder| Instant Terminal Reorder| Instant Telsel Reorder| Instant Teleset Active CDC| Instant Initial Distribution|Auto Telsel Schedule| Instant Auto Settle| Instant Call Day| Instant Call Week| Instant Call Cycle| Instant Order Restriction| Instant Delivery Flag| Instant Account Type| Instant Settle Class| Region|County|Territory|Route|Chain Statement|Master Agent Id| Minority Owned| Tax Name| State Tax Id|Mailing Name| Bank Account Name| DSR
0|1|0|0|0|0|0|1|0|0|302|0|0|0|0|||||||||||||||||||||0|0|0|||||||||||||||0|0|0|||||||||||||0|-2145916800|0|0|0|0||0|0|0|0|0|0|0|0|0|0|0|0|0|0|1|0|0|0|0|0|0|0|0|0||0|0|0|||||
1|1|1256213087|0|-39081|-39081|1|2|1256213087|999|302|0|0|0|0|Pseudo Outlet||||||||MU|||MU||MU|||MU||||0|0|1|06:00|23:59|06:00|23:59|06:00|23:59|06:00|23:59|06:00|23:59|06:00|23:59|06:00|23:59|0|0|0|||||||||||||1|-2145916800|1|0|1|0||0|0|0|0|0|0|0|0|0|0|-3287|0|0|0|1|1|2|0|0|0|1|0|999|0||5|0|0|||||This is my file format which is a .txt file

Error in loading data using SQL loader

I am getting a error like ‘SQL*Loader -350 syntax error of illegal combination of non-alphanumeric characters’ while loading a file using SQL loader in RHEL. The command used to run SQL*Loader is:
Sqlldr userid=<username>/<password> control =data.ctl
The control file, data.ctl is :
LOAD data
infile '/home/oraprod/data.txt'
append into table test
empid terminated by ',',
fname terminated by ',',
lname terminated by ',',
salary terminated by whitespace
The data.txt file is:
1,Kaushal,halani,5000
2,Chetan,halani,1000
I hope, my question is clear.
Please revert with the reply to my query.
Regards

Replace ''{" by "(" in your control file
LOAD data
infile 'c:\data.txt'
append into table emp_t
empid terminated by ',',
fname terminated by ',',
lname terminated by ',',
salary terminated by whitespace
C:\>sqlldr user/pwd@database control=c.ctl
SQL*Loader: Release 10.2.0.3.0 - Production on Wed Nov 13 10:10:24 2013
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Commit point reached - logical record count 1
Commit point reached - logical record count 2
SQL> select * from emp_t;
     EMPID FNAME                LNAME                    SALARY
         1 Kaushal              halani                     5000
         2 Chetan               halani                     1000
Best regards
Mohamed Houri

SQL Loader newbie's question.

Similar Messages

Maybe you are looking for