Conversion of csv in flat file to oracle table format
hi friends
I have written a C code for conversion of flat file data to Comma seperated values
Now i have to put this .csv file into oracle tables.
Please suggest me a solution to this so that i can put this values into oracle tables
Regards,
Mahesh
You can use Sql*Loader (sqlldr) :
TEST@db102 SQL> create table test (a varchar2(30), b varchar2(30), c varchar2(30));
Table created.
TEST@db102 SQL> exit
Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - Production
With the Partitioning, OLAP and Data Mining options
$ cat test.csv
aaa,bbb,ccc
ddd,eee,fff
111,222,333
$ cat test.ctl
load data
infile 'test.csv'
replace into table test
fields terminated by ','
(a char, b char, c char)
$ sqlldr test/test control=test.ctl
SQL*Loader: Release 10.2.0.1.0 - Production on Wed Mar 8 15:42:42 2006
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Commit point reached - logical record count 3
$ sqlplus test/test
SQL*Plus: Release 10.2.0.1.0 - Production on Wed Mar 8 15:42:48 2006
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - Production
With the Partitioning, OLAP and Data Mining options
TEST@db102 SQL> select * from test;
A B C
aaa bbb ccc
ddd eee fff
111 222 333
TEST@db102 SQL> But probably there's no need to convert the flat file to csv...
Similar Messages
-
Conversion of white spaced flat file to oracle table format
hello friends
I have found out that SQL*Loader can load data from .txt format into table format in oracle.
Please if anynone can provide me with the syntax for conversion of white spaced data in text format would be of great help
Regards,
-MaheshThe utilities guide provides some sample cases.
Just change the field terminator and adjust the field definitions
http://download-west.oracle.com/docs/cd/B10501_01/server.920/a96652/ch10.htm#1006689 -
Conversion of fixed length flat files to oracle table
hello friends
Please help me getting the code for conversion of fixed length flat files to oracle table
Should the tables be pre-defined ?????
In this case the de-limiters are variable length spaces and not commas.Please help me with the same
Regards,
-MaheshYou can use SQL*Loader to load fixed-width files into Oracle. Instructions on writing appropriate control files are in the Oracle Utilities manual
http://download-west.oracle.com/docs/cd/B10501_01/server.920/a96652/ch03.htm#1004687
You can also use external tables, assuming you're using 9i or later (the syntax for external table definitions is nearly identical to the syntax for SQL*Loader control files).
You'll need to create a table definition in Oracle. You can either create a "normal" table and use SQL*Loader to populate it or you can create an external table definition.
Justin -
Extracting a flat file from oracle table
I have moved the knowledge module KIM ISO SQL to FileAppend from the Metadata to my project folder.
But when I create an interface mapping the oracle table and a flat file on a different unix server, in the drop down menu , it shows only KIM SQL TO SQL and KIM Control Append.It does not show up the SQL to FileAppend knowledge module option.
What should I do to extract a flat file from oracle table?
Thanks
Hima
Overstock.comAll IKM in the Drop Down Menu are dependent of the target technology.
A question, at this interface, is your target table a file ? -
Map FLAT file to oracle table using 9.04 version - PLS HELP!!!!
Hello all
I am having a problem with mapping a flat file to oracle table. The validation is successful, when I go to Project/Deployment manager. Try to deploy the mapping itself and the target table. It said succesful, and the last step is another "Deploy", this one is fail. Saying could not locate the file (which is a flat file) , but it is there on the server.
I have read all the help on line and follow what they show me, but still not work
Any ideas? Please provide detail answer if you know it.
Thank in advanceHallo,
just give a rights on connector
Variant 1
1. connect to user sys
2. grant read,write on directory <connector_name> to <target_schema>;
or
Variant 2
1. as user sys or system give CREATE_ANY_DIRECTORY to <target_schema>
2. manualy make CREATE DIRECTORY <connector_name> as '<full_path_to_directory>';
and enjoy :)
PS: <connector_name> you can take from script CREATE_TABLE wisch in Generation phase was created!
Kirill -
OWB - Flat file to oracle table
Second message, please read.
OS- Microsoft windows 2000 5.00.2195 Service Pack 2
OWB client---9.0.3.33.0
OWB Repository--9.0.3.0.1
Database--oracle 9i Enterprise Edition 9.0.1.3.1 with the partioning option Jserver Release9.0.1.3.0
OEM--9.0.1.0.0
I have created mapping between the source(flat file)and target(oracle)using Oracle Warehouse Builder. Mapping was validated, configured and it successfully generated without errors. The ‘Deploy’ button and the ‘Run’ button are disabled. How can I run/deploy this mapping ?
The above OWB copy was downloaded from the Oracle corp website. Is this version an evaluation copy? Alternatively Is this a beta copy ?
Please help.Dear All,
I have a problem with loading flat files to oracle tables using OWB 9.2
i created a map with my flat file as a source and my oracle table as a target,and i created a connector between the target location and the flat file location.And i deployed the connector and registered the flat file location using my PC information and the path of the files on my pc.
I generated the map and saved the .ctl file and deployed the map,and hence trying to load the ctl file using the sql loader as the following:
C:\Documents and Settings\CORAL 2000>sqlldr owb_rt_rep/owb_rt_rep@ofsa
control = D:\oracle2\ofsa\owb\codegen\BM_DEBIT_CARDS_DAT_MAP.ctl
---where owb_rt_rep is my runtime repository user.
I got the following error:
SQL*Loader-350: Syntax error at line 18.
Expecting "(", found ".".
INTO TABLE "{{TRG_LOC1.Schema}}"."BM_DEBIT_CARDS_DAT"
--where trg_loc1 is my target location and bm_debit_cards_dat is my target table.
I tried to grant from the target schema the privelages to the runtime user incase its the problem,but still it didn't work.
Any ideas??
Dina Nagia
Message was edited by:
Dina Nagia -
Create flat file from oracle table data
d_adp_num char(10)
d_schd_date char(8)
d_sched_code char(25)
d_pay_code char(50)
d_mil_start char(4)
d_mil_end char(4)
d_duration char(5)
d_site_code char(4)
d_dept_id char(6)
select payroll_id,
schedule_date,
reason_code ,(sched_code)
reason_code, (pay_code)
start_time,
end_time,
total_hours,
site_code,
department_id
from dept_staff
where schedule_date between (sysdate+1) and (sysdate+90)
loading some data instead for the date range.
sched_code - 'Unavailable' if reason_code = 'OD' and 'LA'
pay_code - 'BD Berevevement' if reason_code = 'BD'
'UP Unexcused PTO' if reason_code = 'UP'
'RG' if reason_code = 'SH'
'PTO' if reason_code = 'VA'
these are a few.....
start_time and end_time - convert into military time
based on start_ampm and end_ampm
Based on this, I need help to create a flat file. Attaching sample of flat file and data from dept_staff
If site_code is there then no need to get department_id( see sample flat file)
sample data for flat file
ZZW002324006072012 PTO
0800160008.00
ZZW002428106072012 RG
1015174507.50HM34
ZZW002391606072012 RG
1100193008.50
ZZW002430406072012 RG
1100193008.50 130000
dept_staff table data
PAYROLL_ID SCHEDULE_DATE REASON_CODE REASON_CODE_1 START_TIME START_AMPM END_TIME END_AMPM TOTAL_HOURS SITE_CODE DEPARTMENT_ID
ZZW0024468 6/8/2012 SH SH 730 A 400 P 850 12
ZZW0000199 6/8/2012 SH SH 730 A 400 P 850 14
ZZW0023551 6/8/2012 SH SH 1145 A 930 P 975 GH08 95
ZZW0024460 6/8/2012 SH SH 515 A 330 P 1025 GH08 95
ZZW0023787 6/8/2012 SH SH 630 A 300 P 850 24
ZZW0024595 6/8/2012 TR TR 730 A 400 P 850 90
ZZW0023516 6/8/2012 OD OD 800 A 400 P 800 95
ZZW0023784 6/8/2012 OD OD 800 A 400 P 800 5
ZZW0024445 6/8/2012 SH SH 1145 A 930 P 975 GH08 5
ZZW0024525 6/8/2012 OD OD 800 A 400 P 800 23
ZZW0024592 6/8/2012 TR TR 730 A 400 P 850 5
ZZW0024509 6/8/2012 SH SH 830 A 330 P 700 MK21 95
ZZW0023916 6/14/2012 SH SH 1100 A 730 P 850 27user_anumoses wrote:
Any examples, please provide? Thankshttp://www.lmgtfy.com/?q=oracle+utl_file+example
Handle: user_anumoses
Status Level: Newbie
Registered: Jun 9, 2009
Total Posts: 155
Total Questions: 60 (55 unresolved)
why so MANY unanswered questions? -
SSIS - Exporting Data into flat files from Oracle Table as batchwise process
Hi All,
Thanks in advance.
I have a Large Table in Oracle Database with some 3 Lakhs record. I need to fetch the 10,000 records for every iteration and export it into the flat file. This process should occur recursively until the table becomes empty.
Hence, For every iteration on flat file to be generated with 10,000 records.
Please help how to proceed further in SSIS.
Thanks
Pyarajan.SYes, it always helps if your question doesn't specify the actual requirements...
Use the FOR loop container to control the iterations of the data flow. For each run you read 10,000 rows from the table and dump them in a flat file. Either move the flat file, or use an expression on the flat file connection manager to give them dynamic
file names.
30 million rows is also not a problem by the way, it just takes a bit longer.
MCSE SQL Server 2012 - Please mark posts as answered where appropriate. -
Problem to Load the data Flat file to Oracle table on Linux Machine
hi,
when i change the path of source flat file from windows to Linux machine. Now it gives the error. Basicalyy this file will load the files names into Oracle table. but in windows path its fine. All things r running fine in Linux. when i run the interface it gives this>>>>>>>>
SQL*Loader: Release 11.2.0.1.0 - Production on Wed Dec 19 16:40:16 2012
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
SQL*Loader-704: Internal error: ulconnect: OCIServerAttach [0]
ORA-12162: TNS:net service name is incorrectly specified
Thanks
Regards,
Edited by: AMSI on Dec 19, 2012 6:01 AMI assume you're using the "LKM file to Oracle SQL Loader".
For test purpose, can you just try with "LKM file to SQL" (slower) ?
We could check if the problem comes from the SQL Loader.
Your unix server has access to the oracle database ? -
Sending data from flat file or oracle table view to a IBM MQ
Hi,
We need a help in developing solution.
We have a scenario, where data(multiple records) in source (table/file) needs to populated into a queue(JMS IBM MQ) as a single message. To achieve this we are trying a two step process.
1) We created a temp table to store multiple records from file, this temp table is having one column of *‘clob’* data-type which will store data from file into a single row. We are facing issue while loading data from file to staging area using LKM FILE TO ORACLE (SQLLDR)
When we are executing interface, while creating C$ table it is going error out . Instead of taking clob (target write data type) it is taking varchar with +5000+ size whereas varchar supports only *4000*.
create table SNPM.C$_0SINGLERECORD
C1_C1 VARCHAR2(5000) NULL
NOLOGGING
Error message:
910 : 42000 : java.sql.SQLException: ORA-00910: specified length too long for its datatype
java.sql.SQLException: ORA-00910: specified length too long for its datatype
Need help in sending data into destination table.
2) After populating this data into destination(temp table) as a single record we need to send each row as a single message to JMS MQ. currently we are using LKM FILE to SQL to load into Staging area and IKM SQL TO JMS APPEND to put message in JMS MQ. We are succeeding in putting message of length < 4000 as these KMs are converting the data using varchar2, but we have data of large size+(>4K)+.
Pointer/ solution will be of great help.
Please let me know in case you need more description.The error message that is showing while using clob as datatype(which we created as user data type in data types section of respective technology)
java.lang.NumberFormatException: For input string: "4294967295"
at java.lang.NumberFormatException.forInputString(Unknown Source)
at java.lang.Integer.parseInt(Unknown Source)
while using varchar2 in creating C$ table following is the error:
910 : 42000 : java.sql.SQLException: ORA-00910: specified length too long for its datatype
java.sql.SQLException: ORA-00910: specified length too long for its datatype
at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:125)
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:316) -
Loading Date fields from flat file to Oracle tables
Hi,
I have a flat file with a few date columns. I have given the format for the date field while creating the data store for the flat file. The format I used is 'YYYY-MM-DD'.
But I get an error when I execute it after associating the module with LKM & IKM.
The error message is as follows:
org.apache.bsf.BSFException: exception from Jython: Traceback (innermost last):
File "<string>", line 3, in ?
OS command has signalled errors
Can anyone help me out.
ThanksAt the time of DataStore creation. You take that date field as string.
After this, in interface, when you map this date field with table field. You should use CONVERT(<field name>,DATE) in expression editor. -
ODI error while loading data from Flat File to oracle
Hi Gurus,
I am getting following error while loading flat file to oracle table :
ava.lang.NumberFormatException: 554020
at java.math.BigInteger.parseInt(Unknown Source)
at java.math.BigInteger.<init>(Unknown Source)
at java.math.BigDecimal.<init>(Unknown Source)
at com.sunopsis.sql.SnpsQuery.updateExecStatement(SnpsQuery.java)
at com.sunopsis.sql.SnpsQuery.addBatch(SnpsQuery.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execCollOrders(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSqlC.treatTaskTrt(SnpSessTaskSqlC.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
The connections between source and target is fine.
Kindly suggest on this error.
Thanks
ShridharHi John,
The source is csv file. By default all columns are string type.The integration is failing at step 3 ( load Data).
I am loading the data from csv file directly to staging table( oracle ).Its one to one mapping.
Shridhar -
MAPPING FLAT FILE TO ORACLE ERROR!! Please help
hello all
I am using OWB on Oracle9i.
Trying to map flat file (file.txt) to oracle table,
Validate: okey, some warning
Generate/Deploy: successful.
But when I check to the database sqlplus there is no rows existed. I verify that I connect to the right database.
My question is:
When doing a map from flat file to oracle table. Do I have to have some thing in the middle such as (filter, join) or I just can do a straight mapping if I don't have any condition to filter out.
Please response if you know the answer.
Your answer greatly appreciated. Thank you for your help
Regards,If you are using an OWB version which is 9.0.3.x or earlier, to load a flat file into the database, you should generate SQL loader files and run them either manually or by using a scheduler.
The new version (9.0.4) supports external tables, so you don't have to use SQL loader. Please refer to the user manual for more details.
Regards:
Igor -
Flat file to Oracle Database - Invalid Month
Hi All
I am New to XI and trying to create a simple interface between Legacy system (flat file) and Oracle database.
I have some date fields in the Oracle table.
When i run the interface it says "invalid month" with some SQL exception number.
I am using (mm/dd/yyyy) format for the date.
Is there any conversion i need to do. I am using XML SQL format for Oracle database.
Any help is appreciated.
Thanks
NagakishoreHello,
Oracle is very picky with the way date is stored. Assume that you have a field datefield that you need to save. In mapping add an attribute hasqQuote and set it to "NO". When mapping the value to the node use to_date as shown below.
<DateField hasQuot="No">
TO_DATE("2004-07-20", "yyyy-mm-dd hh:mi:ss")</DateField>
cheers,
Naveen -
Load flat file into oracle with SQL Loader
Hi All,
Oracle 9i
I want to load flat file into oracle with the help of sqlloader but I want to skip some columns from flat file.
Can anyone tell me how can we skip column from flat file , I can’t open flat file into excel as CSV due to large volume
Does anyone has any solution for the same.
Umesh GoelFiller can be use when we want to skip database table column or we want to put null in database table column
but if we have 10 column in flat file and we want to load 1,2,5,7 number column from flat file
then I think filler will not work
If yes then plz let me know.
thx
UG
Maybe you are looking for
-
Can someone help me change the line width of my numbers table, its not set to thin or none and its stuck on pt25. its a spreadsheet i imported from excel.
-
I've been having an intermittent problem for some time now with my MacBook Pro keyboard. The "p", "0" and _ keys will suddenly stop working. Sometimes I can fix the problem by opening TextEdit and typing in the the text window. Sometimes it seems to
-
Hi! I have a problem with purchase! when I open AppStore on my iPhone 4S and open purchases, there is nothing! I open TOP chart and there nothing too! This problem begins then I upgrade to iOS7.0! What can I do to resolve the ptobblem? P.S.: sorry fo
-
E66: "press unlock to activate keypad" issue
hi, i've been using the phone for a few months now and i noticed recently that sometimes,when i lock the keypad, i get the "press unlock to activate keypad" message, on and on, without me touching any buttons at all. It just keeps appearing very r
-
hi. Radhat 6.0 in Oracle 8.0.5.1pathch in used.. and installing OWS 4.0.7 Error Message Error during action Relinking executable dbsnmp... I want to way Error? and complete install. help! null