SQL*Loader importing problem, with file with eastern european files

Hello,
on Oracle 11g with UTF-8 encoding, I tried to import a csv file into a table via sqlload, the separator is the semicolon ";" all work fine except for some lines witch are not well integrated (the concerned files come from Eastern European countries like Bulgary, Hungary and Czech Republic).
For example:
For:
text_1; text_2; text_with_char_at_end_like_š; new_text
during the integration instead of have:
| text_1 | text_2 | text_with_char_at_end_like_š| new_text |
I got:
| text_1 | text_2 | text_with_char_at_end_like_š; new_text | null |
does anyone has this problem, I tried to change the delimiter by code X'59', specified in sqlldr ENCODING UTF8 ... but it does not work
do you have an idea about this problem
Thank you in advance

Thanks,
the problem was solved since, the file was not in UTF8 format (for example GREEK FORMAT) and the NLS_LANG was AMERICAN_AMERICA ASCII
then i translate all files to UTF 8 and changed the NLS_LANG to UtF8.
Regards

Similar Messages

SQL*Loader Import Problem

Hi,
I am trying to import some data from .txt file to a table in Oracle DB using TOAD- Sql*Loader - Import wizard. I was able to load all the files successfully. All the files are pipe(|) delimited. But in one of the files, when the values for the field is NULL - it is populated as ' ' (space), I have trouble in loading these files.
Suppose I have the fields f1, f2, f3, f4 in the .txt file. And say I have the data as following (and delimter as pipe(|)):
f1 f2 f3 f4 f5
r1|01|xyz|123|abc
r2|02| |234|bcd * 3rd column being null(space)
r3| |sam|345|def * 2nd field being null(space)
|04|ram|456|efg * 1st field being null(space)
|05|abc|567|gef * 1st column being null
I have problems loading the records 4,5 using Sql*loader, as the first field being null, the data is not being loaded properly. Is there any alternative way of loading this file into my table. Please help me.

Pl post OS and database versions, along with the contents of the loader control file and the loader log file with the errors.
http://docs.oracle.com/cd/E11882_01/server.112/e22490/ldr_field_list.htm#i1009544
HTH
Srini

Problem with SQL*Loader and different date formats in the same file

DB: Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bi
System: AIX 5.3.0.0
Hello,
I'm using SQL*Loader to import semi-colon separated values into a table. The files are delivered to us by a data provider who concatenates data from different sources and this results in us having different date formats within the same file. For example:
...;2010-12-31;22/11/1932;...
I load this data using the following lines in the control file:
EXECUTIONDATE1 TIMESTAMP NULLIF EXECUTIONDATE1=BLANKS "TO_DATE(:EXECUTIONDATE1, 'YYYY-MM-DD')",
DELDOB TIMESTAMP NULLIF DELDOB=BLANKS "TO_DATE(:DELDOB, 'DD/MM/YYYY')",
The relevant NLS parameters:
NLS_LANGUAGE=FRENCH
NLS_DATE_FORMAT=DD/MM/RR
NLS_DATE_LANGUAGE=FRENCH
If I load this file as is the values loaded into the table are 31 dec 2010 and 22 nov *2032*, aven though the years are on 4 digits. If I change the NLS_DATE_FORMAT to DD/MM/YYYY then the second date value will be loaded correctly, but the first value will be loaded as 31 dec *2020* !!
How can I get both date values to load correctly?
Thanks!
Sylvain

This is very strange, after running a few tests I realized that if the year is 19XX then it will get loaded as 2019, and if it is 20XX then it will be 2020. I'm guessing it may have something to do with certain env variables that aren't set up properly because I'm fairly sure my SQL*Loader control file is correct... I'll run more tests :-(

Sql loader performance problem with xml

Hi,
i have to load a 400 mb big xml file into mz local machine's free oracle db
i have tested a one record xml and was able to load succesfully, but 400 mb freeying for half an hour and does not even started?
it is normal? is there any chance i will be able to load it, just need to wait?
are there any faster solution?
i ahve created a table below
CREATE TABLE test_xml
COL_ID VARCHAR2(1000),
IN_FILE XMLTYPE
XMLTYPE IN_FILE STORE AS CLOB
and control file below
LOAD DATA
CHARACTERSET UTF8
INFILE 'test.xml'
APPEND
INTO TABLE product_xml
col_id filler CHAR (1000),
in_file LOBFILE(CONSTANT "test.xml") TERMINATED BY EOF
anything i am doing wrong? thanks for advices

SQL*Loader: Release 11.2.0.2.0 - Production on H. Febr. 11 18:57:09 2013
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
Control File: prodxml.ctl
Character Set UTF8 specified for all input.
Data File: test.xml
Bad File: test.bad
Discard File: none specified
(Allow all discards)
Number to load: ALL
Number to skip: 0
Errors allowed: 5000
Bind array: 64 rows, maximum of 256000 bytes
Continuation: none specified
Path used: Conventional
Table PRODUCT_XML, loaded from every logical record.
Insert option in effect for this table: APPEND
Column Name Position Len Term Encl Datatype
COL_ID FIRST 1000 CHARACTER
(FILLER FIELD)
IN_FILE DERIVED * EOF CHARACTER
Static LOBFILE. Filename is bv_test.xml
Character Set UTF8 specified for all input.
SQL*Loader-605: Non-data dependent ORACLE error occurred -- load discontinued.
ORA-01652: unable to extend temp segment by 128 in tablespace TEMP
Table PRODUCT_XML:
0 Rows successfully loaded.
0 Rows not loaded due to data errors.
0 Rows not loaded because all WHEN clauses were failed.
0 Rows not loaded because all fields were null.
Space allocated for bind array: 256 bytes(64 rows)
Read buffer bytes: 1048576
Total logical records skipped: 0
Total logical records rejected: 0
Total logical records discarded: 0
Run began on H. Febr. 11 18:57:09 2013
Run ended on H. Febr. 11 19:20:54 2013
Elapsed time was: 00:23:45.76
CPU time was: 00:05:05.50
this is the log
i have truncated everything i am not able to load 400 mega into 4 giga i cannot understand
windows is not licensed 32 bit

LR3.2 import problem on computer with Windows OS

LR3.2 import problem on Windows OS
This is a continuation of a question that I posed on August 22, 2010 in the discussion string "Cannot import CR2". I have not been able to resolve the issue of importing an image into an existing folder location. I had not been able to work on this issue for a number of weeks due to other circumstances, until today.   Note that the following people had attempted to provide answers and suggestions already: ssprengel, JayS In CT.
I use a laptop with a Windows operating system and a Macintosh desktop with Snow Leopard. I run Lightroom on both of them. The Windows laptop has Windows Vista Home service pack 2, version 6.0 [6002]. Around August 12th I upgraded from Lightroom 2 [481478], to Lightroom 3 on the laptop. I left the LR2 on the laptop as well as LR3. On September 12th I upgraded the laptop to LR3.2. No other changes have been to the laptop or its software applications that I know of.
My current attempts at resolving the issue reveal that when I created a new catalog "Test Catalog" in LR3 and saved that catalog to my desktop new folder labeled "Test Catalog" that I can import an image into LR3.2 to a new folder on the laptop's desktop. I then deleted the images via LR3.2 Folders Remove function and tried to import the images into an existing folder as presented in the LR3.2 Import dialog, but get the error message "The following files were not imported because they could not be read.".   When I import images into a new folder placed on the desktop, I can use all functions in LR3 e.g. Develop module. I cannot import images into existing folders on the laptop's hard drive - I have tried importing into the entire existing folders in the following hierarchy: c:\users\Michael\My Documents\My Pictures\2010 but always get the same error message.
LR3.2 does correctly backups upon exiting each time I quit the program, so I know that there isn't any issue of writing to that backup folder which is contained in an upper folder that contains the lightroom catalogs. I have even created a new Word file, saved it into the folder with Lightroom catalogs, opened it up, modified it, saved it, and saw that it works OK, so that tells me there is no problem with a Read-Only folder attribute.
I cannot recall if upon the upgrade from LR2.6 to LR3 that I chose to upgrade the catalog to LR3 version. Would that matter, if yes, what do I verify, how do I manual upgrade the catalog.
History of actions between August 10th that I have taken follows between the [[[[ and ]]]]:
[[[[Preference settings for Default Catalog are set to start with a specific catalog that I call "Lightroom master catalog", it is not set to the "Load most recent catalog".
All of the following were using my laptop: Previously I had no problem with LR2 for any functions. I just purchased an Epson 7000 media storage device, and in early August and practiced importing images into LR2, and those images were pulled in OK. Next, I upgraded to LR3. I discovered that the Epson's images had been placed into a wrong folder when I opened LR3. I used the remapping function in LR3 to move the images into the correct folder. Next, I used a SanDisk card reader to import images into LR3 into an existing folder of images, but the following error message appeared "the following files were not imported because they could not be read" (Import Results said 'some import operations were not performed'). I tried importing a single image, and multiple images, but had the same error. I tried switching the card reader to each of 4 different USB port on the laptop, with the same error occurring on each USB port used.
In order to try to isolate the problem. I took the SanDisk card reader with the memory card and successfully imported the images into LR3 on my Macintosh desktop computer; so to me the problem is not the card reader or the memory card. I also used the SanDisk recovery disk while using my laptop to look at the files on the memory card and I could see all the images correctly while in the recovery program, but I have not copied the images to the laptop's hard disk, and have not tried an import into the laptop's LR3. I did not import images directly from my camera to the laptop LR3 since I did not think it would help with the troubleshooting.
I then ran the Repair from the Adobe LR3 CD upgrade disk, on my laptop. Then I tried doing the import using the SanDisk reader and memory card, but the same problem occurred and same error message, that the files could not be imported (I was trying to import into a folder of existing images). I then used the Laptop's Control Panel function to remove LR3 application. Then I did a fresh upgrade of LR3 on my laptop, but the same error message and I am unable to do any import of the memory card from the card reader. I then tried to do an image import from the Epson 7000 into the laptop, and the same error message and I am unable to do any import into a folder with existing images.   I then tried doing an image import into LR2 on the laptop, and got the same problem to occur when trying to import into an existing folder of images. I have a couple of Canon EOS SLR digital cameras, and the issue occurs for any of the file types of the cameras.
Went into LR3 Preferences, General Tab, I now checked the previously unchecked box for Import Options - "Show import dialog when a memory card is detected".
Connected the Canon XTi directly with a cable to the laptop computer. Note that Canon's information said that Picture Transfer Protocol is automatically used when the XTi is directly connected to a computer, so I did not need to change anything in the camera's menu for communications choices (there is no communication menu in fact). I selected one image and copied it to the laptop desktop. Tried to import it into LR3 into a folder of existing images but got the error message "Could not copy a file to the requested location." While in LR3, I changed the location of where the file would be copied into - any of my existing folders of images; tried 5 different folders, but kept getting the same error message.
With the card reader connected via USB port on the laptop, I copied one image file to the desktop, and then tried importing into LR3 into a folder of existing images. Got the error message "Could not copy a file to the requested location."]]]]

I am not clear if by 'import' you are trying to copy or move the files from a location to another or if you are adding the files to a catalog. My comments may not, therefore, be too helpful.
Firstly, with both LR2 and LR3 installed you will have both catalogs present, but if you try to open the LR2 catalog with LR3 you will be prompted to update the catalog. You will thus know which catalog you are working on.
Secondly, if you are reading direct from the camera, you should connect using the 'PC connection' mode.
Thirdly, there is an issue with reading .CR2 files directly from the early Canon DSLRs (in Europe named 300D, 350D, 400D). While they are visible with the Canon software, they can not be seen with Windows explorer nor can they be accessed with Lightroom.
I suggest that you take the CF card out of the camera and copy the files using Windows Explorer in to the destination folder. You are then sure that the files are on the PC.
If you have the right Codec installed, you can view them with Windows photo gallery; if you don't, you can use one of the Canon software packages to view the files. You are then sure that the files are not corrupted.
Then import the files to your LR catalog using the normal import routine selecting 'add without moving'. I have tried this routine successfully using my 350D using both LR1.x and LR3.x. If that doesn't work - I'm lost.
Frank

SQL Loader / WHEN clause / swich off? / bloated log files

Hallo everyone,
I am loading data from very large source files using SQL-Loader. This all works fine.
However, now, using the WHEN clause (in the control file), I would like to load only a very restricted sub-set of the main data. This also works fine ...
WHEN ARTICLECODE != '000000000000006769'
However, the log file becomes completely bloated with messages telling me of each record which has failed the WHEN clause ...
Record 55078: Discarded - failed all WHEN clauses.
This is becoming a problem because it slows down the process and creates bloated log files which are eating up my disk-space.
There must be a simple command to allow me to switch off thiese messages but, although I have googled on it, I haven't managed to find it.
Any ideas on this one? I'm sure it's simple.
Regards and many thanks,
Alan Searle

Try to add key SILENT=DISCARDS to sqlldr command
Silent means - Suppress messages during run (header,feedback,errors,discards,partitions)

SQL loader import issue..

Hi,
I am working on 10g database on ibm AIX ..
i need to use sql loader and insert some data in to table using a input file.
The input file contains follwing format..- data.dat
001 901 200 1611196 "dis
ltype
gu" Mhamicddu kuasa 12as king
all these values are tab deliminated and one column value "disltypegu" is enclosed by " " and in next line. This "disltypegu" shuld be inserted in to one column.
I am using following control file..
LOAD DATA
INFILE '/home/oracle/data.dat'
INSERT INTO TABLE emp
(e1,e2,e3,e4,e5,e6,e7,e8,e9)
any idea ...wht all things i need to include in my control file to perform this insert...
I am using below control file ..
LOAD DATA
INFILE '/home/oracle/data1.csv'
APPEND
INTO TABLE emp
FIELDS TERMINATED BY X'09'
OPTIONALLY ENCLOSED BY '"'
TRAILING NULLCOLS
(ename,edd,emob)
By using this control file , we can import tab delemenated and enclosed by "" column ...it is working ..
Only thing is if some column data is in next row , it is treating it as a second row and inserting in to new row..
How to insert data in to one row..
This is my data file ... with 3 column values .. ( ename -Robin , edd - Address , emob - 13)
Robin "Address"
13
but it is inserting emob value (13) in ename ...like next line as a new row...

oradba11 wrote:
Hi,
I am working on 10g database on ibm AIX ..
i need to use sql loader and insert some data in to table using a input file.
The input file contains follwing format..- data.dat
001 901 200 1611196 "dis
ltype
gu" Mhamicddu kuasa 12as king
all these values are tab deliminated and one column value "disltypegu" is enclosed by " " and in next line. This "disltypegu" shuld be inserted in to one column.
I am using following control file..
LOAD DATA
INFILE '/home/oracle/data.dat'
INSERT INTO TABLE emp
(e1,e2,e3,e4,e5,e6,e7,e8,e9)
any idea ...wht all things i need to include in my control file to perform this insert...
I am using below control file ..
LOAD DATA
INFILE '/home/oracle/data1.csv'
APPEND
INTO TABLE emp
FIELDS TERMINATED BY X'09'
OPTIONALLY ENCLOSED BY '"'
TRAILING NULLCOLS
(ename,edd,emob)
By using this control file , we can import tab delemenated and enclosed by "" column ...it is working ..
Only thing is if some column data is in next row , it is treating it as a second row and inserting in to new row..
How to insert data in to one row..
This is my data file ... with 3 column values .. ( ename -Robin , edd - Address , emob - 13)
Robin "Address"
13
but it is inserting emob value (13) in ename ...like next line as a new row...How is this data file created and what processes (automated AND manual) does it pass through before coming to sqlloader? It looks to me like it is getting manually copied and pasted from notepad with line wrap turned on. You really need to address why the data is being wrapped across multiple lines (records).
Edited by: EdStevens on Mar 13, 2012 7:48 AM

SQL LOADER Import

Hello
So I have a export from a MYSQLl database a .sql file that I would like to import into oracle. Can I do that without creating a control file? Would I have to creat a control file for every table that is in the database?
Brian Sims

Hi Brian,
when you don't have a control file the defaults will be used and the defaults commonly don't work in general. As you can imagine every table has its own data types which commonly requires a dedicated control file for every table.
There's a dedicated SQL*Loader forum and they might be able to assist you to automate the process
Export/Import/SQL Loader & External Tables

How to filter some illegal rows when SQL Loader import data

I want to import data in a csv file by SQL Loader.
but , I don't want to import some illegal rows
when the column 'name' is null
how can I modify the SQL Loader ctrl file?

Hi,
refer this blogpost:
http://gennick.com/allnull.html
thanks,
X A H E E R

SQL Loader Date Problems

Hi Guys,
We have a SQL Loader script that used to data in the 'mm/dd/yyyy' format. Post migration of the script onto a seprate server the format is getting stored in 'dd/mm/yyyy' format in a VARCHAR datatype column for DOB.
Please find below the Loader script :
"insert into tsa_lists values ('" & ttsa_list_typ & "','" & ttsa_list_num & "',"
                                    if ttsa_list_typ <> "AuthRep" then
                                    inscmd.CommandText= "insert into tsa_lists values ('" & ttsa_list_typ & "','" & ttsa_list_num & "',?,?,?,?,?,?,?,?,?,?,sysdate,?,?)"
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_sid",200,1,30,"")
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_lastname",200,1,500,"")
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_firstname",200,1,500,"")
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_firstletter",200,1,1,"")
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_middlename",200,1,500,"")
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_dob",200,1,100,"")
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_pob",200,1,200,"")
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_citizenship",200,1,200,"")
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_cleared",200,1,3,"")
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_misc",200,1,2000,"")
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_firstname_orig",200,1,500,"")
                                    inscmd.Parameters.Append inscmd.CreateParameter("ttsa_lastname_orig",200,1,500,"")Data coming in the below format:
SID     CLEARED     LASTNAME     FIRSTNAME     MIDDLENAME     TYPE     DOB     POB     CITIZENSHIP     PASSPORT/IDNUMBER     MISC
3799509          A     ABD AL SALAM MARUF ABDALLAH               01-Jul-55
3799512          A     ABD AL SALAM MARUF ABDALLAH               01-Jan-80
3727959          A     KHALID KHALIL IBRAHIM MAHDI               11-Nov-50
3458238          A     KHALID KHALIL IBRAHIM MAHDI               08-Jan-81
3458242          A     KHALID KHALIL IBRAHIM MAHDI               31-Jul-81
3458231          A     KHALID KHALIL IBRAHIM MAHDI               01-Aug-81
2407275          A     MUSA BARARUDDIN Y DAGAM               19-Aug-62
Please can you guys suggest a way.
Cheers,
Shazin

1) That does not look like anything recognized by "SQL*Loader" utility.
2) If you just really mean a "sql" statement to load data...then:
a) If table column is date type, then use the TO_DATE() function
b) If column is Varchar2 you should not save date's in a varchar2 column.
In any case check out the NLS_DATE_FORMAT parameter on the database and or the same parameter on client side.
:p

Import problem DVCPRO 25 with CS5.5

I have a problem with importing a 60 min DVCPRO 25 file from P2 into CS5.5. I worked with the file in CS4 project before and it worked fine (the file had been split into two parts while recording with a HVX200, but it is handled as one file in NLE) Now I wanted to import the file into a new project with CS5.5 but the import process gets stuck and Premiere hangs. Any idea or similar experiences with this?

Yes, effectively I have
DesignStandard_CS5_5_Content_ALL.exe
DesignStandard_CS5_5_LS4.7z
DesignStandard_CS5_5_LS4.exe
Illustrator_15_1_Content_LS4.exe
InDesignFamily_7_5_Content_ALL.exe
Then I run the DesignStandard_CS5_5_LS4.exe but it finished by :
'Un problème s'est produit lors de l'extraction de certains fichiers. Vérifiez l'espace disponible sur l'ordinateur ainsi que les droits d'accès en écriture pour le dossier de destination'
->
'A problem occurred while extracting some files. Check the available space on the computer as well as write access to the destination folder rights'
All of this is ok, I do installation wiith local administrator user, and the PC is a Win7 computer ... so I don't know why installation isn't running correctly...
Thank you for your help

Import problem on Vista with datapump

Hi
I've got a problem with an import into an Oracle XE database server on Vista, I keep getting Ora error "39070 Can't create log file" when executing an impdp command, whereas exactly the same command is working perfectly on Windows XP.
Here is what I'm doing: I want to create a new DB on a target laptop that runs under Vista. I have Oracle XE installed on both my source laptop where I have the source DB and on the target laptop running Vista. I export the DB on the source laptop with expdp (no problems), then copy the export dir content over to the target laptop, then create the user and all the necessary stuff on the traget laptop XE DB server (account unlock, grant create, then create dir (where the DB dump is) and grant read write on that dir to the new user), then use an impdp command like this:
impdp <user>/<password> directory=<newdb> dumpfile=newdb_schema.dmp logfile=newdb_imp.log
to import the data in the DB on the target laptop.
This fails miserably, whereas it succeeds without problems if I do exactly the same on a Win XP desktop machine set up exactly the same way !
On top of that, I succeeded 6 months ago to do the same thing on that Vista laptop, but now it refuses to work.
What's going on ? Are there known problems with the datapump on Vista, or is it a protection problem, i.e. no rights for the datapump process to write a log file in the dir where the db dump is ? What's the way to get it working ?
Thanks for your help, I'm really stuck with that one.
Regards
Balex

Which privileges has Vista user?
On Vista you must explicitly to give user ADMIN rights....
HTH

BW SQL 2005 import problem

Hi,
I'm trying to import one view from SQL 2005 DB. I took into consideration all rules like upper case view name, I gave the required permissions to the user BW and also created the view by the same user. There's no problem with reading data source through BW. I created info objects, defined transfer rules as well. But unfortunatelly when I try to take data to the packages it waits in not completed status wiht yellow sign. I have 10 transactions in the View.
I gave db owner, ddladmin and public permission to BW user from SQL side. ANy idea?

Hi ilker,
Below link will helps you to solve the issue and will have some sort of information.....
http://technet.microsoft.com/en-us/library/dd299430.aspx
Regards
Sudheer

Importing problem-iCal won't recognize .csv files

I've recently upgraded to 10.4.9 from 10.3.9 on my Power PC iMac G5. The old version of iCal had no problem seeing downloaded .csv files and importing them. The new version won't see them or import them. Under 10.3.9, all I had to do was double click on the downloaded .csv file and it would import all events into iCal. Now, nothing happens. I'm a basic user and don't know about scripting or anything else. Any help?

YES! SUCCESS!
I found two ways of doing this. After searching the net, I found this online app on this guys website that worked the best:
http://manas.tungare.name/projects/yahoo2ical/
It says it's a "yahoo" csv converter, but it worked fine for my outlook csv file.
The other option is, if you have an account with google, like a gmail account, you can use their google calendar to import your csv file. Once you've done that, you can subscribe to that calendar you imported via the "share" option. Just get the .ics address. This took a couple tries on google's site to import, but it worked.

How to SQL*loader to skip some columns from the source file?

I am using oracle9i sqlldr to load some .csv files into db.
If I want to skip the first two columns in the source file, can I do that?
If yes, how should I specify it in the ctl file?
Thanks
Wendy

Hello Dave,
Here is a sample of what you'll need to have in your control fileLOAD DATA
APPEND
INTO TABLE <target_table>
FIELDS TERMINATED BY ','
( column_1 FILLER
, column_2
, column_3
, column_4 FILLER
)Hope this helps,
Luke

SQL*Loader importing problem, with file with eastern european files

Similar Messages

Maybe you are looking for