Import unicode flat file

Hello ,
I try to import a unicode (Windows unicode, not UTF-8) flat file but it couldn't be executed successfully.
There is an error message in Deployment Manager.
RPE-01013: SQL Loader reported error condition, number -1073741819.
My environment configuration as follows :
Database ver. 9.2
Database CharacterSet : AL16UTF16
OWB ver 9.2
Import CharacterSet : AL16UTF16LE
Import module : Flat file module.
Source Flat file Language : Unicode (Windows unicode) Traditional Chinese
Source Flat file : Export from Windows 2k
Validate , generate & deploy .... OK
What's wrong of the above configuration ? Anybody can help ? Thanks !
Daniel

Daniel,
The language settings in the Windows registry variable NLS_LANGUAGE on the machine where SQL Loader was run must be the same as the language parameter in the database. You should see more meaningful errors in SQL*Loader log file (by default $ORACLE_HOME/owb/temp/<SQLLDR_MAP_NAME>.log).
Nikolai Rochnik

Similar Messages

Importing From Flat File with Dynamic Columns

HI
I am using ssis 2008,i have folder in which I have Four(4) “.txt” files each file will have 2 columns(ID, NAME). I loaded 4
files in one destination, but today I receive one more “.txt” file here we have 3 columns (ID, NAME, JOB) how can I get a message new column will receive in source. And how can I create in extra column in my destination table dynamically …please help me

Hi Sasidhar,
You need a Script Task to read the names and number of columns in the first row of the flat file each time and store it in a variable, then create a staging table dynamically based on this variable and modify the destination table definition if one ore more
new columns need to be added, and then use the staging table to load the destination table. I am afraid there is no available working script for your scenario, and you need some .NET coding experience to achieve your goal. Here is an example you can refer
to:
http://www.citagus.com/citagus/blog/importing-from-flat-file-with-dynamic-columns/
Regards,
Mike Yin
TechNet Community Support

Modifying the number of records to skip after importing the flat file

I imported a flat file and the first row was the column header. I also created an external table for that flat file. The sqlldr is skipping the first record during the load. Is there a way to change this in the flat file module or External table?

If you marked this row as the header in the sample wizard then you will see the following in the External Table:
ACCESS PARAMETERS (
RECORDS DELIMITED BY NEWLINE
CHARACTERSET WE8MSWIN1252
STRING SIZES ARE IN BYTES
NOBADFILE
NODISCARDFILE
NOLOGFILE
SKIP 1
So the external table is skipping this.
Now the issue with changing it is interesting because you cannot change this after the sampling... I think this is a bug which I will file.
Let me know if this answers the question,
Jean-Pierre

Using DTS Wizard to Import a Flat File containing data like "4124, rue Champenois"

THE BELOW DATA SHOULD BE ONE FIELD, but the COMMA causes it to separate into two fields. The FLAT FILE is a comma-delimited CSV file. The data in the CSV file for this one field actually uses double quotes at each end of the street number and street name.
"2144, rue Champenois"
"340, rue Champs Elysees"
What happens during the conversion process when using the DTS Wizard is that the street number and street name are split apart into two separate fields. This messes up the output and causes the SSIS package to fail, so that the FLAT FILE Source's data never
makes it into a SQL Server Database Table. I saw a box called TEXT QUALIFIER, so I put the DOUBLE QUOTE in there, thinking that this would keep the one field together which contains the STREET NUMBER and STREET NAME. No, that didn't work.
When using this import wizard with a FLAT FILE SOURCE, how do you keep a string that has double quotes at each end and a comma in the middle, together as one field?
Now, I went back later and started all over and put the " (Double Quote one time) in thr TEXT QUALIFIER block, and this did work. Why sometimes and not others?

Hi Champenois,
I have tried your problem.
1) Exported "DimCustomer" table in "AdventureWorksDW" to filat file with bellow query.
Query: select top 10 CustomerKey,AddressLine1 from DimCustomer where AddressLine1 like '%,%'
2) Data comes to flat file like this.
3) Then i have taken flat file source and configured like this.
4) Now went to "Columns" tab and check the data. I am getting only two columns like above.
So, Please check your flat file connection manager with above flat file connection screen shot.
Please make this as answer if, you are able to solve your problem.

Unable to Import Unicode (csv) file to BlackBerry Bold 9700

Hi all
I'm facing some problems with my new BlackBerry Bold 9700. I have Nokia mobile, I exported my contacts using PC-Suite 7. The exported file includes Arabic characters, so the charset used was in Unicode. I've changed the heading for important fields (and removed others) so that they will match with BlackBerry. I imported the file with "BlackBerry Desktop Manager" using "Synchronize" feature. The import was successful, but the charset was in wrong format (just like viewing html page with different codepage!) it was like garbage!
Anyhow, I tried to export, as an example, one contact from my BB and I included Arabic text, when I exported the contact list as (csv) I received a "?????"!!! I then imported the same file with "Synchronize" and strangly it did import and accepted the "?????" and displayed the actual Arabic text as a substitution.
How come BB don't support Unicode?! Is there anyway I can import my contacts from Nokia?
I appreciate any kind of help, hints or tips, thanks in advance...
BlackBerry Bold 9700
v5.0.0.442 (Platform 5.1.0.121)
Regards
Hashem

I guess, the only option that can help in such situation is to use Outlook Express!
This is how I managed to do it:
1. Sync between Nokia PC-Suite and Outlook Express
2. Sync between BB Desktop Manager and Outlook Express
3. Done
or
1. Sync between Nokia PC-Suite and Outlook Express
2. Export from Outlook Express as an address book (WAP) to use it on other machine
3. Import to Outlook Express (you can use Address Book from Accessories)
4. Sync between BB Desktop Manager and Outlook Express
5. Done
Regards
Hashem

SSIS - Import Multiple flat files with different metadata

Hi ,
I have set of flat files with different metadata structure, I would like to load them into staging tables.
1. ) Can we load the flatfiles into the staging tables with out having multiple data flow task.
2.) If possible , can we programmatically select the staging table based on the metadata of the flatfile and load them.
Please advise.
Thanks
Thiya

Nope in SSIS a data flow task needs to have a fixed metadata. So if your file metadata varies then best option would be use OPENROWSET syntax to pull the data and populate into your staging table. You may also use
SELECT .. INTO StagingTable ... FROM OPENROWSET (...)
syntax to create staging table at runtime based on the file metadata
http://sqlmate.wordpress.com/2012/08/09/use-your-text-csv-files-in-your-queries-via-openrowset/
If you want to do this in SSIS you need to create data flow dynamically using script task and build the metadata
see
http://www.selectsifiso.net/?p=288
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Importing a Flat File to Oracle and updating another table

Hey everyone,
I am a newbie with Oracle, and I've tried for the last 2 days to solve this problem below. But all my searches and attempts have failed.
I have a text file called ReturnedFile.txt. This is a comma separated text file that contains records for two fields.... Envelope and Date Returned.
At the same time, I have a table in Oracle called Manifest. This table contains the following fields:
Envelope
DateSentOut
DateReturned
I need to write something that imports the ReturnedFile.txt into a temporary Oracle table named UploadTemp, and then compares the data in the Envelope field from UploadTemp with the Envelope field in Manifest. If it's a match, then the DateReturned field in Manifest needs updated with the DateReturned field in UploadTemp.
I've done this with SQL Server no problem, but I've been trying for two days to make this work with Oracle and I can't figure it out. I've been trying to use SQL*Loader, but I can't even get it to run properly on my machine.
I did create a Control file, saved as RetFile.ctl. Below is the contents of the CTL file:
LOAD DATA
INFILE 'C:\OracleTest\ReturnedFile.txt'
APPEND
INTO TABLE UploadTemp
FIELDS TERMINATED BY "'"
ENVELOPE,
DATERETURNED
If I could get SQL*Loader running, below is the code I came up with to import the text file and then to do the compare to the Manifest table and update as appropriate:
sqlldr UserJoe/Password123 CONTROL=C:\OracleTest\RetFile.ctl LOG=RetFile.log BAD=RetFile.bad
update Manifest m set m.DateReturned =
(select t.DateReturned
    from UploadTemp t
    where m.Envelope = t.Envelope
That's all I got. As I said, I can't find a way to test it and I have no idea if it's even close.
PLEASE...can anyone assist me? Am I even close on this thing?
Joe

If your ReturnedFile.txtfile is comma separated then you need TERMINATED BY "," not TERMINATED BY "'" in your control file. If there happens to not be an ending comma in any row, then you also need to add TRAILING NULLCOLS to your control file. You should also use a date format for your date in your control file that corresponds to the date format in your ReturnedFile.txt file, in case it does not match the date format on your system. You need to add a WHERE EXISTS clause to your update statement to prevent any rows that do not match from having the DateReturned updated to a null value. Please see the example below. If this does not help then please do a copy and paste as I did, that includes a few rows of sample data and table structure. It would also help to see your SQL*Loader log file or a SQL*Loader error message. If you can't get SQL*Loader to run properly, then you may have other issues, such as file permissions at the operating system level. There are also other options besides the methods below. For example, you could use an external table, instead of SQL*Loader, if your ReturnedFile.txtfile is on your serer, not your client. You could also use merge instead of update.
SCOTT@orcl_11gR2> host type returnedfile.txt
env2,03-07-2013
env3,04-07-2013
env4,05-07-2013
SCOTT@orcl_11gR2> host type retfile.ctl
LOAD DATA
INFILE 'ReturnedFile.txt'
APPEND
INTO TABLE UploadTemp
FIELDS TERMINATED BY ","
trailing nullcols
(ENVELOPE
, DATERETURNED date "dd-mm-yyyy")
SCOTT@orcl_11gR2> create table uploadtemp
2    (envelope         varchar2(15),
3     datereturned date)
4 /
Table created.
SCOTT@orcl_11gR2> create table Manifest
2    (Envelope         varchar2(15),
3     DateSentOut   date,
4     DateReturned date)
5 /
Table created.
SCOTT@orcl_11gR2> insert all
2 into manifest values ('env1', sysdate-7, sysdate-3)
3 into manifest values ('env2', sysdate-6, null)
4 into manifest values ('env3', sysdate-5, null)
5 select * from dual
6 /
3 rows created.
SCOTT@orcl_11gR2> select * from manifest
2 /
ENVELOPE        DATESENTO DATERETUR
env1            28-JUN-13 02-JUL-13
env2            29-JUN-13
env3            30-JUN-13
3 rows selected.
SCOTT@orcl_11gR2> host sqlldr scott/tiger CONTROL=RetFile.ctl LOG=RetFile.log BAD=RetFile.bad
SQL*Loader: Release 11.2.0.1.0 - Production on Fri Jul 5 13:15:06 2013
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
Commit point reached - logical record count 3
SCOTT@orcl_11gR2> select * from uploadtemp
2 /
ENVELOPE        DATERETUR
env2            03-JUL-13
env3            04-JUL-13
env4            05-JUL-13
3 rows selected.
SCOTT@orcl_11gR2> update Manifest m
2 set m.DateReturned =
3    (select t.DateReturned
4     from   UploadTemp t
5     where m.Envelope = t.Envelope)
6 where exists
7    (select t.DateReturned
8     from   UploadTemp t
9     where m.Envelope = t.Envelope)
10 /
2 rows updated.
SCOTT@orcl_11gR2> select * from manifest
2 /
ENVELOPE        DATESENTO DATERETUR
env1            28-JUN-13 02-JUL-13
env2            29-JUN-13 03-JUL-13
env3            30-JUN-13 04-JUL-13
3 rows selected.

Unicode Flat file upload

I am having an issue loading a file from the Presentation server into a unicode BW system. In my file, I have "Ärzte" and when I preview it, the Ä is replaced with #. I have 0langu of DE in the file.

I think you need to follow two things before doing this upload using File System:
Go to SM59 transaction and check following things, select your BW system and click on that:
1-In the Logon/Security Tab Remove language "EN" if it's mentioned.
2-In the Special Options tab Select Character width in Target System as UNICODE.
I think this will solve your issue.
Let me know if you still have any issue
-Ashish

Import flat file in selction screen

Hi all,
Could anybody help me in giving me a hint to import a flat file with thousands of values (articles selection) in the query selection screen.
Best regards.
Geo

I have a question related to using the multiple selections in a BEx Query. We are seeing some very long wait times for our selections and was wonder if this is normal, or if we have some things to fix in our system.
In one of our Project System Queries, we are inputting 54 lines like the following list:
AIR
BAM
BAR
BRR
BTR
COM
CSM
CSR
CTM
CTR
EPM
EPR
It is taking up to 45 minutes just to get these items loaded in from the clipboard, this seems a bit excessive to me, as it only take a matter of a second or two to do the same thing in our R/3 system.
I was thinking that BW was doing some sort of validations as it brought in the list, but no one has been able to answer this question for me.
If anyone can provide some advice or answers, it will be greatly appreciated.
Thanks,
Lloyd

How to import flat file as a source in DAC Client

Dear All,
I am doing some R&D,I have a problem that how can i import the flat file in DAC client which i am using as a source.
Can any one please explain in detail step wise.
Regards
Tarang Jain

Hi Tarang,
How long will it take to run the sample execution plan? Since when i run 'CRM Automotive' EP, it runs for more than 3 hours and still it is running. My system config is 1GB RAM with windows os. I have also opened the DAC server and client in console mode and I m not able to see any errors. I have only got only the task 'Load row into run table ' completed successfully and next 10 are in Running stage from the past 2 hours.
My DAC client shows continously the below shown message for 1 hr.
'Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.model.ConnectionHan
dler getConnection
INFO: Getting connection for: Model structure for W_ETL_RUN_STEP (RUN_STEP) (cur
rently 0)
Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.model.ResultSetPars
er logMinutesSeconds
INFO: Query took 0 minutes, 0 seconds
Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.model.ConnectionHan
dler cleanUp
INFO: Returning connection for: Model structure for W_ETL_RUN_STEP (RUN_STEP) (c
urrently 1)
Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.model.ResultSetPars
er logMinutesSeconds
INFO: Populating DACObjects took 0 minutes, 0 seconds
Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.model.DACChildTable
Model setParentID
INFO: PARENT ROW ID IS: 95D45F88DBB268B3D19DB71B4E42D3FF
Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.objectcomponents.Mo
delStruct setQuery
INFO: SELECT
RUN_STEP.DEPTH
,RUN_STEP.STEP_NAME
,RUN_STEP.STATUS
,RUN_STEP.START_TS
,RUN_STEP.END_TS
,RUN_STEP.STATUS_DESC
,RUN_STEP.PHY_SRC_NAME
,RUN_STEP.PHY_TRGT_NAME
,RUN_STEP.PHY_FOLDER_NAME
,RUN_STEP.SERVER_NAME
,RUN_STEP.PHASE_NAME
,RUN_STEP.EXEC_TYPE_NAME
,RUN_STEP.SUCESS_ROWS
,RUN_STEP.FAILED_ROWS
,RUN_STEP.ERROR_CODE
,RUN_STEP.DEFN_STEP_WID
,RUN_STEP.ROW_WID
,RUN_STEP.LAST_UPD
,RUN_STEP.APP_WID
,RUN_STEP.RUN_WID
,RUN_STEP.STEP_WID
,RUN_STEP.PHY_SRC_WID
,RUN_STEP.PHY_TRGT_WID
,RUN_STEP.PHY_FOLDER_WID
,A_W_ETL_APP.ROW_WID
,A_W_ETL_APP.NAME
FROM W_ETL_RUN_STEP RUN_STEP
INNER JOIN W_ETL_APP A_W_ETL_APP ON RUN_STEP.APP_WID=A_W_ETL_APP.ROW_WID
WHERE
(RUN_STEP.RUN_WID='95D45F88DBB268B3D19DB71B4E42D3FF')
ORDER BY
RUN_STEP.START_TS ASC,
RUN_STEP.DEPTH ASC'
Any comments on this?
I had also copied the CRM Analytics source file into the "D:\Informatica\PowerCenter8.1.1\server\infa_shared\SrcFiles"
as metioned in Appendices ' Configuring Universal Adapter for CRM Analytics'.
With Regards,
Prads

Issue importing flat files into SQL server 2008R2

I have csv files that the last column may not have data. SSIS (version 2008R2) will insert the next row's data into the empty cells, which causes my package to fail.
I know this is resolved in 2012 but we are using 2008R2 still. Any suggestions?
Thanks.

Hi sqlBI2014,
After testing the issue that Flat File Connection Manager cannot handle file with uneven number of columns in each row in my SQL Server 2008 R2 environment, I can reproduce it.
Based on my research, the issue is caused by the Column Delimiter gets first preference and then Row delimiter. So the next row data would be inserted in the empty column cell. This is by design in SQL Server 2005, SQL Server 2008 or SQL Server 2008 R2.
Good news is that the issue is fixed in SQL Server Data Tools which comes with SQL Server 2012. In SQL Server 2012, by default, the Flat File Connection Manager always checks for a row delimiter in unquoted data, and starts a new row when a row delimiter
is found. This enables the connection manager to correctly parse files with rows that are missing column fields.
If you still want to fix the issue in SQL Server 2008 R2, there is a sample component posted to the CodePlex that might help you with this:
http://ssisdfs.codeplex.com/
References:
http://blogs.msdn.com/b/dataaccesstechnologies/archive/2013/03/13/flat-file-source-cannot-handle-file-with-uneven-number-of-columns-in-each-row.aspx
https://connect.microsoft.com/SQLServer/feedback/details/293193/ssis-import-of-flat-file-with-uneven-number-of-columns
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

Using ssis import a multiple flat files with different mappings

I have an scenario for import a file
20 different flat file source and having XML mapping document in a table.
get files from that path(i have path and file name extension in table)
i have map this file based on the file name extension in dynamically
create a 20 different staging table based on mapping in dynamically
kindly help for this

Hi Karthick,
As Arthur said, if you don't want to hard code the data flow, you need to read XML from the SQL Server table and use Script Task to implement the dynamic columns mapping. To read XML from a SQL table, you can refer to:
http://blog.sqlauthority.com/2009/02/13/sql-server-simple-example-of-reading-xml-file-using-t-sql/
In the Script Task, we need to parse the first row of the flat file to get the columns information and save that to a .NET variable. Then, the variable will be used to create the query that will be used to create SQL table. For more information, please see:
http://www.citagus.com/citagus/blog/importing-from-flat-file-with-dynamic-columns/
Regards,
Mike Yin
TechNet Community Support

Error in Importing Flat file by FDMEE

Hi,
I am trying to import a Flat File through FDMEE in a BSO Cube , but its throwing error at the import step only
Error in FileData.importData Traceback (most recent call last): File "<string>", line 39, in importData
RuntimeError: Exception in the file import servlet call
I am not using any import script , I am trying to import a simple flat file with a Rule to import it (Workflow->Data Load Rule).

Hi Sharad,
How did you rectify the issue mentioned:
Error in FileData.importData Traceback (most recent call last): File "<string>", line 39, in importData
RuntimeError: Exception in the file import servlet call
I am facing the same issue and would really appreciate if I can get any guidelines or related document on fixing this issue.
Please provide help on this at the earliest as this issue is affecting my deliverables.
Thanks,
Sumit Wadhwa

Importing Flat file into Planning 11.1.2 via empa

Hi all,
I have imported diemension using flat file into dimension library ,when i right click on to CURRENCY dimension i found 2 options A)shared libary B)application
when i clicked on to that application i couldnt find the application .Create application using Classic Planning .Epma has its own respository i need to import the metadata currency into demotst2

In order to import into a planning app you need to convert it to EPMA format. You indicate that the planning application is a classic application.
In EPMA you need to convert the classic app then you will be able to import the flat file
JTS

Import flat file

hi
all,I am newbie to this forum .
Can u pls tell me "how to import a flat file to database"
sanjay

Try to read about "External Table" and "SQL Loader".

Import unicode flat file

Similar Messages

Maybe you are looking for