How to load csv file to table using ssis

Hi,
i have loaded the csv file to table using ssis, it is working file but record is mismatch.
source data :
col1 col2 col3 col4
aa, bb, this is sample,data for the details, this is
column delimiter - comma
col3 - record contains comma. so col3 record after the comma is added with the as col4
i need the col3 record with comma.
so what is the column delimiter will use ?
Regards,
abdul Khadir

Hi Abdul,
Based on your description, you want to distinguish a comma is used for column separator or used in address column in a text file, then load the data from the text file to SQL Server table.
As per my understanding, if you can replace the comma column separator to another delimiter like semicolon (;), just do it. Then we can select Semicolon {;} as Column delimiter for the Flat File Connection Manager. Or ensure all columns are enclosed in double
quotes ("). Then we can set the double quotes (") as Text qualifier for the Flat File Connection Manager, and the commas will be loaded as part of the string fields.
If you can't have that done, because computers don't know the context of the data, you would have to come up with some kind of rules that decides when a comma represents a delimiter, and when it is just part of the text. I think a custom script component
would be necessary to pre-process the data, identify where a comma is part of an address, and then treat that as one field.
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

Similar Messages

How to load csv file in oracle table

Hi,
i have csv files to which i want to load the csv file data and table structure in oracle. my csv files on the window machine but database is runing on ibm aix.so how to do it please any one can help me about. thanks a lot in advance
i know th syntax below
$sqlldr userid=username/password control=<filename> log=<log filename>

Hello,
Yes, with SQL*Loader you can do it.
But first you have to create a Table into your database with columns and datatype matching
the content of you "csv" file.
Then, you'll have to prepare a control file and use the option fields terminated by "," as it's
a "csv" format.
Then, you could execute your statement.
Please, find enclosed a link with some example about SQL*Loader and "csv" file:
[http://www.orafaq.com/wiki/SQL*Loader_FAQ]
Hope this help.
Best regards,
Jean-Valentin

How to load .csv file into an abap table

Hi,
Pls provide me with a sample code on how to load a .csv file (with column header and rows of data) into a table in sap.
Thank you!
Moderator Message: A google search would yield faster results, so search!
Edited by: Suhas Saha on Jan 16, 2012 5:30 PM

Hi,
Using GUI_upload convert file to internal table data.
Using the below statement separate header and data from CSV.
Read t_itab into wa_titab index 1.
delete t_itab from wa_itab.
Create an internal table with the structure same as 'CSV' file and use the below statement to separate.
loop at t_itab into wa_itab.
      split wa_itab-rec at ',' into var1 var2 var3.
      wa_output-v1 = var1.
      wa_output-v2 = var2.
      wa_output-v3 = var3.
    append wa_output to t_output.
endloop.
Edited by: syamsundr on Jan 16, 2012 11:54 AM

How to load XML file to table (non-XML) with SQL*Loader -- issue with nulls

I have been attempting to use SQL*Loader to load an XML file into a "regular" Oracle table. All fields work fine, unless a null is encountered. The way that nulls are represented is shown below:
<PAYLOAD>
<FIELD1>ABCDEF</FIELD1>
<FIELD2/>
<FIELD3>123456</FIELD3>
</PAYLOAD>
In the above example, FIELD2 is a null field and that is the way it is presented. I have searched everywhere and have not found how I could code for this. The issue is that if FIELD2 is present, it is coded like: <FIELD2>SOMEDATA</FIELD2>, but the null is represented as <FIELD2/>. Here is a sample of the control file I am using to attempt the load -- very simplistic, but works fine when fields are present:
load data
infile 'testdata.xml' "str '<PAYLOAD>'"
TRUNCATE
into table DATA_FROM_XML
FIELD1 ENCLOSED BY '<FIELD1>' AND '</FIELD1>',
FIELD2 ENCLOSED BY '<FIELD2>' AND '</FIELD2>',
FIELD3 ENCLOSED BY '<FIELD3>' AND '</FIELD3>')
What do I need to do to account for the way that nulls are presented? I have tried everything I could glean from the web and the documentation and nothing has worked. Any help would be really appreciated.

I hadn't even got that far. can you direct me to where the docs are to import data that is stored within xml but that you don't need any xml functionality, that just happens to be the format the data is stored in? thx

How to load CSV files into HANA

1.- Create an CSV file with your data
2.- Copy the file to dropbox/yourname inside the HANA box
3.- Create a table in HANA with the structure of your file
4.- create the control file BBB with the following information:
import data
into table XXX."YYY"
from 'ZZZ.csv'
record delimited by '\n'
fields delimited by ','
optionally enclosed by '"'
error log 'Text_Tables.err'
Where XXX is your schema, YYY is your HANA Table and ZZZ is your file
5.- Open an Script File and write the following:
LOAD FROM '/filer/dropbox/yourname/BBB.ctl';
where BBB is the name of your control file
Greetings,
Blag.

With the recent upgrade to the HANA SP3...the method to upload files to HANA has been slightly changed...so here's the updated tutorial:
1.- Create an CSV file with your data
2.- Copy the file to the HANA Dev Center
3.- Open a FTP connection to ftp.sapdevcenter.com
(You can find the user name and password by doing a select to SYSTEM.FTP_SERVER)
and....*Don't paste the Username or password here or any other place!*
4.- Create a folder with your name on the FTP site and copy the file there
4.- Create a table in HANA with the structure of your file
5.- create the control file BBB with the following information:
import data
into table XXX."YYY"
from 'ZZZ.csv'
record delimited by '\n'
fields delimited by ','
optionally enclosed by '"'
error log 'Text_Tables.err'
Where XXX is your schema, YYY is your HANA Table and ZZZ is your file
5.- Open an Script File and write the following:
IMPORT FROM '/dropbox/yourname/BBB.ctl';
where BBB is the name of your control file
I just test it and it works...if it doesn't work for you, please let me know
Greetings,
Blag.

How to load data into user tables using DIAPIs?

Hi,
I have created an user table using UserTablesMD object.
But I don't have know how to load data into this user table. I guess I have to use UserTable object for that. But I still don't know how to put some data in particular column.
Can somebody please help me with this?
I would appreciate if somebody can share their code in this regard.
Thank you,
Sudha

You can try this code:
Dim lRetCode As Long
Dim userTable As SAPbobsCOM.UserTable
userTable = pCompany.UserTables.Item("My_Table")
'First row in the @My_Table table
userTable.Code = "A1"
userTable.Name = "A.1"
userTable.UserFields.Fields.Item("U_1stF").Value = "First row value"
userTable.Add()
'Second row in the @My_Table table
userTable.Code = "A2"
userTable.Name = "A.2"
userTable.UserFields.Fields.Item("U_1stF").Value = "Second row value"
userTable.Add()
This way I have added 2 lines in my table.
Hope it helps
Trinidad.

How to include .php file in .shtml using SSI

Hi,
I've just finished with my "Contact Us form" for my website and have some issues with running it. I have a .shtml file http://mydomain.com/contact-us.shtml in wich I'd like to include a contact us form file http://mydomain.com/includes/ContactUs.php. Now, having my web page "contact-us" as a *.shtml file with ContactUs.php file included, I can run the form but I can't send any emails. If I would change contact-us.shtml in contact-us.php the form runs perfect but, I can't use other includes on that file as logo, header, footer etc. How could I include an .php file in a .shtml file and runing both the included .php script and includes themself?
Thank You!

Keep it simple.
Your html file uses syntax like "" to include an SSI file. Your server requires either (1) that the html file have the .shtml extension or (2) you twiddle with an .htaccess file to cause the server to parse ALL html files for SSIs. The latter is generally not a good idea.
PHP files are already processed on the server. You include SSI files the same way, but the syntax is a little different: "<?php include (".header"); ?> ".

Loading multiple .csv files into a table using SSIS

Hi,
I have a requirement where I have 200+ csv files to be loaded into Netezza table using SSIS.
Issue I am facing is all columns have different number of columns, for ex, file 1 has columns A,B,C and file 2 has columns C,D,E. My target table has all columns from A to E in it.
But, when I am using for each loop container, only the file for which I have specified filepath+filename in loop variable, that is getting loaded. Rest all files, no data is getting loaded from them and package is executing successfully.
Any help is appreciated.
Regards,
VT

if you want to iterate through files then all files should be in same folder and you should use file enumerator type within ForEach loop. Then inside loop you might need a script task to generate the data flow on the fly based on the avialble input columns
from the file and do the mapping in the destination. So I assume you put NULLs (or some default value) for missing columns from the file
http://blog.quasarinc.com/ssis/best-solution-to-load-dynamically-change-csv-file-in-ssis-etl-package/
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Load .csv file data with OWb Process flow using Web

Hi,
I Have a file in my local machine( Machines on multiple user's), need to load data through Web user interface.
Let's say have a web page with multiple radio buttons respective to different sources, by clicking on each button will pass the path of .csv file to through Application, (API or Java programming interface) execute owb Process flow as a accepting file path as a input parameter to execute for loading purpose.
Should facilitate view data, Update data through web based on user requests.
Need your guidence how can i implement this with OWb 11g R2.
Assuming with Web browser functionality. Please confirm it and if yes, please throw some light how could be the steps to implement.
Thanks

Hi David,
Thanks for your reply.
Undersatnd your proposed solution.But my requirement should be as follows.
1. Currently under consideration using web page likely to be implement with Java, allowing users to load .csv file data into staging area.(Loading flat file into Data abse table)
Case 1, Assuming OWB software is not installed on user machine. I think no.
Is it possible through web page (this case Java page) to trigger java procedure/Pl/SQl procedure or integration of both to laod data into staging area.If yes, how it could effect performance of data load with 1 GB file.
Case 2, OWb client software installed on User machine, while runtime passing parameters means passing manually?
In case it is automated, how should i pass machine name & Path to owb runtime web browser.
Could you please show me guidence how should I acheive this functionality with APEX customization part?
Thanks agin for your support.
Anil

How to load text file data to Oracle Database table?

By using Oracle Forms, how to load text file data to Oracle Database table?

Metalink note 33247.1 explains how to use text_io as suggested by Robin to read the file into a Multi-Row block. However, that article was written for forms 4.5 and uses CREATE_RECORD in a loop. There was another article, 91513.1 describing the more elegant method of 'querying' the file into the block by transactional triggers. Unfortunately this more recent article has disappeared without trace and Oracle deny its existence. I know it existed as I have a printed copy in front of me, and very useful it is too.

*** Question How to load a file into BI-Integrated Planning and use WAD 7.0

Hi, I created an manual DTP upload to my planning infocube and it works fine. The transformation rules convert 0CALMONTH into the relevant Calendar and Fiscal characteristics. So all of my Time Characteristics are fine, both Calendar and Fiscal.
However, When using the "How to load a file into BI-Integrated Planning and use WAD 7.0" solution, only the Calendar Characteristics are populated and not the Fiscal. The upload application somehow knows to populate the 0CALMONTH2, 0CALQUART1, 0CALQUARTER, and 0CALYEAR.
How can I get the upload to populate my Fiscal Period Characteristics?
Would it be best to modify the "Upload Application, or can I write a planning function to update the fiscal characteristics, or some other way?
Thanks!

My planning data is being uploaded via the SDN Planning File Upload Solution. What I did was end up modifiying the upload class ZCL_RSPLF_FILE_UPLOAD Method EXECUTE.
I added the following code if anyone is interested.
*{ INSERT BWDK902323 1
THIS SECTION OF CODE POPULATES THE FISCAL PERIOD CHARACTERISTICS
USING THE FISCAL YEAR VARIANT 'NK' AND THE CALENDAR MONTH/YEAR
FIELD-SYMBOLS <0FISCVARNT> TYPE /BI0/OIFISCVARNT. " Fiscal Year Variant
FIELD-SYMBOLS <0FISCYEAR> TYPE /BI0/OIFISCYEAR. " Fiscal Year
FIELD-SYMBOLS <0FISCPER> TYPE /BI0/OIFISCPER. " Fiscal Year/Period
FIELD-SYMBOLS <0FISCPER3> TYPE /BI0/OIFISCPER3. " Posting Period
FIELD-SYMBOLS <0CALMONTH> TYPE /BI0/OICALMONTH. " Calendar Month/Year
ASSIGN COMPONENT '0CALMONTH' OF STRUCTURE <L_S_DATA> TO <0CALMONTH>.
ASSIGN COMPONENT '0FISCPER' OF STRUCTURE <L_S_DATA> TO <0FISCPER>.
ASSIGN COMPONENT '0FISCVARNT' OF STRUCTURE <L_S_DATA> TO <0FISCVARNT>.
ASSIGN COMPONENT '0FISCPER3' OF STRUCTURE <L_S_DATA> TO <0FISCPER3>.
ASSIGN COMPONENT '0FISCYEAR' OF STRUCTURE <L_S_DATA> TO <0FISCYEAR>.
<0FISCVARNT> = 'NK'.
CALL FUNCTION 'FISCPER_FROM_CALMONTH_CALC'
EXPORTING
IV_CALMONTH = <0CALMONTH>
IV_PERIV = <0FISCVARNT>
IMPORTING
EV_FISCPER3 = <0FISCPER3>
EV_FISCPER = <0FISCPER>
EV_FISCYEAR = <0FISCYEAR>.
*} INSERT

How to load flat file using IP

Hi Experts,
I know that we can use planning function exit in BW-BPS to load the data from flat file(and there is a how to document).
But in IP what is process to load the flat file.becoz when i see into my planning function,type exit is not available.
Any idea.

/people/marc.bernard/blog/2007/11/25/how-to-load-a-file-into-sap-netweaver-bi-integrated-planning-part-1
/people/marc.bernard/blog/2007/11/25/how-to-load-a-file-into-sap-netweaver-bi-integrated-planning-part-2
hope this helps.

How to delete the data loaded into MySQL target table using Scripts

Hi Experts
I created a Job with a validation transformation. If the Validation was failed the data passed the validation will be loaded into Pass table and the data failed will be loaded into failed table.
My requirement was if the data was loaded into Failed database table then i have to delete the data loaded into the Passed table using Script.
But in the script i have written the code as
sql('database','delete from <tablename>');
but as it is an SQL Query execution it is rising exception for the query.
How can i delete the data loaded into MySQL Target table using scripts.
Please guide me for this error
Thanks in Advance
PrasannaKumar

Hi Dirk Venken
I got the Solution, the mistake i did was the query is not correct regarding MySQL.
sql('MySQL', 'truncate world.customer_salesfact_details')
error query
sql('MySQL', 'delete table world.customer_salesfact_details')
Thanks for your concern
PrasannaKumar

Uregnt - How to Load Flat File into BW-BPS using Web Browser

Hello,
We have followed the 'How to Load Flat File into BW-BPS using Web Browser' guide to build BSP web front-end to upload flat file. Everything works great but we have a requirement to populate the Planning Area Variables based on BSP drop down list with values. Does anyone know how to do this? We have the BSP coded with drop down list all we need to do now is populate variables. We can populate the variables through the planning level (hardcoded) but we need to populate them through the web interface.
Thanks,
Gary

Hello Gary,
We have acheived the desired result by not too a clean method but it works for us.
What we have done is, we have the link to load file in a page where the variables can be input. The user would then have the option to choose the link to load a file for the layout in that page.
By entering the variable values in the page, we are able to read the variables for the file input directly in the load program.
Maybe this approach might help.
Sunil

How to load flat files to BI

Hi All,
I am new to SAP BI. PLease tell me how to load excel files to BI.

hi,
For BI 7.0 basic step to laod data from flat (excel files) files for this follow the beloww step-by step directions ....
Uploading of master data
Log on to your SAP
Transaction code RSA1u2014LEAD YOU TO MODELLING
1. Creation of Info Objects
u2022 In left panel select info object
u2022 Create info area
u2022 Create info object catalog ( characteristics & Key figures ) by right clicking the created info area
u2022 Create new characteristics and key figures under respective catalogs according to the project requirement
u2022 Create required info objects and Activate.
2. Creation of Data Source
u2022 In the left panel select data sources
u2022 Create application component(AC)
u2022 Right click AC and create datasource
u2022 Specify data source name, source system, and data type ( master data attributes, text, hierarchies)
u2022 In general tab give short, medium, and long description.
u2022 In extraction tab specify file path, header rows to be ignored, data format(csv) and data separator( , )
u2022 In proposal tab load example data and verify it.
u2022 In field tab you can you can give the technical name of info objects in the template and you not have to map during the transformation the server will automatically map accordingly. If you are not mapping in this field tab you have to manually map during the transformation in Info providers.
u2022 Activate data source and read preview data under preview tab.
u2022 Create info package by right clicking data source and in schedule tab click star to load data to PSA.( make sure to close the flat file during loading )
3. Creation of data targets
u2022 In left panel select info provider
u2022 Select created info area and right click to select Insert Characteristics as info provider
u2022 Select required info object ( Ex : Employee ID)
u2022 Under that info object select attributes
u2022 Right click on attributes and select create transformation.
u2022 In source of transformation , select object type( data source) and specify its name and source system Note: Source system will be a temporary folder or package into which data is getting stored
u2022 Activate created transformation
u2022 Create Data transfer process (DTP) by right clicking the master data attributes
u2022 In extraction tab specify extraction mode ( full)
u2022 In update tab specify error handling ( request green)
u2022 Activate DTP and in execute tab click execute button to load data in data targets.
4. Monitor
Right Click data targets and select manage and in contents tab select contents to view the loaded data. Alternatively monitor icon can be used.
BW 7.0
Uploading of Transaction data
Log on to your SAP
Transaction code RSA1u2014LEAD YOU TO MODELLING
5. Creation of Info Objects
u2022 In left panel select info object
u2022 Create info area
u2022 Create info object catalog ( characteristics & Key figures ) by right clicking the created info area
u2022 Create new characteristics and key figures under respective catalogs according to the project requirement
u2022 Create required info objects and Activate.
6. Creation of Data Source
u2022 In the left panel select data sources
u2022 Create application component(AC)
u2022 Right click AC and create datasource
u2022 Specify data source name, source system, and data type ( Transaction data )
u2022 In general tab give short, medium, and long description.
u2022 In extraction tab specify file path, header rows to be ignored, data format(csv) and data separator( , )
u2022 In proposal tab load example data and verify it.
u2022 In field tab you can you can give the technical name of info objects in the template and you not have to map during the transformation the server will automatically map accordingly. If you are not mapping in this field tab you have to manually map during the transformation in Info providers.
u2022 Activate data source and read preview data under preview tab.
u2022 Create info package by right clicking data source and in schedule tab click star to load data to PSA.( make sure to close the flat file during loading )
7. Creation of data targets
u2022 In left panel select info provider
u2022 Select created info area and right click to create ODS( Data store object ) or Cube.
u2022 Specify name fro the ODS or cube and click create
u2022 From the template window select the required characteristics and key figures and drag and drop it into the DATA FIELD and KEY FIELDS
u2022 Click Activate.
u2022 Right click on ODS or Cube and select create transformation.
u2022 In source of transformation , select object type( data source) and specify its name and source system Note: Source system will be a temporary folder or package into which data is getting stored
u2022 Activate created transformation
u2022 Create Data transfer process (DTP) by right clicking the master data attributes
u2022 In extraction tab specify extraction mode ( full)
u2022 In update tab specify error handling ( request green)
u2022 Activate DTP and in execute tab click execute button to load data in data targets.
8. Monitor
Right Click data targets and select manage and in contents tab select contents to view the loaded data. There are two tables in ODS new table and active table to load data from new table to active table you have to activate after selecting the loaded data . Alternatively monitor icon can be used
Regards,
ANI

How to load csv file to table using ssis

Similar Messages

Maybe you are looking for