Importing flat file

Hi all
I have a .csv file sitting on a shared folder. How do i import it to the OWB staging area. Any help or advice is greatly appreciated.
Thank You

OWB can capture the flat file definition from the shared drive, and you can either construct external tables on the file or sqlloader mappings. To capture the definition create a flat file module and the location will be the shared drive, then either import on that module where you can pick the files and sample the files to get the file metadata, or create a file manually without the sample wizard. The sample wizard makes it pretty simple to do.
Note the module has a metadata location and a data location, the metadata location will be where you can obtain the file's metadata (at design) and the data location will be the location used at runtime.
See the blog post here on the data mover expert which illustrates some components here.
http://blogs.oracle.com/warehousebuilder/2009/01/expert_useful_scripts_from_simple_primitives.html
Cheers
David

Similar Messages

Import flat files

Hi all
Can any one please tell me , how to import flat files from 'postgres database' on a completely different network?
Thank You

Are you wanting to unload to file from Postgres? Or use ODBC connectivity to it? ODBC would allow remote connectivity using the database gateway connectivity. Running an unload on postgres instance to file and ftp'ing the file is another option.
Cheers
David

I want to import flat files by ftp in owb

I want to import flat files by ftp in owb.
When I config the ftp host ip, username, password and path, then I import the flat files, but
this didn't succeed. And I find the owb didn't check the ftp host's directory,
and it check the localhost of owb, so it reported there isn't the directory.
So how to solve the problem.
Thank you!

Hi,
you must first transfer the files via ftp to the dbserver and then process. Create a workflow with a ftp activity and transfer the files. After this you can call the mappings in this workflow.
If you want to sample the flat files you have two choices:
1.) Using the owb client on the dbserver and sample the files on the dbserver. Then you need only one location with the path on the db-server.
2.) Using the owb client on a client machine and sample the files on the client. Then you need two locations: one local which points to the file directory on your client, one remote which points to the path on the dbserver. Use the first to sample the files, and change to the second before deploying the mappings.
Regards,
Detlef

Import flat file in selction screen

Hi all,
Could anybody help me in giving me a hint to import a flat file with thousands of values (articles selection) in the query selection screen.
Best regards.
Geo

I have a question related to using the multiple selections in a BEx Query. We are seeing some very long wait times for our selections and was wonder if this is normal, or if we have some things to fix in our system.
In one of our Project System Queries, we are inputting 54 lines like the following list:
AIR
BAM
BAR
BRR
BTR
COM
CSM
CSR
CTM
CTR
EPM
EPR
It is taking up to 45 minutes just to get these items loaded in from the clipboard, this seems a bit excessive to me, as it only take a matter of a second or two to do the same thing in our R/3 system.
I was thinking that BW was doing some sort of validations as it brought in the list, but no one has been able to answer this question for me.
If anyone can provide some advice or answers, it will be greatly appreciated.
Thanks,
Lloyd

How to import flat file as a source in DAC Client

Dear All,
I am doing some R&D,I have a problem that how can i import the flat file in DAC client which i am using as a source.
Can any one please explain in detail step wise.
Regards
Tarang Jain

Hi Tarang,
How long will it take to run the sample execution plan? Since when i run 'CRM Automotive' EP, it runs for more than 3 hours and still it is running. My system config is 1GB RAM with windows os. I have also opened the DAC server and client in console mode and I m not able to see any errors. I have only got only the task 'Load row into run table ' completed successfully and next 10 are in Running stage from the past 2 hours.
My DAC client shows continously the below shown message for 1 hr.
'Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.model.ConnectionHan
dler getConnection
INFO: Getting connection for: Model structure for W_ETL_RUN_STEP (RUN_STEP) (cur
rently 0)
Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.model.ResultSetPars
er logMinutesSeconds
INFO: Query took 0 minutes, 0 seconds
Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.model.ConnectionHan
dler cleanUp
INFO: Returning connection for: Model structure for W_ETL_RUN_STEP (RUN_STEP) (c
urrently 1)
Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.model.ResultSetPars
er logMinutesSeconds
INFO: Populating DACObjects took 0 minutes, 0 seconds
Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.model.DACChildTable
Model setParentID
INFO: PARENT ROW ID IS: 95D45F88DBB268B3D19DB71B4E42D3FF
Sep 30, 2008 3:52:59 PM com.siebel.analytics.etl.client.data.objectcomponents.Mo
delStruct setQuery
INFO: SELECT
RUN_STEP.DEPTH
,RUN_STEP.STEP_NAME
,RUN_STEP.STATUS
,RUN_STEP.START_TS
,RUN_STEP.END_TS
,RUN_STEP.STATUS_DESC
,RUN_STEP.PHY_SRC_NAME
,RUN_STEP.PHY_TRGT_NAME
,RUN_STEP.PHY_FOLDER_NAME
,RUN_STEP.SERVER_NAME
,RUN_STEP.PHASE_NAME
,RUN_STEP.EXEC_TYPE_NAME
,RUN_STEP.SUCESS_ROWS
,RUN_STEP.FAILED_ROWS
,RUN_STEP.ERROR_CODE
,RUN_STEP.DEFN_STEP_WID
,RUN_STEP.ROW_WID
,RUN_STEP.LAST_UPD
,RUN_STEP.APP_WID
,RUN_STEP.RUN_WID
,RUN_STEP.STEP_WID
,RUN_STEP.PHY_SRC_WID
,RUN_STEP.PHY_TRGT_WID
,RUN_STEP.PHY_FOLDER_WID
,A_W_ETL_APP.ROW_WID
,A_W_ETL_APP.NAME
FROM W_ETL_RUN_STEP RUN_STEP
INNER JOIN W_ETL_APP A_W_ETL_APP ON RUN_STEP.APP_WID=A_W_ETL_APP.ROW_WID
WHERE
(RUN_STEP.RUN_WID='95D45F88DBB268B3D19DB71B4E42D3FF')
ORDER BY
RUN_STEP.START_TS ASC,
RUN_STEP.DEPTH ASC'
Any comments on this?
I had also copied the CRM Analytics source file into the "D:\Informatica\PowerCenter8.1.1\server\infa_shared\SrcFiles"
as metioned in Appendices ' Configuring Universal Adapter for CRM Analytics'.
With Regards,
Prads

Issue importing flat files into SQL server 2008R2

I have csv files that the last column may not have data. SSIS (version 2008R2) will insert the next row's data into the empty cells, which causes my package to fail.
I know this is resolved in 2012 but we are using 2008R2 still. Any suggestions?
Thanks.

Hi sqlBI2014,
After testing the issue that Flat File Connection Manager cannot handle file with uneven number of columns in each row in my SQL Server 2008 R2 environment, I can reproduce it.
Based on my research, the issue is caused by the Column Delimiter gets first preference and then Row delimiter. So the next row data would be inserted in the empty column cell. This is by design in SQL Server 2005, SQL Server 2008 or SQL Server 2008 R2.
Good news is that the issue is fixed in SQL Server Data Tools which comes with SQL Server 2012. In SQL Server 2012, by default, the Flat File Connection Manager always checks for a row delimiter in unquoted data, and starts a new row when a row delimiter
is found. This enables the connection manager to correctly parse files with rows that are missing column fields.
If you still want to fix the issue in SQL Server 2008 R2, there is a sample component posted to the CodePlex that might help you with this:
http://ssisdfs.codeplex.com/
References:
http://blogs.msdn.com/b/dataaccesstechnologies/archive/2013/03/13/flat-file-source-cannot-handle-file-with-uneven-number-of-columns-in-each-row.aspx
https://connect.microsoft.com/SQLServer/feedback/details/293193/ssis-import-of-flat-file-with-uneven-number-of-columns
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

Import flat file to multiple tables based on identifier column

Hello,
I am trying to setup a package that will import one pipe-delimited flat file (a utility bill) to multiple data tables based on the value of the first column. I have been told it is similar in format to an EDI file, but there are some differences.
The number of columns is consistent where the first columns are the same. Meaning a record that has '00' in the first column will always have 10 columns; a record that has '01' in the first column will always have 9 columns; etc.
Each value in the first column represents a separate destination data table. Meaning a record that has '00' in the first column should be output to table '00'; a record that has '01' in the first column should be output to table '01'; etc. All
destination tables reside on the same SQL Server.
Identifier columns can repeat multiple times throughout the flat file. Meaning a record that starts with '01' may be repeated multiple times in the same.
Sample Data:
00|XXXXXXXX|XXX|XXXXXXXX|XXXXXX|XXXX|X|XXXXXXXXXX|XX|XXXXX
01|XXXXXXXXXXX|XXX|XXXXXXXX|XXXXX|XXXXXXXXXXXXXXXXXXXX|XXXXXXXXXX|XXXXXXX|XXXXXXXXXXXXXX
02|XXXXXXXXXXX|XXXXXXXX|XXXXXXX|XXXXX|XXXXX|XXXXX|XXXXX|XXXXX|XXXXX|XXXXX|XXXXX
04|XXXXXXXXXXX|XXXXXXXXXXXXX|XXX|XXXXXXXX
05|XXXXXXXXXXX|XXXXXXXXXXXXX|XXX|XXXXXXXX|XXXX
07|XXXXXXXXXXXXX|X|XXXXXXXXXXXXXXX|XXX|XXXXXXXX|XXXX|XXXXXXX|XXXXXXXXXXX
07|XXXXXXXXXXXXX|X|XXXXXXXXXXXXXXX|XXX|XXXXXXXX|XXXX|XXXXXXX|XXXXXXXXXXX
07|XXXXXXXXXXXXX|X|XXXXXXXXXXXXXXX|XXX|XXXXXXXX|XXXX|XXXXXXX|XXXXXXXXXXX
07|XXXXXXXXXXXXX|X|XXXXXXXXXXXXXXX|XXX|XXXXXXXX|XXXX|XXXXXXX|XXXXXXXXXXX
01|XXXXXXXXXXX|XXX|XXXXXXXX|XXXXX|XXXXXXXXXXXXXXXXXXXX|XXXXXXXXXX|XXXXXXX|XXXXXXXXXXXXXX
02|XXXXXXXXXXX|XXXXXXXX|XXXXXXX|XXXXX|XXXXX|XXXXX|XXXXX|XXXXX|XXXXX|XXXXX|XXXXX
04|XXXXXXXXXXX|XXXXXXXXXXXXX|XXX|XXXXXXXX
Any help would be appreciated.

Hi koldar.308,
If there are few distinct values in the first column, we can use Flat File Source connect to that flat file, then use Conditional Split Transformation to split the first column to multiples, and then load the data to multiple tables with OLE DB Destination
based on the outputs of Conditional Split.
After testing the issue in my environment, please refer to the following steps to achieve this requirement:
Drag a Flat File Source connect to that flat file with Flat File Connection Manager.
Drag a Conditional Split Transformation connects to the Flat File Source.
Double-click the Conditional Split Transformation, add several Output based on the first column values as below:
Drag same number OLE DB Destinations as the outputs of Conditional Split, connect to Conditional Split with one case output:
If there are any other questions, please feel free to ask.
Thanks,
Katherine Xiong
If you have any feedback on our support, please click
here.
Katherine Xiong
TechNet Community Support

Error in Importing Flat file by FDMEE

Hi,
I am trying to import a Flat File through FDMEE in a BSO Cube , but its throwing error at the import step only
Error in FileData.importData Traceback (most recent call last): File "<string>", line 39, in importData
RuntimeError: Exception in the file import servlet call
I am not using any import script , I am trying to import a simple flat file with a Rule to import it (Workflow->Data Load Rule).

Hi Sharad,
How did you rectify the issue mentioned:
Error in FileData.importData Traceback (most recent call last): File "<string>", line 39, in importData
RuntimeError: Exception in the file import servlet call
I am facing the same issue and would really appreciate if I can get any guidelines or related document on fixing this issue.
Please provide help on this at the earliest as this issue is affecting my deliverables.
Thanks,
Sumit Wadhwa

Importing Flat file into Planning 11.1.2 via empa

Hi all,
I have imported diemension using flat file into dimension library ,when i right click on to CURRENCY dimension i found 2 options A)shared libary B)application
when i clicked on to that application i couldnt find the application .Create application using Classic Planning .Epma has its own respository i need to import the metadata currency into demotst2

In order to import into a planning app you need to convert it to EPMA format. You indicate that the planning application is a classic application.
In EPMA you need to convert the classic app then you will be able to import the flat file
JTS

Import flat file

hi
all,I am newbie to this forum .
Can u pls tell me "how to import a flat file to database"
sanjay

Try to read about "External Table" and "SQL Loader".

SSIS: Why do columns become misaligned when importing flat files?

Hi All
I am stumped with the following.
When I try to load a fixed length flat file into a table, the first few thousand records load correctly but then the columns start going out of sync.
Visually it looks like the data is drifting off to the right. Below is what the table looks like when the load completes:
Col1    Col2    Col3    Col4
1        1         1         1
1        1         1         1
1        1         1         1
   1        1         1         1
    1        1         1         1
      1        1         1         1
        1        1         1         1
Additional info:
1. The file has 400 000 records.
2. The first few thousand records load OK.
3. Source file is a flat file, fixed length, no delimeters.
4. All rows are same length, with LFCR.
I tried using a script task to check with C# if all rows are the same length and has the same line terminator, and could not pick up anything out of the ordinary.
What could be the cause?

Thank you for the reply.
I discovered the source of the problem, but still don't understand how to solve it.
There is one extra character in one of the columns every few thousand lines. This is the character: �
I don't understand why all the rows following a corrupt row is shifted by one character and not just the effected row?
Secondly, via a script task, SSIS indicates that the length of the row is still the same, despite the extra character. Is it possible that SSIS does not recognize this character and this is what is causing all columns to shift / mis-align?

How to import flat file with date in filename on a regular basis

Hi,
Using OWB 11gR1
I have a file that will be delivered to an FTP each night with the date in the filename having the form YYYYMMDD-FILE.txt (ex: 20100326-FILE.txt) that I want to import to an external table.
Now I've set up the import to the external table but am only able to import files that I specify the name for exactly. I've tried pointing to filenames such as "*-FILE.txt" and "%-FILE.txt" but that only results in errors.
It must be possible to automatically import files with different filenames but the same structure, or isn't it? Could anyone help me solve this it'd be greatly appreciated.
Thank you in advance.

Hi
For dynamic files you can;
1. either do the DDL on the external table to point to the file with the changing name
2Copy the file to a fixed name before using the external table/maps
3. Use the preprocessor to cat/pipe these files for the external table. See the post here http://blogs.oracle.com/warehousebuilder/2009/06/file_staging_using_external_table_preprocessor.html it shows using gunzip but could simply be doing 'cat' on a bunch of files to standard output
Cheers
David

Import Flat File to file module

hello,
i have created owb file location and file module with OMBPlus.Now I want to import my sample.csv file to file module .How can I do so in OMBPlus ?
regards,
tanveer

Hi Tanveer
The import wizard is a GUI too, you can run the GUI wizard from OMBPlus, or just build the OMB commands to describe your file.
See the data mover expert for sample usage of the wizards if that is what you want:
http://www.oracle.com/technology/products/warehouse/htdocs/Experts/datamover.zip
Cheers
David

SSIS Flat File Source not populating varchar column

I have SSIS package that imports flat files with column separator | from "Flat File Source" into the database trough "OLE DB Destination".
For one of the columns (file contains UIDs in curly brackets) destination column is varchar(250) null-able, when "Retain nulls" is set to true complete data have been imported, but when "Retain nulls" is set to false beside fact that in
the file data is not null and it is not empty string it is not imported and in the destination column is empty string.
I know that this "Retain nulls" applies to the columns that contains NULLs but this is not the case.
If someone have experience with such issue please help.
Thank you in advance.

From your statement it looks like when you have curly brackets it skips the value and inserts nulls instead. And that may be the reason why its working fine when you change retain null value.
I would suggest
Make your setting "retain null" to true and load the flat file, then check what happens to the values having curly braces (is there any value or null) , if there is value we need to check for that(please share a sample file). And if it having null
instead of "{value}", I would suggest to put a script task to remove { from your flat file and then try load the data.
Hope this helps.
Regards, -Amit

Uploading Importing text file & crosstab display

 I want to upload a text tab delimited file into our db, currently we
are uploading it to a temp table in the db, do some validation checks and write
to a table when done. I have two questions:
 1) Is there a more efficient way of upload/importing flat files into
the db via forms, like loading data into a non db data block and working on the
data via loops rather than sql in a temp table.
 2) I want to present the data to the user(for verification) via a form
screen as they have read it in, the only way I can think of doing this, is
populating a temp table and then using a data block based on a stored procedure
that contains a dynamic pivot query package since I don't know the
number of columns that the file will contain. Data blocks can do either
vertical or horizontal alignment but not grid.
 File will take the format of: 
 col1 col2 col3
row1 data_r1c1 data_r1c2 data_r1c3
row2 data_r2c1 data_r2c2 data_r2c3
row3 data_r3c1 data_r3c2 data_r3c3
row4 data_r4c1 data_r4c2 data_r4c3
 
 Thank you in advance 

Thank you for your reply
1) It's a utility for users and so it has to be through forms
Presently I think it is better to read it in to a temp table then I can use sql for validation which would be faster than looping through blocks. But with this approach I'm just a little worried about Lost Updates e.g. what if someone is changing scores in the regular update screen while another person is trying to import them via the import utility.
2) I have to use a stored procedure because I don't know how many columns a user will want to load in, sometimes it could be 2,3 or 5 etc. So basically I am looking at a way of presenting the data from it's stored format in it's read in format i.e. file format
File format =
 col1 col2 col3 coln
row1 data_r1c1 data_r1c2 data_r1c3 data_r1cn
row2 data_r2c1 data_r2c2 data_r2c3 data_r2cn
row3 data_r3c1 data_r3c2 data_r3c3 data_r3cn
rown data_rnc1 data_rnc2 data_rnc3 data_rncn
It is stored in the temp table as
row1 col1 data_r1c1
row2 col1 data_r2c1
row1 col2 data_r1c2
row2 col2 data_r2c2
Example
 Test1 Test2 Test3 Test4
John 54 45 70 65
Jane 38 55 72 70
Stored in the temp and subsequently written to Student Score table as
Student Test Score
John Test1 54
John Test2 45
John Test3 70
John Test4 65
Jane Test1 38
Jane Test2 55
Jane Test3 72
Jane Test4 70

Importing flat file

Similar Messages

Maybe you are looking for