Issue with flat file load

Hello,
I am trying to load data via flat file. we have entries in a field which starts with 0s are skipped when we load in CSV format.
like i have an entry 00657, is being loaded as 657 .
How can i prevent this?
Thanks.
Praveen

Hi Praveen,
It is of lenghth 5. but when i upload CSV file it is not considering 00 infront. But i want those. I am loading hierarchy from flatfile.
Suggest me, if we can also load from text ?.
Thanks.
Praveen

Similar Messages

Issue with flat file loading timing out

Hello
I have a scenario, where I am loading a flat file with 65k records into a cube. The problem is, in the loading process, I have to look up the 0Material table which has a million records.
I do have an internal table in the program, where I select a subset of the Material table ie around 20k to 30k records. But my extraction process takes more than 1 1/2 hrs and is failing (timed out).
How can i address this issue? I tried building indexes on the Material table and its not helping.
Thanks,
Srinivas.

Unfortunately, this is BW 3.5, so there is no END routine option here. And I tried both .csv and notepad file methods, and both are creating problems for us.
This is the total code, do you guyz see any potential issues:
Start Routine (main code)
refresh i_oldmats.
refresh ZI_MATL.
data: wa_datapak type transfer_structure.
loop at datapak into wa_datapak. (** I collect all the old material numbers from my flat file into an internal table i_oldmats**)
   i_oldmats-/BIC/ZZOLDMATL = wa_datapak-/BIC/ZZOLDMATL.
   collect i_oldmats.
endloop.
sort i_oldmats.
SELECT /BIC/ZZOLDMATL MATERIAL (** ZI_MATL only has recs. where old materials exist, this gets about 300k records out of 1M**)
         FROM /BI0/PMATERIAL
         INTO ZI_MATL FOR ALL
         ENTRIES in i_oldmats WHERE
          /BIC/ZZOLDMATL = i_oldmats-/BIC/ZZOLDMATL .
            collect    ZI_MATL.
Endselect.
Sort ZI_MATL.
Transfer rule routine (main code)
IF TRAN_STRUCTURE-MATERIAL = 'NA'.
    READ TABLE ZI_MATL INTO ZW_MATL
    WITH KEY /BIC/ZZOLDMATL = TRAN_STRUCTURE-/BIC/ZZOLDMATL
    BINARY SEARCH.
    IF SY-SUBRC = 0.
      RESULT = ZW_MATL-MATERIAL.
    ENDIF.
ELSE.
    RESULT = TRAN_STRUCTURE-MATERIAL.
ENDIF.
Regards,
Srinivas.

Problem with flat file loading/Special characters

Hi, All,
We just migrated from Version 3.0B to BI7.0, and I've a problem which I can't handle for the moment. We are in Unicode, current codepage of the server is 4103 and codepage of frontend is 4110 (from SNL1 Transaction).
I'm loading czech texts in my material, via CSV files. The CSV file is correct on my PC, I see the special characters.
The problem is on my loading, whatever Character set I choose in the Infopackage (I choose Standard or Character Set Setting User-dependant), I cannot see the good characters.
Does any one of you already encounter this kind of problem, and, if yes, how did you solve it ?
Thanks

hi,
check out with your flat file letter's type, if it's in lower case letter's change them in
upper case letter's. or otherwise change the infobject's type as-- select check box
corresponding to lower case letter's in infoobject.
if helpful provide points
regards
harikrishna.N

Issue in Flat File load through FTP set up

Hi All,
I am trying to load the flat file using FTP set up ( through process chain ).
I put a file in the FTP server, the file is being picked up from the FTP server but I cannt see the same in Interface file manager (ZIFM) under unfinished or comleted jobs.
I am not able to understand where is the eror?
any suggestion for this would be of great help.
regards
Amol
Edited by: Amol Jaiswal on Nov 8, 2008 12:33 PM

i don't get you.
You are trying to FTP a file to your application server in your process chain; is that correct?
Marco

Issues with WSDL file loading in BPEL process Composite

hi',
I am facing lot of issues in 11G
I am using:-->"Jdeveloper Studio Edition Version 11.1.1.2.0"
When I am trying to open a already working composite from a different machine in my machine, it start giving error
it is unable to build "Unable to load WSDL file", I have all the webservices in different machine OSB and my machine
is targeting that machine OSB with IP address, In my BPEL process I am using localhost, I am able to see all the methods
in composite and dosent shows any error, but when I try to compile it it gives unable to load WSDL file.
please advice,
thanks
Yatan

I suppose, any unhandled exception in the one-way BPEL process could have caused rollback of the instance and hence the instance might not be seen. Add fault handlers-catch/catch-all blocks in the one-way BPEL process if not done already, and test.

Flat-File Loading problem

Hi Friends,
I am struggling with flat-file loading problem. I am trying to load a .csv file into data target. I took all pre-cautions while loading data. I look into preview and simulate the data. Everything is ok, but when i schedule the data, i found 0 records in the monitor. The following is the STATUS message of the above problem:
   No data available
Diagnosis
The data request was a full update.
In this case, the corresponding table in the source system does not
contain any data.
System response
Info IDoc received with status 8.
Procedure
Check the data basis in the source system.
         Can anybody help me what is the problem and procdure to resolve it?
Regards,
Mahesh

Hi Eugene,
Thanks for the quick reply. The following screen-shot tells you the messages of detail tab;
OVER ALL STATUS MISSING WITH MESSAGES OR WARNINGS
REQUEST: MISSING MESSAGES
EXTRACTION
EVERYTHING IS OK
DATA REQUEST RECEIVED
NO DATA AVAILABLE DATA ELECTION ENDED.
PROCESSING
NO DATA
           The above message was shown in details tab. Pls guide me to locate the problem.
Regards,
Mahesh

Flat File loading Initialize with out Data transfer is disabled in BI 7.0

Hi experts,
When loading through flat file in BI 7.0 for Info Package Level Initialization Delta Process with data Transfer is coming by default,but when i want to select Initialization Delta Process without Data transfer is disabled. (in the creation of Data Source (flat file) in the Extraction Tab Delta Process is changed to FIL1 Delta Data (Delta Images).
please provide me Solution.
regards
Subba reddy.

Hi Shubha,
For flat file load please go throught he following link:
http://help.sap.com/saphelp_nw70/helpdata/EN/43/03450525ee517be10000000a1553f6/frameset.htm
This will help.
Regards,
Mahesh

Transformation not generating-Flat file loading

Hello guys, I hope you can help me with this little confusion I have on BI7 Flat file loading.
I got a File (CSV) on my workstation. I am trying to load Master Data. Here is the example of my file and issues:
Lets say, I have CSV file named "CarModel.CSV" on my PC.
This excel file has 10 Records and No atributes for this Field.
So the records should show like this and it is showing correctly in PSA level, DS level.
A
B
C
D
E
F
My goal is to load Flat file data to InfoObject (inserted in Infoprovider)
I created Source system, DS, all thats stuffs.
I am now on Display DS screen under Proposal Tab. I am putting 10 Records to show and hitting Load example data....it works fine by showing all 10 records. However in the bottom part of this screen, what should show as a Field ?In my case , First it was showing the First Record ("A")...i didnt think it was correct but i prceeded anyways. Transformation could not be generated.
I tried by deleting "1" from the field "No. of header rows to be ignored" and its the same result ..No transformations.. I mean i know its very simple to load this data but i am not sure what i am doing wrong..My question is:
1) What should show under Field/propasal tab in my case?am i supposed to create this Field?
2) Should the system to propse the field which is from my flat file header ?in my case i dont have any header..should i have include header in my csv file like "car model"? i am confused please give me some info thanks
dk

Hi,
In filed tab, u have to enter ur infoobject names in an order...and press enter it'll automatically give the description and its other factors...
i guess u shuld have some header in the sense eg: customer,cust ID like this..this only u have to enter as fields...in proposal tab...try that
rgds,

Key Range with Flat File

Hi people, Anybody has a example how it works Key range with Flat file ? Tks

Hi All, I have one scenario to read the source file . The file delimiter is '|' . The no of pipeline for each line is 17. So if a line containing more than 17 , send an error email. For this first i am printing tota pipeline in ecah line to afile called pipelinecount.txt . Then i will read this file and send each value to while loop /for loop , where it will get > 17 , it will exit the process and send an email. But here in script i am getting error at while line. Could anyone help. #! /bin/kshset -x SOURCE_DIR=/vp01/SrcFilessed 's/[^|]//g' /vp01/SrcFiles/Test.txt | awk '{ print length }'> /vp01/SrcFiles/pipelinecount.txtcd $SOURCE_DIRwhile line in `cat pipelinecount.txt`; do if [ $line -eq 17 ];thenecho "No issue in pipeline"exit 0;fiif [ $line -gt 17 ];thenecho "No of pipelines exceeded the expected. Please verify the source file." | mailx -s "WKFS Load: Failed" [email protected]

How to built a hierarchy with flat file?

Hi Experts,
for a better representation of the report, i need to built a hierarchy with flat file.
The Data load is via Flat file.
Do you have some documentation about that?
Thanks
Cheers
Gilo

Hi Gilo,
Check these docs...
<a href="https://www.sdn.sap.comhttp://www.sdn.sap.comhttp://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/0403a990-0201-0010-38b3-e1fc442848cb">How to Download a Hierarchy to a Flat File</a>
<a href="http://help.sap.com/saphelp_nw04/helpdata/en/fa/e92637c2cbf357e10000009b38f936/content.htm">Uploading Hierarchies from Flat Files</a>
<a href="http://sapbwneelam.blogspot.com">More Docs...</a>
Hope it Helps
Srini

Issue importing flat files into SQL server 2008R2

I have csv files that the last column may not have data. SSIS (version 2008R2) will insert the next row's data into the empty cells, which causes my package to fail.
I know this is resolved in 2012 but we are using 2008R2 still. Any suggestions?
Thanks.

Hi sqlBI2014,
After testing the issue that Flat File Connection Manager cannot handle file with uneven number of columns in each row in my SQL Server 2008 R2 environment, I can reproduce it.
Based on my research, the issue is caused by the Column Delimiter gets first preference and then Row delimiter. So the next row data would be inserted in the empty column cell. This is by design in SQL Server 2005, SQL Server 2008 or SQL Server 2008 R2.
Good news is that the issue is fixed in SQL Server Data Tools which comes with SQL Server 2012. In SQL Server 2012, by default, the Flat File Connection Manager always checks for a row delimiter in unquoted data, and starts a new row when a row delimiter
is found. This enables the connection manager to correctly parse files with rows that are missing column fields.
If you still want to fix the issue in SQL Server 2008 R2, there is a sample component posted to the CodePlex that might help you with this:
http://ssisdfs.codeplex.com/
References:
http://blogs.msdn.com/b/dataaccesstechnologies/archive/2013/03/13/flat-file-source-cannot-handle-file-with-uneven-number-of-columns-in-each-row.aspx
https://connect.microsoft.com/SQLServer/feedback/details/293193/ssis-import-of-flat-file-with-uneven-number-of-columns
Thanks,
Katherine Xiong
Katherine Xiong
TechNet Community Support

Flat File loading into Hierarchy

Dear Gurus,
I am trying to load a hierarchy from a flat file. I am not able to do it successfully.
I have a small doubt. Do we need to load the master data into the master data table before loading the hierarchy?
Explanation:
I have an info object zcountry and i had added zzone and zstate as external characteristics in hierarchy. the hierarchy structure should be country with 2 nodes zone1,zone2 and zone one should have 2 states under it as nodes. In this case do I need to maintain the master data in the infoobjects before loading the hierarchies with flat file.?
<b>Node ID     InfoObject     Node Name     Link     Parent ID     Language     Short-Txt     Medium-Txt     Long-Txt</b>
1;     zcountry;     CountryNode;          0;     en;     CountryNode;     CountryNode;     CountryNode;
2;     zzone1;     SouthZone;          1;     en;     SouthZoneNode;     SouthZoneNode;     SouthZoneNode;
3;     zstate;     AndhraPradesh;          2;     en;     AndhraPradesh;     AndhraPradesh;     AndhraPradesh;
4     zstate     Karnataka          2     en     Karnataka     Karnataka     Karnataka
5     zzone1     NorthZone          1     en     NorthZoneNode     NorthZoneNode     NorthZoneNode
6     zstate     Haryana          5     en     Haryana     Haryana     Haryana
7     zstate     Rajastan          5     en     Rajastan     Rajastan     Rajastan
This is how the flat file looks like.
Kindly give me a solution.
Regards
Mohan Kumar.
Message was edited by:
        mohan kumar
Message was edited by:
        mohan kumar

Dear Gurus,
I also followed the same weblog but still i am not able to do that. That is the reason why I asked the question in that detail (with the data I am trying to load).
Regards
Mohan Kumar

Working with flat file as source in owb 10.2

Hi,
I am working with flat file as source . While validating the mapping i am getting the following error like
" to specify a data file configure the mapping , add a node under ' Source data file', type in the file name
and select the file location."
Please give me the suggestion . It is very urgent.

Hi Venkat,
I tried the following stepts.
1. in Design Center select your mapping and right click and select configure
2. select sql loader data files and select create
3. On right hand side data file Name : enter your source file name (ex : source.csv)
4. click ok button.
5. open mapping and validate.
The mapping is validating. After validating I deployed the mapping. Up to this the mapping is working fine.
But when I start the mapping, It has completed with errors.
The error message is:
Status
Error Log
RPE-01013: SQL Loader reported error condition, number 1.
LRM-00112: multiple values not allowed for parameter 'control'
Job Summary
Updated : 2009-02-24 15:32:43.0 Job Final Status : Completed with errors Job Processed Count : 1 Job Error Count : 1 Job Warning Count : 0
Please give me the suggestions.
Thanks,
Venkat

Journal unposting with flat file

Dear Experts,
is it possible to unpost journal using flat files and loading it via load journals?
Thanks for your help,
Best regards,
Benoit

Nope. Any posted journal is untouchable through a flat file load. Technically, you don't post journals through a flat file load either. You actually overwrite the existing working/rejected journal and replace it with a journal of posted status.
Because posted journals cannot be overwritten, it's not possible to go in reverse.

What are the settings for datasource and infopackage for flat file loading

hI
Im trying to load the data from flat file to DSO . can anyone tel me what are the settings for datasource and infopackage for flat file loading .
pls let me know
regards
kumar

Loading of transaction data in BI 7.0:step by step guide on how to load data from a flatfile into the BI 7 system
Uploading of Transaction data
Log on to your SAP
Transaction code RSA1LEAD YOU TO MODELLING
1. Creation of Info Objects
In left panel select info object
Create info area
Create info object catalog ( characteristics & Key figures ) by right clicking the created info area
Create new characteristics and key figures under respective catalogs according to the project requirement
Create required info objects and Activate.
2. Creation of Data Source
In the left panel select data sources
Create application component(AC)
Right click AC and create datasource
Specify data source name, source system, and data type ( Transaction data )
In general tab give short, medium, and long description.
In extraction tab specify file path, header rows to be ignored, data format(csv) and data separator( , )
In proposal tab load example data and verify it.
In field tab you can you can give the technical name of info objects in the template and you not have to map during the transformation the server will automatically map accordingly. If you are not mapping in this field tab you have to manually map during the transformation in Info providers.
Activate data source and read preview data under preview tab.
Create info package by right clicking data source and in schedule tab click star to load data to PSA.( make sure to close the flat file during loading )
3. Creation of data targets
In left panel select info provider
Select created info area and right click to create ODS( Data store object ) or Cube.
Specify name fro the ODS or cube and click create
From the template window select the required characteristics and key figures and drag and drop it into the DATA FIELD and KEY FIELDS
Click Activate.
Right click on ODS or Cube and select create transformation.
In source of transformation , select object type( data source) and specify its name and source system Note: Source system will be a temporary folder or package into which data is getting stored
Activate created transformation
Create Data transfer process (DTP) by right clicking the master data attributes
In extraction tab specify extraction mode ( full)
In update tab specify error handling ( request green)
Activate DTP and in execute tab click execute button to load data in data targets.
4. Monitor
Right Click data targets and select manage and in contents tab select contents to view the loaded data. There are two tables in ODS new table and active table to load data from new table to active table you have to activate after selecting the loaded data . Alternatively monitor icon can be used.
Loading of master data in BI 7.0:
For Uploading of master data in BI 7.0
Log on to your SAP
Transaction code RSA1LEAD YOU TO MODELLING
1. Creation of Info Objects
In left panel select info object
Create info area
Create info object catalog ( characteristics & Key figures ) by right clicking the created info area
Create new characteristics and key figures under respective catalogs according to the project requirement
Create required info objects and Activate.
2. Creation of Data Source
In the left panel select data sources
Create application component(AC)
Right click AC and create datasource
Specify data source name, source system, and data type ( master data attributes, text, hierarchies)
In general tab give short, medium, and long description.
In extraction tab specify file path, header rows to be ignored, data format(csv) and data separator( , )
In proposal tab load example data and verify it.
In field tab you can you can give the technical name of info objects in the template and you not have to map during the transformation the server will automatically map accordingly. If you are not mapping in this field tab you have to manually map during the transformation in Info providers.
Activate data source and read preview data under preview tab.
Create info package by right clicking data source and in schedule tab click star to load data to PSA.( make sure to close the flat file during loading )
3. Creation of data targets
In left panel select info provider
Select created info area and right click to select Insert Characteristics as info provider
Select required info object ( Ex : Employee ID)
Under that info object select attributes
Right click on attributes and select create transformation.
In source of transformation , select object type( data source) and specify its name and source system Note: Source system will be a temporary folder or package into which data is getting stored
Activate created transformation
Create Data transfer process (DTP) by right clicking the master data attributes
In extraction tab specify extraction mode ( full)
In update tab specify error handling ( request green)
Activate DTP and in execute tab click execute button to load data in data targets.

Issue with flat file load

Similar Messages

Maybe you are looking for