Transformation not generating-Flat file loading

Hello guys, I hope you can help me with this little confusion I have on BI7 Flat file loading.
I got a File (CSV) on my workstation. I am trying to load Master Data. Here is the example of my file and issues:
Lets say, I have CSV file named "CarModel.CSV" on my PC.
This excel file has 10 Records and No atributes for this Field.
So the records should show like this and it is showing correctly in PSA level, DS level.
A
B
C
D
E
F
My goal is to load Flat file data to InfoObject (inserted in Infoprovider)
I created Source system, DS, all thats stuffs.
I am now on Display DS screen under Proposal Tab. I am putting 10 Records to show and hitting Load example data....it works fine by showing all 10 records. However in the bottom part of this screen, what should show as a Field ?In my case , First it was showing the First Record ("A")...i didnt think it was correct but i prceeded anyways. Transformation could not be generated.
I tried by deleting "1" from the field "No. of header rows to be ignored" and its the same result ..No transformations.. I mean i know its very simple to load this data but i am not sure what i am doing wrong..My question is:
1) What should show under Field/propasal tab in my case?am i supposed to create this Field?
2) Should the system to propse the field which is from my flat file header ?in my case i dont have any header..should i have include header in my csv file like "car model"? i am confused please give me some info thanks
dk

Hi,
In filed tab, u have to enter ur infoobject names in an order...and press enter it'll automatically give the description and its other factors...
i guess u shuld have some header in the sense eg: customer,cust ID like this..this only u have to enter as fields...in proposal tab...try that
rgds,

Similar Messages

What are the settings for datasource and infopackage for flat file loading

hI
Im trying to load the data from flat file to DSO . can anyone tel me what are the settings for datasource and infopackage for flat file loading .
pls let me know
regards
kumar

Loading of transaction data in BI 7.0:step by step guide on how to load data from a flatfile into the BI 7 system
Uploading of Transaction data
Log on to your SAP
Transaction code RSA1LEAD YOU TO MODELLING
1. Creation of Info Objects
In left panel select info object
Create info area
Create info object catalog ( characteristics & Key figures ) by right clicking the created info area
Create new characteristics and key figures under respective catalogs according to the project requirement
Create required info objects and Activate.
2. Creation of Data Source
In the left panel select data sources
Create application component(AC)
Right click AC and create datasource
Specify data source name, source system, and data type ( Transaction data )
In general tab give short, medium, and long description.
In extraction tab specify file path, header rows to be ignored, data format(csv) and data separator( , )
In proposal tab load example data and verify it.
In field tab you can you can give the technical name of info objects in the template and you not have to map during the transformation the server will automatically map accordingly. If you are not mapping in this field tab you have to manually map during the transformation in Info providers.
Activate data source and read preview data under preview tab.
Create info package by right clicking data source and in schedule tab click star to load data to PSA.( make sure to close the flat file during loading )
3. Creation of data targets
In left panel select info provider
Select created info area and right click to create ODS( Data store object ) or Cube.
Specify name fro the ODS or cube and click create
From the template window select the required characteristics and key figures and drag and drop it into the DATA FIELD and KEY FIELDS
Click Activate.
Right click on ODS or Cube and select create transformation.
In source of transformation , select object type( data source) and specify its name and source system Note: Source system will be a temporary folder or package into which data is getting stored
Activate created transformation
Create Data transfer process (DTP) by right clicking the master data attributes
In extraction tab specify extraction mode ( full)
In update tab specify error handling ( request green)
Activate DTP and in execute tab click execute button to load data in data targets.
4. Monitor
Right Click data targets and select manage and in contents tab select contents to view the loaded data. There are two tables in ODS new table and active table to load data from new table to active table you have to activate after selecting the loaded data . Alternatively monitor icon can be used.
Loading of master data in BI 7.0:
For Uploading of master data in BI 7.0
Log on to your SAP
Transaction code RSA1LEAD YOU TO MODELLING
1. Creation of Info Objects
In left panel select info object
Create info area
Create info object catalog ( characteristics & Key figures ) by right clicking the created info area
Create new characteristics and key figures under respective catalogs according to the project requirement
Create required info objects and Activate.
2. Creation of Data Source
In the left panel select data sources
Create application component(AC)
Right click AC and create datasource
Specify data source name, source system, and data type ( master data attributes, text, hierarchies)
In general tab give short, medium, and long description.
In extraction tab specify file path, header rows to be ignored, data format(csv) and data separator( , )
In proposal tab load example data and verify it.
In field tab you can you can give the technical name of info objects in the template and you not have to map during the transformation the server will automatically map accordingly. If you are not mapping in this field tab you have to manually map during the transformation in Info providers.
Activate data source and read preview data under preview tab.
Create info package by right clicking data source and in schedule tab click star to load data to PSA.( make sure to close the flat file during loading )
3. Creation of data targets
In left panel select info provider
Select created info area and right click to select Insert Characteristics as info provider
Select required info object ( Ex : Employee ID)
Under that info object select attributes
Right click on attributes and select create transformation.
In source of transformation , select object type( data source) and specify its name and source system Note: Source system will be a temporary folder or package into which data is getting stored
Activate created transformation
Create Data transfer process (DTP) by right clicking the master data attributes
In extraction tab specify extraction mode ( full)
In update tab specify error handling ( request green)
Activate DTP and in execute tab click execute button to load data in data targets.

Can we cleanse and transform data at flat file or external table level?

Hi,
I have some data that I want to cleanse and transform. I don't want to cleanse it after i populate the external table, I want to get done with it at flat file level or while populating the external table. Can we cleanse and transform data at flat file or external table level through Oracle or OWB 11.2? Is it possible to run a conditional load (i.e. having a where clause or if-else-then) for an external table? Can we call oracle functions for an external table at the time of creation?
Thanks in advance.
Regards,
Ann.

Hi Oleg,
Thanks a lot for the clarification. :)
So is there a way that I can clease the data within the text file through Oracle or OWB? I have datatype mismatches in the data and most of my data is getting rejected because of that. The way I can think of, for solving this problem, is to create the external table with all fields with datatype varchar and then cleansing the data. But it doesn't seem very effecient plus it will get very complicated because I have almost 80-90 fields.
Any help?
Thanks and regards,
Ann.

Flat-File Loading problem

Hi Friends,
I am struggling with flat-file loading problem. I am trying to load a .csv file into data target. I took all pre-cautions while loading data. I look into preview and simulate the data. Everything is ok, but when i schedule the data, i found 0 records in the monitor. The following is the STATUS message of the above problem:
   No data available
Diagnosis
The data request was a full update.
In this case, the corresponding table in the source system does not
contain any data.
System response
Info IDoc received with status 8.
Procedure
Check the data basis in the source system.
         Can anybody help me what is the problem and procdure to resolve it?
Regards,
Mahesh

Hi Eugene,
Thanks for the quick reply. The following screen-shot tells you the messages of detail tab;
OVER ALL STATUS MISSING WITH MESSAGES OR WARNINGS
REQUEST: MISSING MESSAGES
EXTRACTION
EVERYTHING IS OK
DATA REQUEST RECEIVED
NO DATA AVAILABLE DATA ELECTION ENDED.
PROCESSING
NO DATA
           The above message was shown in details tab. Pls guide me to locate the problem.
Regards,
Mahesh

Unit Code, Commercial Code - Flat File loading vs BPS Loading

Hi SDN Community,
Recently, we have moved our flat file loading to be performed by BPS interfaces.
During flat file loads, the Commercial code of all units of measures, are verified.
eg.DAY
But when loaded by BPS, the UNIT code is verified.
eg. TAG.
In the display of the BPS upload, it displays DAY which is the commercial code.
The only thing, is the customer is forced to use TAG in the BPS upload files.
They wish to create another record in the transaction
CUNI to be
Unit code = DAY
Commercial code = DAY.
However, i have found that we cannot allocate the same commercial code to another unit code.
Is this a design constraint, or a process error that i am doing.
Thank you.
Simon

04.01.2010 - 02:22:53 CET - Reply by SAP
Dear customer,
As i do not fully understand how this works, but the base table T006A
has 2 entries, 1 for english, 1 for German, should it not be that the
English EN entry field be working rather that the German DE, hence DAY
should be used? Can you please confirm my understanding on this?
>>> If you check my attachment "SE16.xls", you can see that it's for
language >>English<<, and the internal format is TAG while the external
format is DAY.
- Are there any plans to modify the BPS functionality in newer SAP BW
versions to allow the customer to indicate the same UOM as per flat
file laods? Or is an upgraded Support Pack that allows this?
- If not, would it be possible to make any customer enhancements to
allow this to take place depending on customer requirements.
>>> There is no plan at this moment to change this BPS functionality
in newer SAP BW versions or support packages.
We really recommend you to use internal format TAG in the upload file
in BPS which I think should be acceptable and feasible to you. All
other ways trying to use external format is risky and we cannot assure
you that it will work well as it's not SAP standard function. (I think
it's not worth the risk as the standard function which requires
internal format should not be too unacceptable)
Thanks for your understanding.
I also don't think my BC-SRV-ASF-UOM colleague would be able to help
you a lot regarding this.
Best Regards,
Patricia Yang
Support Consultant - Netweaver BW
Global Support Center China
SAP Active Global Support

Customized Seeded report to XMLP report but its not generating output file?

I want to customize "Dunning Letter Print from Dunning Letter Generate" Report, which is called from "Dunning Letter Generate" Report
Steps i followed to Customize reports are.
1. Changed output format to xml for "Dunning Letter Print from Dunning Letter Generate" Report.
2. Ran report to generate xml data and using xml data created RTF file
3. Registered data definition and template with code and short name same which is ARDLP_NON_SRS
Now while i am running report its completing normal, but its not generating output file giving Error like –
"Unable to find Published Output for this request"
“No Output File Exist for Request No - xxxxx”
No Idea why its not picking template, Can anyone help me in this?
Using:
Oracle Applications : 10.0.5.2,
MS Word 2007
Thanks,

I am not giving the solution, providing you a hint..
This is the query you need to satisfy,
SELECT NVL(R.DESCRIPTION ,CP.USER_CONCURRENT_PROGRAM_NAME)
FROM FND_CONCURRENT_REQUESTS R, FND_CONCURRENT_PROGRAMS_VL CP,XDO_DS_DEFINITIONS_B XDS
WHERE ( ( FND_PROFILE.VALUE('CONC_REPORT_ACCESS_LEVEL') = 'U'
AND R.REQUESTED_BY = :$PROFILES$.USER_ID ) or
( FND_PROFILE.VALUE('CONC_REPORT_ACCESS_LEVEL') = 'R'
AND R.RESPONSIBILITY_ID = :$PROFILES$.RESP_ID ) )
AND R.PROGRAM_APPLICATION_ID = CP.APPLICATION_ID
AND R.CONCURRENT_PROGRAM_ID = CP.CONCURRENT_PROGRAM_ID
AND XDS.APPLICATION_SHORT_NAME=
( SELECT APPLICATION_SHORT_NAME
FROM FND_APPLICATION
WHERE APPLICATION_ID=CP.APPLICATION_ID)
AND XDS.DATA_SOURCE_CODE = CP.CONCURRENT_PROGRAM_NAME
AND R.OUTPUT_FILE_TYPE='XML'
AND R.STATUS_CODE not in ('E', 'D', 'T', 'X')
ORDER BY R.REQUEST_ID DESC
Go to system profiles and query for 'Concurrent:Report Access Level', responsibility you need and modify the profile name accordingly....

Flat File loading Initialize with out Data transfer is disabled in BI 7.0

Hi experts,
When loading through flat file in BI 7.0 for Info Package Level Initialization Delta Process with data Transfer is coming by default,but when i want to select Initialization Delta Process without Data transfer is disabled. (in the creation of Data Source (flat file) in the Extraction Tab Delta Process is changed to FIL1 Delta Data (Delta Images).
please provide me Solution.
regards
Subba reddy.

Hi Shubha,
For flat file load please go throught he following link:
http://help.sap.com/saphelp_nw70/helpdata/EN/43/03450525ee517be10000000a1553f6/frameset.htm
This will help.
Regards,
Mahesh

Best practise around handling time dependency for flat file loads

Hi folks,
This is a fairly common situation - handling time dependency for flat file loads. Please can anyone share their experience around handling this. One common approach is to handle the time validity changes within the flat file where it is easily changeable by the user but then again is prone to input errors by the user. Another would be to handle this via a DSO. Possibly, also have this data entered directly in BI using IP planning layouts. There is a IP planning function that allows for loading flat file data but then again, it only works without the time dependency factor.
It would be great to hear thoughts or if anyone can point to a best practise document for such a scenario.
Thanks.

Bump!

Flat file load Error 1

Hi ,
Iam trying to load flat file to infoobject. when i tried to load it , iam getting an error ( see below), iam not getting this error when i loaded in dev and Quality. only getting error in Production. the file contain only 2 records.
is there any access required rights required in production ?
Error 1 when loading external data
Message no. RSAR234
Diagnosis
Error number 1 occurred when loading external data:
1. Error when reading the file (access rights, file name, ...)
2. File size or number of records does not correspond to the data in the control file
3. Error when generating the IDoc
4. File contains invalid data (errors with an arithmetic operation or data conversion)
Procedure
Check whether you have the required access rights and whether the data in the control file is correct (file names, record length, number of records, ...). Correct the data in the control file if necessary and check the data file for invalid data (values of the wrong type, values in the wrong format for conversion exit,...). Check whether the file has headers that have not been specified.

Hi
Check your Authorization for Loading the Flat File/ Access the work Station from AL11 ..
Check your Transformation Rule Details for the Conversions / Data Types are mapped correctly.
If Infopackage loads data from a flat file on your workstation, then you cannot execute the Infopackage in a Process Chain you need to put your flat file on the Application Server(AL11) and change your Infopackage to load from there instead of the workstation
The file should be closed while scheduling
The file path mentioned in the external data tabpage of the infopackage should be correct
Records in the file should be in uppercase you can use lowercase for a particular characteristic.provided the lowercase checkbox in the general tabpage of the maintenance screen of the infoobject is checked.
Calendar day should be of the format yyyymmdd in the file
Hope it helps

Flat File Loading

Hi Experts,
I am loading data from Flat File to DSO.I got the following error while activating Data in DSO.
"No SID found for value ' 0500136A' of characteristic 0MAT_SALES"
I have checked in Material sales master data I have the value 0500136A in .If you see above error it showing some space in front of 0500136A.I am not seeing that space in master data.I was edidted again and loaded to DSO and activated Then I got same error.Is it problem with Excel File formatting related.Pls through some light onthe issue.
Thanks,
Suryam.

Hi All,
Thank you.
Khaja,
I got the data upto PSA is fine and I am able to load the data in to DSO but I got the error while activating DSO
Ashok,
I loaded master data before loading Transactional data.May be it problem with file format.How can I check these format issues.
Brian,
We are using Transformation in BI7.0.I tried put conversion in DataSource level i.e Alpha for the field.But still I am getting same error.
Pls advice me on the above issue.
Thanks,
Suryam.

Regarding flat file load to DSO...

Hi Experts,
I am trying to load transaction data from flat file to DSO in BI7.0 that comprises two characteristics and one keyfigure. The characteristics type is char and keyfigure's type is int. Till PSA, data is fine. In transformation, I have just done one-to-one mapping with source field and target field, but while executing DTP, the error popped up as follows,
Data package 1:Errors during processing
Extraction completed, processing termination
Please help. I tried various combinations, but not able to schedule. Valuable answers would be awarded remarkably.
Thanks,

Hi there...
Here are some ideas to Ur problem
Assuming that u defined info objects correctly, length and types... and u mapped transformations correctly
And ur data in flat file is absolutely correct...
Of course very common but suggestible is plz check the data lengths in flat file and defined length of the info object.. If yes
Come to Data source and check the settings for the flat file ,separater and escape sign and rows to ignored..and check the data preview...
Plz compare the data in PSA and Flat file... plz do this very carefully... If yes...
Go to data source and at the FIELDS tab and check whether u assigned info objects correctly...if yes...
Check the conversion routines in the same screen of the tab FIELDS.. if for key figure u see PER16.. Remove it and try to load to PSA and do load the cube..
Hope this can give u an idea...
Regrds...KP

BI7 Flat file loading

Hello
I am trying to load flat file from my workstation to BI. I have a transaction data, in which 4 chars IO filed and 3 KFs field. I am little confusion about loading in BI7 since Infosource , TR, UR not required.
I am creating flat file source system and DS as well. I have info obj catalog for both Chars and kfs. do i have to load master data first ?before loading transactional? i have data in excel format all master data in different file , and also Transaction data (include MD and kfs) in one file. can i just create DS for transaction data and then load or i have to create DS for each Chars IO to load master data first?
when i tried to create DS fro trans data , for some reason under proposal tab it only populates one field, FIELD1, i assume i ll have to go to Field tabe and manuall select all fields by adding new rows..
Could someone give me some idea on how to do the loading to infocube? i also tried to create Transformation , it gave me an error..
when we create DS for transactional data using Flat file , wouldnt system supposed to map all the DS fields to the cube using Transformation, but its not happening to mine, please help...
thanks
DK

Hi........
Before loading transaction data you have to load Master data...
1) For each master data....ie IO.....you have to create one datasource.........
You have to create datasource using tcode : RSO2.......
The General tab is same for all datasource........
In the Extraction tab...
Real Time>> RDA is not supported......
Adapter >> Load text type file from work station
Name of the file >> select your file
Header rows to be ignored >> 1
Character set settings >> Default
Data format >> Seperated with seperator...
Data seperator>>;
Escape sign >> #
Number format >>Direct entry
Thousands seperator>>.
Decimal point seperator>>,
SAP suggests the use of header row ,as the system can use this header information to help define fields on the file.
The Proposal tab reads the header row and proposes field names and type..........here you have to choose load example data and take a look at the proposed list.Make sure that all fields are flagged Copy to Fieldlist......This proposed field is derived from the header line and contents of your flatfile....
These proposed fiels and types can be changed in Fields tab........At this point you need to check if the field types and lenth are correct......In some cases proposal will not be accurate,and you will need to adjust the field types and length on the fields tab.....
You file should be saved as .csv format.........
2) Then you have to create an infopackage and load data till PSA......
3) Then create transformation between the datasource(PSA) and the target(IO).........
4)Then create DTP and load data..........
After this in the same way you have to create datasource for transaction data...........the infopackage..........transformation ........DTP........process is same...........
Check this link :
http://help.sap.com/saphelp_nw70/helpdata/EN/43/03450525ee517be10000000a1553f6/frameset.htm
Hope this helps you.......
Regards,
Debjani.........
Edited by: Debjani Mukherjee on Sep 21, 2008 9:44 AM

Flat File Load

Hi all, create a Infosource load this sample data, Create an ODS object and load into it and Query on the ODS
1,Take Access database, retreat for 2000 row random sample
2,Create Datasource
3,Load data
4,Build ODS5,
5,Query
Can someone please tell me what all the steps needed to do to achieve the tasks.
i am using BI 7.0 version. I am a beginner and please i appreciate if someone can walk through a step by step procedure like how to bring in a flat file and also on how to map the Z info objects in the infosource. i hope i was clear
Thanks .
Message was edited by:
        kim s
Message was edited by:
        kim s

Hi,
   i guess you are having the datas in Excel. Now we will see the procedure.
1. In source system tab, choose File type, and choose create. Create a source system name.
2. double click on the source system whic you created.
3. It will take you to the Datasources tree.
4. there choose Create, and choose 'Transaction data' t will show the datasource screen. There do the following.
      General Info Tab: Give all descriptions ( short, mediunm...)
     Extraction Tab   : Give name of the excel file with full path (c:\excel.csv)
                               Give dataformat CSV.
     Fields Tab      : In Template Imfoobject, Give all your zinfoobjects ( as u mentioned in ur message that you got all objects as z)
    AFter finishing entering all zobjects one by one in template, it will ask 'copy' choose ok for all copy.
5. Activate the datasource created.
6. Create Infopackage on the datasource by rightclicking on the datasource.
7. Now, right click on the datasource created, choose create DTP, and it will take you to the DTP creation screen.
8. There it will ask the data target (i guess already you have creatd your ods/DSO.)
    give that ods/dso name as data target.
9. give the Datasource name as source.
10. choose enter. This will ask 'no transformations are done, transformations will be created by 12 rules' choose ok.
11. Now it will propose the transformations with graphical mapings as one to one.
12. Activate your created DTP, by selecting activate button
13. Now, modeling part is over.
14. and you can schedule the created infopackage, to pull the data from flat file to PSA.
15. Again schedule the DTP by choosing Execute.
Note: In bi7 there is no need to created transfer fules, update rules, infosource....
Hope this will be helpfull,
rgrds,
v.Sen

Flat File Load Problem

Hi All,
Has anyone come across where flat file uploads cuts out the last 1 or 2 columns from the upload.
This happens in the preview and in the actual load.
The data separators(,) and the Escape sign (") are OK
This are sample lines below:
"60    ","105906      ","A","253215      ","2005052700000000","516007      ",".TonyA        ","1.17                 ","0.20         ","2005050600000000","7     ","1   "
"102   ","42577       ","A","560194      ","2005070400000000","825293      ","A.HARCOURT     ","23.95                ","4.19         ","2005062300000000","8     ","56 "
"149   ","103179      ","A","254010      ","2005020900000000","208864      ","Paul Glew      ","2.16                 ","0.38         ","2004121300000000","9     ","1   "
It only loads up to the column with 0.20,4.19,0.38 and cuts it out from the date onwards (3 last columns).
Anybody seen this???

Hi Guys,
I really don't have much of a leeway in manipulating the file for upload. It is generated by a legacy system and the upload will be automated.
However, I am using a subset of the data for testing which I have been changing to troubleshoot the errors. What confuses me in this situation is that I have similar data structures with the same spaces, date formats etc. that is working. To answer your questions:
In the preview the data is displayed OK and first date in the line is displayed without the suffix zeros up to the last 3 columns which is blank completely, the following column shows 4 zeros and the last column is blank as well.
I have tested the data by physically removing the last 3 columns from the file. When I preview that it also gives me zeros in the 2nd last column even though there is no data to be read.
I have also tested it by removing unwanted spaces and it did not make a difference.
I have also tested via a logical path as well as pc file.
I am thinking other ways to test this......any ideas still......
K

.csv flat file loading data issue

Environment: SQL Server 2008 R2
Purpose: Load source data which are stored in a csv file to the destination table
Problem: After setting up flat file transformation, including the columns in the output alias, see the following picture:
,because SSIS set datatype to 50 char while the length is 65. I also set up response string filed to 100 in the destination table, An error message showed as the following picture
What I could do differently to overcome this issue. please advise

There are a number of them but not associated with that field
[SSIS.Pipeline] Warning: Warning: Could not open global shared memory to communicate with performance DLL; data flow performance counters are not available. To resolve, run this package as an administrator, or on the system's console.
1. [Flat File Source [511]] Error: Data conversion failed. The data conversion for column "Version_cd" returned status value 4 and status text "Text was truncated or one or more characters had no match in the target code page.".
2. [Flat File Source [511]] Error: The "output column "Version_cd" (604)" failed because truncation occurred, and the truncation row disposition on "output column "Version_cd" (604)" specifies failure on truncation.
A truncation error occurred on the specified object of the specified component.
3. [Flat File Source [511]] Error: An error occurred while processing file "C:\Users\data\ETL files\dummydata.csv" on data row 2.
4. [SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on component "Flat File Source" (511) returned error code 0xC0202092. The component returned a failure code when the pipeline engine called PrimeOutput().
The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
5. Task Data Flow Task failed

Transformation not generating-Flat file loading

Similar Messages

Maybe you are looking for