Tracking history while loading from flat file

Dear Experts
I have a scenario where in have to load data from flat file in regular intervals and also want to track the changes made to the data.
the data will be like this and it keep on changes and the key is P1,A1,C1.
DAY 1---P1,A1,C1,100,120,100
DAY 2-- P1,A1,C1,125,123,190
DAY 3-- P1, A1, C1, 134,111,135
DAY 4-- P1,A1,C1,888,234,129
I am planing to load data into an ODS and then to infocube for reporting what will be the result and how to track history like if i want to see what was the data on Day1 and also current data for P1,A1,C1.
Just to mention as i am loading from flat file i am not mapping RECORDMODE in ODS from flat file..
Thanks and regards
Neel
Message was edited by:
Neel Kamal

Hi
You don't mention your BI release level, so I will assume you are on the current release, SAP NetWeaver BI 2004s.
Consider loading to a write-optimized DataStore object, to strore the data. That way, you automatically will have a unqiue technical key for each record and it will be kept for historical purposes. In addition, load to a standard DataStore object which will track the changes in the change log. Then, load the cube from the change log (will avoid your summarization concern), as the changes will be updates (after images) in the standard DataStore Object.
Thanks for any points you choose to assign
Best Regards -
Ron Silberstein
SAP

Similar Messages

Error while loading from Flat file

Hi,
I'm trying to load master data from a flat file. After loading I get the following message even though I have used PSA as staging area. I see that data is present in the master data table (Text) without any errors though. Kindly help.
Error when updating Idocs in Business Information Warehouse
Diagnosis
Errors have been reported in Business Information Warehouse during IDoc update:
EDI: Partner profile not available
System response
There are IDocs with incorrect status.
Procedure
Check the IDocs in Business Information Warehouse . You can get here using the BW Monitor.
Removing errors:
How you remove the errors depends on the error message you receive.

Check your flat file format and field separator. Is it .txt or .csv file?
Go to "Source systems" in "Modeling" chose your source system for flat files and perform check.
Maybe problem is with your source system...
This might also be due to logical names of the systems not being maintained. Also has anyone doen a flat file upload before this on the system and what is the version ?

Error while loading CSV Flat file

Hi,
I am getting the following errors while loading a flat file into the DataSource:
1. Error 'Unit CS is not created in language EN...' at conversion exit CONVERSION_EXIT_CUNIT_INPUT (field UNIT record 1, value CS)
2. Error 'The argument '9,018.00' cannot be interpreted as anumber' on assignment field /BIC/ZTVSA record 1 value 9,018.00
What can I do to correct this?
Thanks

I am taking the following (Headers) fields in this order in a CSV file :
0LOGSYS ,0MATERIAL,0UNIT,0BASE_UOM,0COMP_CODE,0PLANT,0FISCPER,0FISCVARNT,
0CURRENCY,0PRICE_TYPE,ZTVSAKF,ZVOTVSKF,0PRICE_CTRL,ZPRICE_STKF,0PRICE_BASE,
0VAL_CLASS,0CURTYPE,0VALUATION
I have added all these fields in the DataSource as well. T-Code CUNIT has CS as a Unit.
I deleted and recreated the DataSource and am getting this error now:
Error 'Unit CS is not created in language EN...' at conversion exit CONVERSION_EXIT_CUNIT_INPUT (field UNIT record 1, value CS)
Error 'The argument '1,398.00' cannot be interpreted asa number' on assignment field /BIC/ZTVSAKF record 1 value 1,398.00
Error 'The argument '8,10.00' cannot be interpreted as anumber' on assignment field /BIC/ZTVSKF record 1 value 8,10.00
Error 'Unit 0 is not created in language EN...' at conversion exit CONVERSION_EXIT_CUNIT_INPUT (field BASE_UOM record 1, value )
Error 'Unit CS is not created in language EN...' at conversion exit CONVERSION_EXIT_CUNIT_INPUT (field UNIT record 1, value CS)
Error 'The argument '5,50.00' cannot be interpreted as anumber' on assignment field /BIC/ZTVSAKF record 1 value 5,50.00
Does it matter what order the columns are in?

Cube creation & Data loading from Flat file

Hi All,
I am new to BI 7. Trying to create a cube and load data from a flat file.
Successfully created the infosource and Cube (used infosource as a template for cube)
But got stucked at that point.
I need help on how to create transfer rules/update rules and then load data into it.
Thanks,
Praveen.

Hi
right click on infosource->additional functions->create transfer rules.
now in the window insert the fields you want to load from flat file->activate it.
now right click on the cube->additional functions->create update rules->activate it.
click on the small arrow on the left and when you reach the last node(DS)
right click on it->create info package->extenal data tab->give your FLAT file path and select csv format->schedule tab->click on start.
hope it helps..
cheers.

CUNIT error in data loading from flat file after r/3 extraction

Hi all
After R/3 business content extraction, if i load data from flat file to info cube, I am getting Conversion exit CUNIT error, what might be the reason, the data in the flat file 0unit column is accurate, and mapping rules are also correct, but still i am getting error with CUNIT.?

check your unit if you are loading amount or quantities what mapping you have and what you are loading from flat files.
BK

Data loading from flat file to cube using bw3.5

Hi Experts,
                   Kindly give me the detailed steps with screens about Data loading from flat file to cube using bw3.5
       ...............Please

Hi ,
Procedure
You are in the Data Warehousing Workbench in the DataSource tree.
       1.      Select the application components in which you want to create the DataSource and choose Create DataSource.
       2.      On the next screen, enter a technical name for the DataSource, select the type of DataSource and choose Copy.
The DataSource maintenance screen appears.
       3.      Go to the General tab page.
                            a.      Enter descriptions for the DataSource (short, medium, long).
                            b.      As required, specify whether the DataSource builds an initial non-cumulative and can return duplicate data records within a request.
                            c.      Specify whether you want to generate the PSA for the DataSource in the character format. If the PSA is not typed it is not generated in a typed structure but is generated with character-like fields of type CHAR only.
Use this option if conversion during loading causes problems, for example, because there is no appropriate conversion routine, or if the source cannot guarantee that data is loaded with the correct data type.
In this case, after you have activated the DataSource you can load data into the PSA and correct it there.
       4.      Go to the Extraction tab page.
                            a.      Define the delta process for the DataSource.
                            b.      Specify whether you want the DataSource to support direct access to data.
                            c.      Real-time data acquisition is not supported for data transfer from files.
                            d.      Select the adapter for the data transfer. You can load text files or binary files from your local work station or from the application server.
Text-type files only contain characters that can be displayed and read as text. CSV and ASCII files are examples of text files. For CSV files you have to specify a character that separates the individual field values. In BI, you have to specify this separator character and an escape character which specifies this character as a component of the value if required. After specifying these characters, you have to use them in the file. ASCII files contain data in a specified length. The defined field length in the file must be the same as the assigned field in BI.
Binary files contain data in the form of Bytes. A file of this type can contain any type of Byte value, including Bytes that cannot be displayed or read as text. In this case, the field values in the file have to be the same as the internal format of the assigned field in BI.
Choose Properties if you want to display the general adapter properties.
                            e.      Select the path to the file that you want to load or enter the name of the file directly, for example C:/Daten/US/Kosten97.csv.
You can also create a routine that determines the name of your file. If you do not create a routine to determine the name of the file, the system reads the file name directly from the File Name field.
                              f.      Depending on the adapter and the file to be loaded, make further settings.
■       For binary files:
Specify the character record settings for the data that you want to transfer.
■       Text-type files:
Specify how many rows in your file are header rows and can therefore be ignored when the data is transferred.
Specify the character record settings for the data that you want to transfer.
For ASCII files:
If you are loading data from an ASCII file, the data is requested with a fixed data record length.
For CSV files:
If you are loading data from an Excel CSV file, specify the data separator and the escape character.
Specify the separator that your file uses to divide the fields in the Data Separator field.
If the data separator character is a part of the value, the file indicates this by enclosing the value in particular start and end characters. Enter these start and end characters in the Escape Charactersfield.
You chose the; character as the data separator. However, your file contains the value 12;45 for a field. If you set u201C as the escape character, the value in the file must be u201C12;45u201D so that 12;45 is loaded into BI. The complete value that you want to transfer has to be enclosed by the escape characters.
If the escape characters do not enclose the value but are used within the value, the system interprets the escape characters as a normal part of the value. If you have specified u201C as the escape character, the value 12u201D45 is transferred as 12u201D45 and 12u201D45u201D is transferred as 12u201D45u201D.
In a text editor (for example, Notepad) check the data separator and the escape character currently being used in the file. These depend on the country version of the file you used.
Note that if you do not specify an escape character, the space character is interpreted as the escape character. We recommend that you use a different character as the escape character.
If you select the Hex indicator, you can specify the data separator and the escape character in hexadecimal format. When you enter a character for the data separator and the escape character, these are displayed as hexadecimal code after the entries have been checked. A two character entry for a data separator or an escape sign is always interpreted as a hexadecimal entry.
                            g.      Make the settings for the number format (thousand separator and character used to represent a decimal point), as required.
                            h.      Make the settings for currency conversion, as required.
                              i.      Make any further settings that are dependent on your selection, as required.
       5.      Go to the Proposal tab page.
This tab page is only relevant for CSV files. For files in different formats, define the field list on the Fields tab page.
Here you create a proposal for the field list of the DataSource based on the sample data from your CSV file.
                            a.      Specify the number of data records that you want to load and choose Upload Sample Data.
The data is displayed in the upper area of the tab page in the format of your file.
The system displays the proposal for the field list in the lower area of the tab page.
                            b.      In the table of proposed fields, use Copy to Field List to select the fields you want to copy to the field list of the DataSource. All fields are selected by default.
       6.      Go to the Fields tab page.
Here you edit the fields that you transferred to the field list of the DataSource from the Proposal tab page. If you did not transfer the field list from a proposal, you can define the fields of the DataSource here.
                            a.      To define a field, choose Insert Row and specify a field name.
                            b.      Under Transfer, specify the decision-relevant DataSource fields that you want to be available for extraction and transferred to BI.
                            c.      Instead of generating a proposal for the field list, you can enter InfoObjects to define the fields of the DataSource. Under Template InfoObject, specify InfoObjects for the fields in BI. This allows you to transfer the technical properties of the InfoObjects into the DataSource field.
Entering InfoObjects here does not equate to assigning them to DataSource fields. Assignments are made in the transformation. When you define the transformation, the system proposes the InfoObjects you entered here as InfoObjects that you might want to assign to a field.
                            d.      Change the data type of the field if required.
                            e.      Specify the key fields of the DataSource.
These fields are generated as a secondary index in the PSA. This is important in ensuring good performance for data transfer process selections, in particular with semantic grouping.
                              f.      Specify whether lowercase is supported.
                            g.      Specify whether the source provides the data in the internal or external format.
                            h.      If you choose the external format, ensure that the output length of the field (external length) is correct. Change the entries, as required.
                              i.      If required, specify a conversion routine that converts data from an external format into an internal format.
                              j.      Select the fields that you want to be able to set selection criteria for when scheduling a data request using an InfoPackage. Data for this type of field is transferred in accordance with the selection criteria specified in the InfoPackage.
                            k.      Choose the selection options (such as EQ, BT) that you want to be available for selection in the InfoPackage.
                              l.      Under Field Type, specify whether the data to be selected is language-dependent or time-dependent, as required.
       7.      Check, save and activate the DataSource.
       8.      Go to the Preview tab page.
If you select Read Preview Data, the number of data records you specified in your field selection is displayed in a preview.
This function allows you to check whether the data formats and data are correct.
For More Info: http://help.sap.com/saphelp_nw70/helpdata/EN/43/01ed2fe3811a77e10000000a422035/content.htm

Data is not updated to Infocube (BI 7.0) when i load from flat file

Hi Experts,
               when I try to load data from flat file to Infocube (BI 7.0) with full or Delta, I am gettin following errors.
1) Error while updating to data target, message No: RSBK241
2) Processed with Errors, Message No: RSBK 257.
Till transformations everthing is successful but updating data to cube is not successful...
what is the message no. indicates? can i find solution anywhere with respective to Message NO.?
Anybody please help me..
Regards
Anil

Hi Bhaskar,
                   There is no problem with cube activation.But i try to activate the cube by using
the function module " RSDG_CUBE_ACTIVATE". It goes to short dump.Anyhow i want to know
that in what scenario we use this function module to activate the cube.
         There is no special characters in the file. I delete the requests in psa, cube and Re run the
Infopackage & DTP.But I am getting same error.
The following errors are found in updating menu
of details tab (display messages option)
1) Error while updating to data target, message No: RSBK241
2) Processed with Errors, Message No: RSBK 257.
                 Thank you
Regards
Anil
Edited by: anilkumar.k on Aug 20, 2010 8:35 PM

Vendor master data load from flat file

Hi Experts,
I am trying to load data from flat file. I am confused which info object i should use. My requirement is for info cube 0BBP_C01.
As i found for this info cube only two info objects are available: 0BBP_VENDOR and 0VENDOR. But in my flat file i have following fields: Vendor code, Vendor Name, Ultimate Parent, City, Country, Minority Status, Vendor Payment Terms. which all are together not present in either of info objects.
Please suggest which info object i must use. or should i create Z info object for my requirement?
Thanks in advance.
Regards,
Niranjan Chechani

Hi Kiran,
I am loading data through flat file. I am not getting your point like how to get attributes present in the R/3 system which I am not using in this case.
Hi rvc,
I have created two characteristics z info objects i.e. ZU_PARENT for Ultimate parent and ZVEN_PAY for Vendor Payment Terms.
When i am trying to add these two as attributes and add it as Navigational attribute, I am getting the error "Characteristic 0VENDOR: The attibutes SID table(s) could not be filled" (Message no. R7586)
Please suggest am i wrong somewhere?
Thanks and Regards,
Niranjan Chechani
Edited by: Niranjan Chechani on Nov 28, 2011 12:15 PM

Help Required regding: Validation on Data Loading from Flat File

Hi Experts,
I need u r help in the following issue.
I need to validated the transactional data loading to the GL Cube from Flat file,
1) The transactional data to the Cube to be loaded only if master data record exists for the 0GL_ACCOUNT info object.
2) If the master data record does not exits then the record need to be skipped from the loading and after the loading the system should throw a message saying that these many records have been skipped (if there are any skipped records.).
I would really appriciate u r help and suggestions on solving this issue.
Regds
Hari

Hi, write a start routine in transfer rules like this.
DATA: l_s_datapak_line type TRANSFER_STRUCTURE,
 l_s_errorlog TYPE rssm_s_errorlog_int,
 l_s_glaccount type /BI0/PGLACCOUNT,
 new_datapak type tab_transtru.
 refresh new_datapak.
 loop at datapak into l_s_datapak_line.
 select single * from /BI0/PGLACCOUNT into l_s_glaccount
 where CHRT_ACCTS eq l_s_datapak_line-field name in transfer structure/datsource for CHRT_ACCTS
and GL_ACCOUNT eq l_s_datapak_line-field name in transfer structure/datsource for GL_ACCOUNT
and OBJVERS eq 'A'.
 if sy-subrc eq 0.
 append l_s_datapak_line to new_datapak.
 endif.
 endloop.
 datapak = new_datapak.
 if datapak[] is initial.
abort <> 0 means skip whole data package !!!
 ABORT = 4.
 else.
 ABORT = 0.
 endif.
i have already some modifications but U can slightly change it to suit your need.
regards
Emil

Short dump while loading Hierarchy flat file

Hi gurus,
i am trying to load data from flat file to hierarchy, when i am trying to schedule the InfoPackage its giving message a dump :-
"ASSIGN_LENGTH_0" C
"SAPLRRSV" or "LRRSVU10"
"RRSV_INT_CHA_VAL_SPLIT"
These are the steps i followed.
1 created a ZINREGION
2. enabled hierarchy of ZINREGION and included ZINCOUNTRY as external characteristics.
3.and then created infosource and assigned DataSource and created hierarchy and created InfoPackage.
4. selected the hierarchy in InfoPackage, which was created by clicking the hierarchy structure in DataSource and transfer structure.
5.when i scheduled the load in InfoPackage i got above short dump message.
I FOLLOWED THIS BLOG
/people/prakash.bagali/blog/2006/02/07/hierarchy-upload-from-flat-files
thanks
Sathya Pathapati

Hi Philippe,
The processing step, as I could see in the status tab of the monitor, is ".Service API" I am not sure if this is what you are asking for. If not, please let me know what you want me to check for. Below is the description I have in the Status Tab.
InfoIdocs missing; file system
Diagnosis
InfoIDocs are missing. With the file system as source system, the IDocs are created in BW. As this did not happen there was probably a short dump in BW.
System response
No end-confirmation arrived in the Warehouse from
Procedure
Check the short dumps in BW.
Check the data in the InfoCube.
Error Correction:
If the data was correctly updated in the InfoCube, then it is possible that no InfoIDocs were generated.
Set the data request status manually to "OK" (green traffic light).
This error has occured in a standard SAP Program.
Hi Ravi,
I am not loading the data to the cube but only to the ODS. I have plans to load the data later from ODS to Cube.
I am not using the process chains to load the data and anyway, as I am not loading to the cube, I auume the index will not come into picture. Please correct me if I am wrong.
And, what do you mean by "Split the file". Can you please elaborate?
Thanks,
RPK.

Loading from flat file to dso using process chains

hi,
i am using BI7.0
i am new to process chains
can anyone explain how to load data from flat file to dso using process chains(i have created all the objects created) preffered if explained with an example

You can find a lot info if you can searh SDN.
Metachain
Steps for Metachain :
1. Start ( In this variant set ur schedule times for this metachain )
2.Local Process Chain 1 ( Say its a master data process chain - Get into the start variant of this chain ( Sub chain - like any other chain ) and check the second radio button " Start using metachain or API " )
3.Local Process Chain 2 ( Say its a transaction data process chain do the same as in step 2 )
Steps for Process Chains in BI 7.0 for a Cube.
1. Start
2. Execute Infopackage
3. Delete Indexes for Cube
4.Execute DTP
5. Create Indexes for Cube
For DSO
1. Start
2. Execute Infopackage
3. Execute DTP
5. Activate DSO
For an IO
1. Start
2.Execute infopackage
3.Execute DTP
4.Attribute Change Run
Data to Cube thru a DSO
1. Start
2. Execute Infopackage ( loads till psa )
3.Execute DTP ( to load DSO frm PSA )
4.Activate DSO
5.Delete Indexes for Cube
6.Execute DTP ( to load Cube frm DSO )
7.Create Indexes for Cube
3.X
Master loading ( Attr, Text, Hierarchies )
Steps :
1.Start
2. Execute Infopackage ( say if you are loading 2 IO's just have them all parallel )
3.You might want to load in seq - Attributes - Texts - Hierarchies
4.And ( Connecting all Infopackages )
5.Attribute Change Run ( add all relevant IO's ).
Start
Infopackge1A(Attr)|Infopackge2A(Attr)
Infopackge1B(Txts)|Infopackge2B(Txts)
/_____________________|
Infopackge1C(Txts)______|
\_____________________|
___________________|
__\___________________|
___\__________________|
______ And Processer_ ( Connect Infopackge1C & Infopackge2B )
__________|__________
Attribute Change Run ( Add Infobject 1 & Infoobject 2 to this variant )
1. Start
2. Delete Indexes for Cube
3. Execute Infopackage
4.Create Indexes for Cube
For DSO
1. Start
2. Execute Infopackage
3. Activate DSO
For an IO
1.Start
2.Execute infopackage
3.Attribute Change Run
Data to Cube thru a DSO
1. Start
2. Execute Infopackage
3.Activate DSO
4.Delete Indexes for Cube
5.Execute Infopackage
6.Create Indexes for Cube
Some Links
http://help.sap.com/saphelp_nw2004s/helpdata/en/8f/c08b3baaa59649e10000000a11402f/frameset.htm
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/8da0cd90-0201-0010-2d9a-abab69f10045
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/19683495-0501-0010-4381-b31db6ece1e9
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/36693695-0501-0010-698a-a015c6aac9e1
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/9936e790-0201-0010-f185-89d0377639db
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3507aa90-0201-0010-6891-d7df8c4722f7
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/263de690-0201-0010-bc9f-b65b3e7ba11c

Data loading from flat file into bw

Hi Experts,
When we load data from flat file into BW the sequence of fields in flat file should be matched with the transfer structure or communication structure?
wid thanX,
arijit

Arijit,
The sequence of fields in a flat file must be the same as this one in the transfer structure.
The comm and tran structures are the same after the first creation of datasource from flat file source system. After that someone could change the sequence in the CS -- if the mapping of fields in transfer rules remains unchanged, then the load is to be succesful.
In case of changing the sequence in TS you'll get either error or wrong load (values to be loaded into some infobjects will go to another ones.)
Best regards,
Eugene

Regarding master data ,transactional data loading from flat file

Hi friends,
Please tell me how to load master data and transactional data from flat file ....
Thanks in advance ,
Regards,
ramnaresh.

Hi,
Please use the 'search forum' functionality and search the BI Forum with say 'flat file loading'. You would get plenty of links of previous threads.
BR/
Mathew.

How to avaoid space while reading from flat file

Dear all
I am using forms 10g.
I am reading data from flat file using Text_io.
In my exception part i have written like this
EXCEPTION
WHEN no_data_found THEN
CLIENT_TEXT_IO.Fclose(in_file);But if in my last line from the flat file is some other characters then it is taking that also .
How can i avoid it ?
Note :- Other characters means you cannot see like this , when you press SHOW ALL CHARACTERS button in the NOTEPAD++ then it will show ...

My File is like this ABC . There is no extension like ABC.txt .
And in the file if the last line if blank space is there then it is coming to exception part , but if TAB is there then it is not coming .

Load from flat file confusion

hi
i have to load data using 2 flat files with different level of details
file 1 has data:::
Order...........ordertypes....amount$....Rule...
111.................z11.................100.........XYZ1
111.................z12.................100.........XYZ1
112.................z11.................100.........XYZ1
112.................z12.................100.........XYZ1
113.................z11.................100.........XYZ3
113.................z12.................100.........XYZ3
113.................z13.................100.........XYZ3
Now i have file2 data::
Rule..........Date..........Quantity
XYZ1........1.1.10..........111
XYZ3........9.1.10..........222
NOW user needs all this in 1 report!!
how to achieve this??
Create a ODS and store Order Number and Rule as KEY
and load data using 2 flat file loads at different times ??

Whether you should go with infoset or Infocube with some transformation logic depends on the what they want to see on report and how they want to see it. In your example, How would you want to combine the data from two files
Infoset gives you the below combination with quantity replicated on each and every order
Order...........ordertypes....amount$....Rule... Date Quantity
111.................z11.................100.........XYZ1......1.1.10......111
111.................z12.................100.........XYZ1......1.1.10......111
112.................z11.................100.........XYZ1......1.1.10......111
112.................z12.................100.........XYZ1......1.1.10......111
113.................z11.................100.........XYZ3......9.1.10......222
113.................z12.................100.........XYZ3......9.1.10......222
113.................z13.................100.........XYZ3......9.1.10......222
If you want to do some processing on the quantity when you combining, then Infoset might not be optimal
Order...........ordertypes....amount$....Rule... Date Quantity
111.................z11.................100.........XYZ1......1.1.10......111/4
111.................z12.................100.........XYZ1......1.1.10......111/4
112.................z11.................100.........XYZ1......1.1.10......111/4
112.................z12.................100.........XYZ1......1.1.10......111/4
113.................z11.................100.........XYZ3......9.1.10......222/3
113.................z12.................100.........XYZ3......9.1.10......222/3
113.................z13.................100.........XYZ3......9.1.10......222/3
I have to know what exactly they are trying to achieve by combining the data to suggest a method over another
Edited by: Uday Pothireddy on Nov 15, 2010 9:50 PM

Tracking history while loading from flat file

Similar Messages

Maybe you are looking for