Flat file delta loading

Hi
i have laoded the data in to the cube through flatfile, i created the packege for full load , init, and delta packges. suppose i have laoded the 1000 records from flat file to cube . i added 100 records to the file , and run the delta infopage , but its loading 1100 records again , why so , it has to take the only dletas means newly added records , why its laoding all reocrds when i run the Delta packege also ? Please tell me

Flat file delta concept as new same the regular delta.
In case you have 100 new records, you have send them in a different flat file, the extractor does not maintain any delta pointer in case of flat files.
Also you need to ensure in your delta records whether you are sending new images or after images. In case of new images you have load your data in DSO first.
-Neelesh

Similar Messages

Process for Flat file delta load from Application server to transactional??

I want to do a flat file extraction in delta loads from application server and that should be loaded into a transactional cubes scheduling a process chain.
Can any one help with ABAP code and step by step process for this?
Thank you
Devi

Hi Devi,
As per your explaination, you want to load a list of files from application server using process chain.
You can do this with below steps.
1) Create a Event and call event to run Process chain multiple times.
2) Put all filenames in a file say, source-File
3) Write a rooting to read filename from Source-File and trigger InfoPackage
4) At the end of the process chain create new customized program which will delete first line from Source-File so that it will take next file in next run as well as delete currently loaded file. Once this is done trigger event again to start process chain again.
Regards,
Ganesh

How to design Flat file for loading attribute dimension in a planning application

Dear Gurus,
I have a requirement to extract attribute dimensions from an essbase application and load it to another planning application. I have a dimension called Program and two attribute dimensions Sales Manager, Accounts manager associated with Program dimension in Essbase application. I will Extract these dimensions using Essbase outline extractor. After Extracting the attribute dimensions I have to load these dimensions to planning applications using outline load utility. Kindly guide me how to design the flat file for loading attribute dimensions in planning application.
Thanks and Regards
SC

You could dig through the docs and try to figure out the file format manually, or you could do this the easy way. Simply use the Outline Load Utility to export your attribute dimension from Planning. The export file format is the same as the import file format. You might have to manually add a couple of test members to your attribute dimension so that your export file has some content. Then simply update the file you exported, and import it.
(I am assuming you have already manually created the Attribute dimension in Planning, and that you simply need to add members to it.)
Hope this helps,
- Jake

Flat File Data Loads to BI 7.0

Hi Experts,
Please update me what is the best approach i have to follow for the below scenario of Flat File Data Loads
I will get data in Excel ....with Two worksheets....from the user
My requirment is to place the file in Central location avaliable to the user and BW to update if any changes necessary and want to load data(full0 to bw from file if there are any changes
Please update me how to deal with this scenarion of Two work sheets,In a central location...
Thanks

Easiest thing would be to use a DSO with change log to handle the changes to pass onto to any cubes and load a full every night
Then let the change log worry about any changes to the workbook
You have to be careful about the DSO keys though for this to work properly
Now to automate the loads - just how are you planning to create the infopackage as it will only read a csv and not the binary xls
Well it will read the binary xls if you maybe use a dbconnect with a jdbc driver to read the xls (that's on my next thing to do - but if you are as your user id suggests a "bw learner" then that may be a bit complicated)
The only other thign to do is to write a macro that automatically creates the csv file on the app server when the user quits the xls
Or off course you can just dump the csv each night - but then that is a manual task and in systems I design I hate manual tasks as staff go on holiday and peopel change jobs and it's not really very SoX compliant

Is it possible to know flat files names loading using particular info pack

hi experts ,
is it possible to know flat files names loading using particular info package ??
in our project we hav flat file extraction manually ...as i am replacing old sap bi consultant i must contine pending loads ..
as ther s no document about loads i must check and ensure about loads left out ..'
for every flatfile they used load with differnt name ... if am able to get those files name i can list out pending ones
and can load
is it possible to those details ??
pls help me .....
relative answer will rearded with points ............
thanks in advance
regards
harry

I AM REALLY THANK FUL FOR ALL.. your people are really quick .and giving relavtive answers ...
they loaded from desktop only ....not from application server ..
i got details from info cube mange screen .they used to load data monthly wise ,so i hav given month in selection and viewed data..
Regards ,
Harry

Flat file data load to BW datatarget-update mode

I am loading Revenue data using flat file. I am not going to overwrite anything in my futur updates.
each time if I load I have to add the values.
Can I create
Flat file -> ODS--> Cube or
Flat file -
> cube.
In the transfer structure which update mode I need to set .(FULL/Latest status of changed records / Additive delta)
I have to create 2 infopackages-Initial load /Delta load
I am in BW3.5 system
Please provide some lights
Thanks

Hi
If I understand ur question correctly, I think
u can create both
Flat file -> ODS--> Cube or
Flat file -
> cube.
as u like
I think for flat file loading there will be no Initial/ delta load, u can do only full update
Regards
Naalla

Flat file data load

Hi
I just want to extract the data from flat file for the standard business content data source(which is having some problem) just to work my way upwards to see that my conversion logic is working in update and transfer rules.
To create a flat file, I downloaded the data on the my documents folder via menu path system->list->save->local file. Here what option do I have to check(Unconverted,Spreadsheet..) and do I have to change the .txt to .csv here to convert in a form suitable for BW loading. Also what should we mention as data separator.
Please advise.
Thanks in advance.
Regards,
Kate.

Hi kate
Go for spreadsheet,.csv and , as data seperatot.
and also see this links
http://help.sap.com/saphelp_nw04/helpdata/en/8e/dbe92341c84242be2c7d3917f1c197/frameset.htm
http://help.sap.com/saphelp_nw2004s/helpdata/en/8e/dbe92341c84242be2c7d3917f1c197/frameset.htm
Regards
Naalla

Flat file data load - ODS - Look up data in Startroutine

Hi All,
There is a requirement that I have two ODS say 1) ABC and XYZ.
For Both ODS , We load flat file data.
First we load data to ABC for current fiscal period
During the data load to XYZ, We lookup part nos data in ABC for current fiscal period , if data there , for those part nos we load XYZ Flat file data.
My requirement is that , I need to fetch part nos data from ABC for Fiscal period < current fisacl period. Then I need to extract already loaded data for those part nos from XYZ and Mark the flag field as Non reportable .
How can we achieve this ?
Please advice
Thanks
Ajay

Hi ,
Thanks for your reply.
I have done so. When I add lines of My Internal table data to DATA_PACKAGE, It gives the syntax error that both structures are not unique. We have several fields in XYZ ods but they are not in Communication structure.
Thats the problem. Also , if I write the code , will it be executed for each datapackage. I mean , for each datapacket process , my code will fetch whole data from ABC and then from XYZ. Repetion will be there?
Any other logic can i use ?
Thanks
Ajay

Flat file data load error: Exception with type CX_SY_CONVERSION_NO_NUM

Hi Guys,
I am trying to create a datasource from a flat file (excel data in csv format) and when I create infopackage on the datasource and trying to load, I am getting the error,
Error 'An exception with the type CX_SY_CONVERSION_NO_NUM' at conversion exit RSDS_CONVERT_NUMBER (field FAB record 480, value 8)
Can somebody help me with this.
I am working in BI 7. In the excel sheet I have all cell with general format.
I tried using PSA Typed and not Typed. Didnt work
Thanks in advance

I selected Data Format as "Separated with Separated (for Example CSV),
Data Separator ,
Escape Sign ; (this i didnt understand where it comes in csv file) also I left the Hex check boxes unchecked.
PSA not Typed is also unchecked.
Am I missing something? Data types in excel spreadsheet (csv file)?
Thank you

How to move flat file after loading in owb to other directory with othernam

Hi All,
I wast struck in problem . after loading the flat file in owb that file should be move or rename or zip with Date everyday .
I dont know how to achieve this issue in owb via proceudre or any other way ... .
how to zip files from pl/sql procedure ...... with sysdate.zip.
any one please help me in this problem to come out soon.
thanks ,
murari

One way is to use a Java stored procedure, this can then be called from a map or a process flow. The Java stored procedure will use the Zip capabilities in Java to do what you need. For example you will need the following procedure and you will have to grant privileges for your file to ZIP and the entire directory for zipping into (since the file name will be dynamic):
For example grant YOURSCHEMA (change to your tgt schema) read on your extract directory where your file to zip is and write on your zips directory (where the zips will go);
exec dbms_java.grant_permission('YOURSCHEMA', 'SYS:java.io.FilePermission', 'c:\staging\extracts\*','read');
exec dbms_java.grant_permission('YOURSCHEMA', 'SYS:java.io.FilePermission', 'c:\staging\zips\*', 'write' )
You can then create your procedure which you can invoke
CREATE OR REPLACE AND COMPILE JAVA SOURCE NAMED "otnZipFile"
AS
import java.util.zip.ZipEntry;
import java.util.zip.ZipOutputStream;
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.io.IOException;
public class otnZipFile
public static void zipFile(String zip, String filename)
byte[] buf = new byte[1024];
try {
String outFilename = zip;
ZipOutputStream out = new ZipOutputStream(new FileOutputStream(outFilename));
FileInputStream in = new FileInputStream(filename);
out.putNextEntry(new ZipEntry(filename));
int len;
while ((len = in.read(buf)) > 0) {
out.write(buf, 0, len);
out.closeEntry();
in.close();
out.close();
} catch (IOException e) {
create or replace PROCEDURE zip_file(
dir IN VARCHAR2,
file_name IN VARCHAR2) IS
LANGUAGE JAVA NAME 'otnZipFile.zipFile(java.lang.String, java.lang.String)';
For example here I zip a file MYCSV.csv into the zip file MYZIP.zip
exec zip_file('c:\staging\zips\MYZIP.zip', 'c:\staging\extracts\MYCSV.csv');
Cheers
David

Error in flat file data loading

Hi All,
I have a flat file which has 20000 records, when I tried to do Read Preivew data in Data source creation Iam getting the following error.
I have the field name GROSSMARGIN in flat file I have given the properties of Grossmargin as a keyfigure and
Data Type :FLTP-Floating point number,
Unit/Currency: 0CURRENCY.
I am not getting any error while loading the value like '22134'.But when ever the records which are having the value of 5 digits, and starts with 3 like above one.After words I have replaces the value with some 5 digit number like(24432),It has worked fine.I do not understand the error cause.
Please help me.
Regards,
G S Ramanjaneyulu.

Hi Raman,
You are using data type INT2 for this and there is a restriction for this data type.
INT2: 2-byte integer between -32767 and 32767. Fields of this type should only be used for length fields. These long fields are positioned immediately in front of a long field (type LCHR, LRAW). With INSERT or UPDATE on the long field, the database interface enters the length which was actually used in the length field. The length is set to 5 places for this data type.
So this accepts the max no. till 32767 and if you put any no. more than that it will give you error of Overflow.
Please let me know if there are any questions.
Thanks
Amit

Format of flat file to load to ODS

Good morning
Please give me guidance in the following?
1) I will received this from the user and need to develop the ODS and thereafter use the target and payout % with sales figures in reporting:
     Target                    <80%         =>80%     =>90%     =>100%
Payout     Dealer group A     0.10%     0.20%     0.35%     0.50%
Payout     Dealer group B     0.10%     0.20%     0.40%     0.60%
The above information must be loaded via a flat file to the ODS. What should the columns in the flat file look like? Do I create an InfoObject for each target and payout percentage? I do not really want to use Update rules or routines as the user wants to create the CKF's or RKF's himself, but want to keep it as easy as possile for the user to report on these figures and percentages.
Your assistance will be appreciated
Thanks
Cj Faurie

Hi Cj,
        According to the requirements what u Hav written ,these key figures are not calculated one ,then u can make a flat fileusing comma as separator such that your file looks like:
Target %,Payout Dealer Group A %,Payout Dealer Group B %,
80,0.10,0.10
90,0.20.0.40
so on
Hope this helps,
Regards,
Baksh

Flat file data loading error

Hi All,
I am loading data from flat file. It is given error .File is avilable in selected directory and not opend but it showing return code 01.
That error message is like this.
Diagnosis
An error occurred in the source system.
System Response
Caller 09 contains an error message.
Further analysis:
The error occurred in Extractor .
Refer to the error message.
Procedure
How you remove the error depends on the error message.
Note
If the source system is a Client Workstation, then it is possible that the file that you wanted to load was being edited at the time of the data request. Make sure that the file is in the specified directory, that it is not being processed at the moment, and restart the request.

Hi,
While loading data from a flatfile, it is always better to first check the 'Preview' which is basically simulating the dataload from the file to check if the format is correct. You can do this by clicking on the 'Preview' button in the External Data tab within the infopackage. When you click on the 'Preview' button, it asks you for the number of header rows to be ignored and the number of records you want check from the file. If there is an issue with a particular field or the file, it will give an error message. You can correct the same and them do the actual dataload.
Commom errors during dataload from a file are:
1. You keep the file open and try to load the data. Please close the file before you start the dataload.
2. Data seperator and the number of header rows not specified correctly. Kindly double check.
3. Sequence of fields in the file and the infosource do not match .
Check the above points and see if it is useful.
Regards,
Shilpa

Flat file data load through appln server # gets generated at each line

Hi all,
I am loading the data from flat file which is placed on the application server.
At the end of each record i can see a # getting generated.
While loading the data in bw 3.5 i am getting an error message. Can anyone pls let me know how to handle this issue through application server!!
Thanks
Pooja

Hi Pooja,
I had faced similar kind of issue in my earlier project.
The issue is the way of uploading file to application server. Again, i m not say the format of file, but the way the file is uploaded. Normally there are 2 type of uploading, Binary and ASCII. If the file format is CSV and the Appl Server is Windows than, ASCII format is recommended. If it is uploaded in any other format, then the newline is not identified and converted to # - which result to error while loading the data.
I had to put lot of time to find out the correct combination. And then later on train the user to upload it right way. My user used to upload the data by using some FTPPro software.
Even after training, i had to have a manual check the file through AL11 everytime before load but after sometime user got trained and the problem was solved.
Hope this helps.
Regards
Raj

Flat file Hieararchy load issue

Hi all,
I have loaded flatfile hierarchy of 0profit center and load was successful. But I came to know that there was some data swapped for Link name and Parent ID in flat file.
so I deleted the data from PSA and made changes in flat file and then trying to load it again.
Its going to short dump saying "uncaught exception CX_RSR_X_MESSAGE''.
I dont know what is the issue. Actually the file which I have loaded first was a little bit wrong but load was successful and the file which is a correct one when loading goes to dump.
what could be the reason and how to sort it out.
Thx

Hi Bhanu,
As you mentioned out of 7 files only 2 are faling .
a) Are the data in the 2 files similar to other 5 files which are successful ?
      No
           1. Check if its a data issue, error mesgs and at which line it failed and analyze or provide us details.
      Yes
            1. check the path of the file if its defined properly.
            2. check why the load failed ..if its an error while lookup.
Hope it helps .
Thnks
Ram

Flat file delta loading

Similar Messages

Maybe you are looking for