Extraction, Flat File, Generic Data Source, Delta Initialization
Extraction, Flat File, Generic Data Source, Delta Initialization
I have couple of questions regarding data extraction.
1. If you have Data Source a Flat File e.g. Excel file I know that you have to create Data Source at BW side. How do you upload updates, by selecting Delta Update when executing next Data Load? Do you ever u201Cconvertu201D this Excel file into Application Tables to become SAP Source
2. Can you please give me example of situation where you had to create Generic Data Source? What is difference between Time Stamp, Calend. Day and Numeric Pointer. Which one is most common to select?
3. I read somewhere that Generic Data Source does not have Setup Table. I thought that you have to have Setup Table in order to load transaction Data otherwise you will lock the Application Tables. Where am I going wrong im my thinking please?
4. What are steps in terms of IP before, under and after Delta Initialization. I belive that you can do two ways:
Full Update - Initialize Delta Process (without Data Transfer) u2013 Delta Update or
Initialize Delta Process (with Data Transfer) u2013 Delta Update
Am I right? What is most common method and why?
5. If you want to add a filed in Data Source after 6 month using it, you want to do it without re-init Delta Queue. You add field in RSA6, then provide info for ABAP to populate new filed (info u2013 name of Data Source, Extract Structure, field added, name of Application Table which contains the field). How does it work now as there is no SetUp table it has been deleted after Initialisation? How does Delta Queue know that it is going to receive data which has been expanded by one field or it may does not need to know at all?
THANKSSSSSSSSSs
Hi,
1. If you have Data Source a Flat File e.g. Excel file I know that you have to create Data Source at BW side. How do you upload updates, by selecting Delta Update when executing next Data Load? Do you ever u201Cconvertu201D this Excel file into Application Tables to become SAP Source
Once you create Datasource for A flat file extraction then it is file source system specific hence you cont change to Application table source Data source
In info package you can change the source as application server instead of desktop no need to change the DS
2. Can you please give me example of situation where you had to create Generic Data Source? What is difference between Time Stamp, Calend. Day and Numeric Pointer. Which one is most common to select?
When we don't find any standard extractor then we can go for Generic(if i want information sales along with finance information in a data source then generally we dont get standard one hence we can go for generic DS)
Check the below link for More about generic DS .
http://wiki.sdn.sap.com/wiki/display/BI/Generic+Extraction
for Delta capturing you can use
Timestamp(if the table has time stamp filed so it can stamp the last changed record in that table hence it is easy to get delta based on the time stamp)
Calday- (If the table doesn't have the Timestamp filed then search for Calday where you can stamp the delta based on the date when documents are changed )
Numericpointer : If the table doesn't above both then we go for this option where you can the numeric value change stamp )
3. I read somewhere that Generic Data Source does not have Setup Table. I thought that you have to have Setup Table in order to load transaction Data otherwise you will lock the Application Tables. Where am I going wrong im my thinking please?
Generic datasource nothing but we extracting data directly from the database table without any interface between the application/systems
4. What are steps in terms of IP before, under and after Delta Initialization. I belive that you can do two ways:
Full Update - Initialize Delta Process (without Data Transfer) u2013 Delta Update or
Initialize Delta Process (with Data Transfer) u2013 Delta Update
Am I right? What is most common method and why?
Correct
5. If you want to add a filed in Data Source after 6 month using it, you want to do it without re-init Delta Queue. You add field in RSA6, then provide info for ABAP to populate new filed (info u2013 name of Data Source, Extract Structure, field added, name of Application Table which contains the field). How does it work now as there is no SetUp table it has been deleted after Initialisation? How does Delta Queue know that it is going to receive data which has been expanded by one field or it may does not need to know at all?
Once you add the new field to structure(DS) you will get the data as on date onwards not historical data hence what is the concept of setup table ( delta records come from the Delta Que not from the setup table )
If you want histaric data to new field then you need to setp table deletion ...etc...
Hope it is clear..
Regards,
Satya
Similar Messages
-
Generic Data Source delta is not extracted
Hi,
There is a problem in extracting the delta records using Generic Data Source. Delta records ( New / Modified records ) are not posted in the RSA7.
I'll Explain you the Scenario I have done. Created a generic data source in R/3 using view. In the view there is a field Sales Order No. I have enabled the delta update for this field. In the generic delta i have chosen delta type as Numeric pointer.
Extracted the entire record using full update and after initializing the Delta, it extracts the delta record well ie. it only extracts the sequence of Sale Order No. First I extracted nine records(i.e 10001 to 10009) using full update. again I entered a record in underlying table with sale order no as 10011-10013. It extracts those records into BW system. Then again I made an entry in the table with sales order no 10010. But the record is not extracted. Even though I tried of specifying safety lower limit as -3. Still it not extracting the record(10010).
And what if I posted a value of sale order 10014 with the same. what should I do?? Help on this plz.
--Durai.SHi SVS,
Thanks for your reply.
I followed this in my scenario. But I don't understand why it is not extracting? even I specified the safety limit of upper and lower values in the generic delta.
Here the below explanation shows that the delta record can be extracted even if the pointer value is greater than the posted value.
Numeric pointer (last extracted value 10011; Data in underlying table (Max value = 10025) )
Data would be extracted from a min-value of 10010 (lower limit adjusts the last counter 10011 by specified value u2013 1)
max-value of 10020 (after adjustment for upper safety limit u2013 by 5). The current pointer would now indicate 10020 in
RSA7.
--Durai.S -
Generic Data Source - Delta Issue
HI,
I have created a generic delta source (transactions) with the following options: -
- using the extract structure
- enabled the generic delta with billing creation date as delta specific field
- calendar day selected
- safety interval upper limit = 1 calendar days
- additive delta
carried out the folling steps in BW
- Full update from above generic data source (all records)
- Init upload without data transfers (1 record)
- Delta enabled
Now, even though i am editing / modifying any record on my own extract strucutres record on R/3 side, it is not getting reflected in RSA7 (delta queue).
P.S:- I have modified one of the record from full update.
Ideally the modified record should be shown in RSA7, but i am not getting the same.
can you please help me
Thanks
Rajyes,
I also thought the same point. But the records modified / edited yesterday are not appearing in today's delta. I am wondering why.
Is it anything to deal with FULL / INIT without deta transfer / DELTA procedure..
Regards
Rajiv -
Hi,
I am trying to extra delta record from generic data source, but I am not getting any record in RSA7.
I have done the following setting for generic delta source
- customized table from VBRK
- Deltas Specific field (ERDAT) - Date on which record was created
- Time Stamp (As i need to run this delta process every one hour)
- Safety interval upper limit = 900 Sec.
- Safety interval lower limit = 0 Sec.
- Additive Delta for target info cube.
Can you please help me to debug this issue.
ThanksHi Rajiv
Can you give more details on the load( Loading cube or ODS)?
When was the INIT done?
Regards,
Monika -
Generic data source delta setting
Dear All,
We have a custom table created in ECC system as per the scree shot. Period(ZMonth) is the only time related field in the table.
Questsion is how to set the delta settings in the generic data source as shown below.
What should be the correct setting for delta to work?
Thanks Krishow the delta records changes are applying. only creating new records or changes are applying on old records too?
ifs its only new records are entering source we can consider numeric pointer delta method.
as per the presented fields at your data source level, there is no option to handle delta loads thru timestamp or calday.
other option is , Use dso in your data flow before the info cube.
so we can load daily full load to psa and dso, from dso to cube we can make delta settings.
Thanks -
Generic data source delta settings
HI
i have to create delta for Generic data source based on 2 fields like "created on" and "changed on" fields.
how to set this
try avoid numeric point & Whit out using function module
and what is the safety interwell (Please use simple words)Hai Sudha,
Safety inteval is nothing but for ex you have updated your data from R/3 to bw at 11 am If client want the data in between 11.1min to 11.4min the records which are going to present in between the 1 min to 4 min that records only can updated if and ony if your data source is going to make as an generic delta.
bye. -
Generic Data Source Delta on Time Stamp Issue
HI,
I had a Z datasource on a Z table with Time stamp
The Generic delta of the Data source is based on Time stamp with Upper Saftey Intreval 1Sec
When i extract delta consutively with 1 Hr gap i am getting an delta evn tough the table is updated with etries
How to investigate & resolve the issue
ThanksHi
please elaborate question is not clear.
Ashish -
View V/s Extract structure in generic data source!
Hi,
Is it mandatory that view and extract structure must contain same number of fields in generic extraction?
can we enhance the extract structure with a field which is not existing in view?
clarify me with exmaple
Thanks,
RaviThanks Diego!
Actaully, the view which is used in the definition of the data source has four tables
namely AFRU,CRHD,AUFK and AFKO.
Join conditions are:
AFRU MANDT = CRHD MANDT
AFRU ARBID = CRHD OBJID
AFRU MANDT = AUFK MANDT
AFRU AUFNR = AUFK AUFNR
AFRU MANDT = AFKO MANDT
AFRU AUFNR = AFKO AUFNR
Now, i want to know from which table is the field AUFNR is mapped to BW info object!
As the field is in both tables AFRU and AUFK, i am confused of from which table the data is getting filled up to the BW info object!
I need to make a documentation of of each info object of how is it getting filled up and from which table?
Thanks,
Ravi -
Hi Experts.....
previously i am creating one view based on VBRP & VBRK common field is VBELN but i have some confusion long days, these two tables having same data Source i.e..2LIS_13_VDHDR , why u create View. So please explain one real time sinario.Hi,
When we don't find any standard extractor then we can go for Generic(if i want information sales along with finance information in a data source then generally we dont get standard one hence we can go for generic DS)
Re: Extraction, Flat File, Generic Data Source, Delta Initialization
Eg : If you want the information about the All Customers across the regions in that case if i have the information
Like 1)Table 1 has all the information about the Customer number But not having the Customer address and region and Pin code but same information has in other table
table 2 : Customer no,Address, region and Pincode
So since in Two tables i have common field Customer no is present hence if create view then i can get All the information in single in view then you can create Generic DS based on the then same you ca extract the data to BW.
Regards,
Satya -
Generic Data Source - Generic Delta
Hi All,
is it possible to create a Generic data source delta with two values.
I mean suppose I need to extract data sat based on ERDAT.
Now In the Generic Delta I have the date to make it delta but my requirement is like making this date dependent on two dates One ERDAT and second is like always Sy-datum.
So Delta should work on ERDAT and SY-DATUM simultaneously.
Is there any way to do it.
Any help is highly appreciated.
Thanks,
AnjnaHi Anjana,
In one datasource you can only specify one field for generic delta,
As an alternate solution:
1. Develop Generic Extractor based on FM
OR
2. Create 2 datasource one for new records and second for changed records and consolidate data in BW
Please refer the below links...It may be of help for you..
http://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/a0f46157-e1c4-2910-27aa-e3f4a9c8df33
/people/siegfried.szameitat/blog/2005/09/29/generic-extraction-via-function-module
Hope it helps,
Rgds,
Amit Kr. -
BW Master data delta generic data source for further update in BW
Hi BWers,
I am looking for an option to load delta from Master data to another master data within BW. Export data source option for master data only has full load option but no delta update possible.
I tried creating generic data source delta enabled on view of master data (/BI/M). But the problem I am facing now is master data contains quantity field as attribute and this field refers another table RSDKYF for unit. To be able to create data source on view / table no field should refer field in another table.
Did anybody create delta for master data for further loading within BW or came across similar issue with key figures, please let me know the best procedure in this scenario? Appreciate your quick response.
Regards,
MadhavIn your master data attribute have a date field which will be filled by the R/3 load as sy-datum - then create an export datasource and in the infopackage - give a selectoion for the date field as sy-datum and sy-datum -1..
Not exactly a delta but then usually master data is not kept as delta because the volumes are usually less - you can achieve delta by this method... -
Hi Expert,
I have flat file as data source. I want to know how to handle deletes with flat files.
For examaple,
If this is my flat file data
Company...Costcenter....Stock
A......B......10
M.....Z.......20
K......W......25
Company and Costcenter are keys.
If the above three records are loaded into an ODS last month and this month if I realize that A..B...10 record is wrong and is not needed, how do I delete this from the ODS? Do I need to send some indicator in the flat file for BW to understand that this is a delete entry?
Another case is if A..B record changes valye from 10 to 35, then I can send the same file or the same record in a diferent file again and it will over write the data, which is ok.
Can exprets plzz explain these data load streategies?
JasonHello ,
For Case1) Do the reverse posting of the record which u wish to delete from the ODS. I Mean (A..B...-10)
Case2) If you are loading data only till ODS. Then in your ODS u have active data table and a Change log table.
so this new record A..B..35 will overwrite the existing rec -> A..B..10 to A..B..35 and if you are doing further update to Cube then in change log it will first create a reverse image of the exinging record ie A..B..-10 and the writes the new record A..B..35
so --> A..B..10
A..B..-10
A..B..35 so the remaining will be A..B..35
Provided you have to maintain the Delta method in you flatfile
-- EnjoySAP:-)
**Award Credits if you find the solution, Have a great day -
Hi Friends,
We have Generic Data Source (Delta Capable) which is based on Function Module.
For this Data source I am looking for
1) Relevent Outbound Queue Name in SMQ1
2) Relevent R3 Back ground Job which is responsible for data load from Out Bound Queue To Delta Queue
3) Relevent Setup Table in R3 system
4) Is procedure for filling setup table for this generic data source is same as 2LIS Application Specific Data sources?
Thank you.
Tony1) Relevent Outbound Queue Name in SMQ1
Generic datasources dont have outbound queue.
2) Relevent R3 Back ground Job which is responsible for data load from Out Bound Queue To Delta Queue
No outbound queue hence no job.
3) Relevent Setup Table in R3 system
No Setup table for generic datasource.They fetch directly from R3 tables either directly or via function module.
4) Is procedure for filling setup table for this generic data source is same as 2LIS Application Specific Data sources?
No set up tables for generic datasources.
Generic data sources with delta have delta queue only.
Hope this helps. -
Error while doing DELTA Extraction (generic data source)
Hi BW Experts,
In my R/3, I have a generic data source ZBUT_VW.
It receives data from a View which is created based on couple tables.
When I do full load to the corresponding ODS, it is successful.
But after that I delete the ODS and created CUBE with DELTA
I have Initialized delta.
When I do DELTA extraction, it fails.
The error The ALE inbox of the SAP BW is identical to the ALE outbox of the source system
and/or
the maximum wait time for this request has not yet run out
and/or
the batch job in the source system has not yet ended.
I delete the initialization load and trying to do DELTA extraction again and it Fails.
With the same error
Please let me know how can I resolve this problem.
URGENT
gauravI dont think it is possible to have to additive delta with creation date.
Try a full load to cube to check if the extractor is working. -
Delta Enabled Generic Data Source
Hi All,
I have created one Delta Enabled Generic Data Source with
Function Module. The Delta field is Date Field. The Data source picks data from R3 to BW.
In RSA3, I executed the Extractor with the Delta Type "C" i.e Delta Initialization ... but it is throwing the error "Errors occured during the extraction". I also checked the Display Log and the error message is "Could not determine BW release of logical system".
Moreover I am not able to see the Delta Attributes in
RSA7. I checked with the other delta enabled generic extractors which uses Views .. is found to be working fine ... and I also able to see the Delta Attributes in RSA7.
Any suggestions?
Bye
DineshDinesh,
Once you have generated transfer rules in BW for the datasource, delta init can be tried out in RSA3. It iwll not create the delta queue though. Only test the initialization.
To do this, once you have created the transfer rules in BW, specify the logical system name of the BW system in the target system field. After that the extractor can be run in RSA3. It is flagged as read only so delta queue will not get created.
Cheers
Aneesh
Maybe you are looking for
-
I attempted to open Firefox as usual and when I clicked on the icon nothing happened. I uninstalled Firefox and then reinstalled. It said that the download for Firefox was successful but it still does not open. When I click on Firefox it now just say
-
Flash CS3 Form Application doesn't support FlashVars?
Anyone try load FlashVars in Form Application? It doesn't work. Why? In HTML object tag i add: <param name="FlashVars" value="varvalue=myValue" /> <embed src="flash/student.swf" FlashVars="varvalue=myValue" ... And on frame on first form (named: appl
-
Got my Bold 9780 a few months back (Bell Mobility) and find that already the inside felt is separating and peeling away from the case.. wondering if anyone else is having the same issue..
-
Paramter setting in URL in the case of HTTP receiver adapter
I have the following requirment: Can you anyone please help me how to define DATATYPE and configure in HTTP adapter: The web page is developed in JSP page its body contains parameter(for example:<textarea name="xml" cols="70" rows="150" wrap="off">)
-
Opening RAW photo in editor - cannot add a layer or make adjustments.
Greetings - I have recently upgraded to Photoshop Elements 13. I have a Nikon and I am shooting in RAW. Recently I have found that when I open a photo in the Editor - the vast majority of actions are grayed out. I cannot add a layer - or make other a