Time Lag using Timestamp - Generic Datasource

Hello,
I have a generic datasource running in production now. It uses the timestamp for the delta.
Currently the delta runs twice a day - once around 7 am and then again around 1 pm.
I have the upper limit set at 1800 seconds (30 minutes) and no lower limit however when I looked today at the 1 pm pull, the last set of records was pulled up to 9 am. I was surprised. I thought it should have been closer to 12 noon.
This data is constantly updated in ECC - for example. In a 30 minute window, the record count started at 1,966,206 and jumped to 1,966,297.
Has anyone else experienced this lag time? If so, how did you handle it.
I heard from one person that it could be because the application server time is different than the local time of entry. If that is true, how could I resolve that?
I would just like the deltas to bring in the data closer to the time of the pull.
Thanks for any insight.
Lynda

seems to be working correctly in production.
1800 seconds - 30 minute pulls via timestamp

Similar Messages

OCCI Fractional time insertion using Timestamp class

Hello,
On linux with oracle 10g, I modified the demo app occidml to insert a Timestamp into a table. I print the factional time from the timestamp after it is created to verify that indeed it is the correct value. However, when I query the database using SQL, I find that the fractional time component didn't get inserted. Any ideas on how to resolve this would be highly appreciated.
Here is the code snippet for inserting the timestamp..
string sqlStmt = "INSERT INTO author_ag VALUES (:x, :y)";
stmt=conn->createStatement (sqlStmt);
try{
Timestamp ts(env, 2008,9,10,11,12,13, c1);
uint h,m,s,f;
ts.getTime(h, m, s, f);
stmt->setTimestamp (1, ts);
stmt->setString (2, c2);
stmt->executeUpdate ();
cout << "insert - Success" << c1 << " " << f << endl;
}catch(SQLException ex)
cout<<"Exception thrown for insertBind"<<endl;
cout<<"Error number: "<< ex.getErrorCode() << endl;
cout<<ex.getMessage() << endl;
I see the following output:
insert - Success222 222
The database table is as follows:
SQL> desc author_ag
Name Null? Type
TS TIMESTAMP(3)
AUTHOR_NAME VARCHAR2(25)

My mistake. Didn't realize the fractional time had to be specified as NanoSeconds.

Identifying the target system using FM extraction in a Generic Datasource

Hi all,
We are using a Generic datasource using FM for extraction from R/3 system to BW system. This Function module picks data from a Z table! After each successful delta extraction from the table, a flag field is set to identify whether the data is pulled or not.
We are about to use BO data services which is connected to the R/3 system to fetch data. For capturing delta records after the BW run has happened, the table can be added a new flag field to pull delta for Data services.
Is there any way to identify which target system's extraction is running particularly in the function module (for e.g., if BW extraction is triggered or BODS extraction is triggered) so as to set the respective target flag in the Z table?
Regards,
vivek

Leandro,
The calling program of your FM should have a local variable I_RLOGSYS which is populated with the BW server ID.
If you don't know how to access a variable in a program that is in call stack using field symbols, search SDN.
I haven't tested this, so you may have to explore a little.
Good luck.

Real-time data acquisition for HR datasources

Dear Experts,
I have a couple of questions on real-time data acquisition...
a) Can you tell me if any standard HR datasources support real-time data acquisition?
b) Can we apply real-time data acquisition for generic datasources? If yes, is there any difference in the process compared to working with business content datasources when using real-time data acquisition?
Hope you can provide some answers...as always, points will be awarded for answers that effectively address the questions.
Thanks a bunch.
K

Hi Karthik,
a)The decision to go for SAP remote cube depends on the volume of data and the frequency of queries. It is advicible not to use the SAP remote cube if the data volume is high and also, the query frequency is high. Which module in HR are yuo implementing? In HR, the data volume is generally high. So, if you go for loading the data from R/3 every 3 hours, you are asfe as long as the loading volumes are less. For example, for implementing Time management, I would not advice frequent loads as it is time consuming process. So, make a decision based on the above mentioned lines. If the data volume is not high, I would prefer the SAP ermote cube as it will reduce managing the loads.
b)I mentioned FM extractor just for the sake of control of data selection. You can even go for view/table extractor.
Hope this helps.
Thanks and Regards
Subray Hegde

Function Module in Generic DataSources in BI

Hi,
I appreciate your answer about the Function Module in Generic DataSources in BI.
These are the steps I followd on R/3 side.
1) Create a structure with the R/3 table fileds based on the requirement.
2) Create a function module by copying RSAX (Function Group) and RSAX_BIW_GET_DATA_SIMPLE (Functin Module) into our own function group & Function Module (name starting with Y /Z). And use the structure(ex: ZSPMT) created in the reference data of 'Tables' tab (ex: E_T_DATA LIKE ZSPMT).
3) Use the structure name & function module name in the Generic DataSource
Finally when I want to use the Generic DataSource, do i need to insert the records myself in the table (or structre) I created ZSPMT? (which is used in Function Module)
If I need to insert the data into table ZSPMT myself, what is use of function module?
Can't I use the view of this table (ZSPMT) directly in Generic DataSource?
Is the function module used to filter/restrict the data based on client need?
Thank you in advance for you answers
It will help undderstand the difference among View, InfoSet Query & Function Module
used in creating Generic DataSource.
Regards,
Lakshmi

hi,
why did you prefered function module?
if the table ZSPMT egts the data that you enter automatically then no need to use FM.
directly extract with tables/if more than one table then use views.
if you need especially the FM that could solve ur complex requirmnet.
http://help.sap.com/saphelp_nw04/helpdata/en/3f/548c9ec754ee4d90188a4f108e0121/content.htm
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/84bf4d68-0601-0010-13b5-b062adbb3e33
Ramesh

Field in a Generic Datasource

Hi All,
I have created a Generic data source on a SAP table wherein I have a field called Business Area.
But when I upload the data from the R/3 table in my cube I want the filed to be Division.
That is I want data not be loaded Business area wise but Division wise.
Here Division is a navigational attribute of business area.
How do i do this?
Thanks and warm regards,
Sharmishtha

Hi,
1) You have to understand your self about what type of upload(master data/Transaction data) you need to do.
Tell us the table name was suggested to use for generic datasource.
2) You have 2 ways to get ZDIVISION into the cube
a) Take BUSINESS AREA as part of cube and activate the use of Navigational attribute(ZDIVISION) in the cube.
b) Take directly the characterstic ZDIVISION into cube and use the update rule as explained by me earlier.
With rgds,
Anil Kumar Sharma .P

Generic Datasource with Additive Delta

Hi all
I have a question.
In whic case can I use a generic datasource with additive delta?
Does this delta mode make sens only with function module extraction?
If I extract data directly from a table, can I use this delta mode only if a field represents changes?
Thanks for your help!
S.

Stefania,
    To my knowledge what you are thinking is wrong.
we have 2 Methods for Generic DS.
1. New status for changed Records.
2. Additive delta.
New status for changed records means
New Order
order no    quantity
1000          10
order changed to quntity 8. then 2 records will posted 2 BW in first case.
1000          -10
1000            8
if you come to Additve delta.
for the same case it will send the same record as
1000          10
changed records
1000          -2
this is the difference. New status with changed records should be used only in association with ODS not cube becoz we don't have overwrite option.
Additive delta we can use for ODS and Cubes with update mode Addition.
Hope this is clear.
Regards,
Nagesh Ganisetti.

I am using generic datasource first time init sucessful, next time deltas

Hai ALL,
I am using Generic Datasource first time i run init next time i want to run the delta, delta is sucessful but 0 records. i am taken date field and new status fileds(DSO) for DSO. R/3 side table values chaging but not replicate to BI. Can any suggest how to run the delta for Generic Datasource.
Thanks & Regards,
Suresh

Hi
Have you set delta pointers in your Generic datasource? if yes then what it is ? try to see if its logically related with your changes in records or you need to use any other type of delta pointer.

How to get generic delta using timestamp field

Hi All,
i have created a generic datasource using tables vbrp,vbrk.mara,marc,knvv.. to get the sales data for planning.Here i have document created date and time.So i'm concatinating these 2 date and time fields into timestamp which is of format yyyymmddhhmmss.Finally i'm using this timestamp to extract data .
So is it the right way to pull the data using timestamp and what is the timezone i need to specify as the servers are in india only.
or any other way to proceed.
Thanks
Rao.

Hi Rao,
Delta based on timestamp based on generic datasource only works if any one of the tables contains timestamp field(not time and date fields separately).
I dont think by combining date & time fields will give you correct results.
Regarding time zone: Use SAP system time zone.
Srini

Generating a Generic DataSource using Function Modules

I am attempting to create a generic DataSource using a function module. All of our DataSources are business content or custom generated that involve views. At least in our company this is true. Is there any resources available to me with examples on how to do this. I have looked at SAP's 'simple example' and would need a ABAP/BW Guru to figure it out! Any help would be greatfull. Thanx. JJ

Hi Jerry,
The simple example should provide you with the necessary requisite. All what you need to do is to
create your own extract structure and assign that as type for the table parameter e_t_data.
Now you will get the selection criteria, as well as the fields selected in the datasource from the 2 incoming tables. You need to write the necessary abap code to execute a query and populate your extract struture.
Once important peculiarity of this function module is that it is called several times, or as many times as the MAX parameter + 1. ie, once for each row fetched. Hence you will find a persistence method of using a CURSOR with HOLD property to retain the data between the function calls.
The help in generic datasource explains the 3 modes,
initialize, first call and the repeat call for the
function module. The simple function module example actually provides the necessary logic to deal with these modes and the example uses the sflight table.
Hope that is some information that could help u begin with.
Anoop C M

Generic DataSource using FM - Delta doubt

Hi All,
I have few doubts on Generic DataSource Delta.
I am working on one HR requirement. where I need to pull the Mandatory courses information.
to get this done, we have created one Generic DataSource using Function Module.
FM has huge and complex logic, at present it is taking long time when I run in RSA3, if I continue with this to BI, daily running FULL load to BI is not suggestible, because it takes much time to load.
I have planned to set the Delta, just want to know what would be the best option to set the delta option for this requirement? and how? I have 2 dates (Course Start and End dates), Employee, Course Id, Course Type, Position, Job, etc in my DS structure.
Please suggest someone so that I can do FULL load once in BI and continue with Delta without missing any delta records going forward.
Regards,
Kiran

Hi,
In mystrucure used dates are not relating to aedat and erdat, they are CHAR type. here the requirement is little different.
Regards,
Kiran

Generic DataSource using InfoSet on BI 7.0

Hi gurus,
I need to extract data from a InfoCube through a generic DataSource. I have created an InfoSet Query based on this InfoCube and I have noticed this kind of InfoSet is not the same that is used by Tcode RSO2.
Does anybody know if there is any way to get this vai generic DataSource?
I need to get data from Infocube because de Delta Control must be the package number.
Thanks in advance,
Silvio Messias.
P.S.: The version of my environment is 7.0.

Hi Ashok,
Into the Tcode RSO2 (Generic DataSource) I have the option to collect data from an InfoSet. This InfoSet must be created through Tcode SQ02, right?
I woult like to get data from a Infoset Query based on InfoCube, created through RSA1 on BI 7.0.
Is there any way to do it?
Thanks for your help,
Silvio Messias.

Generic Datasource on table IMRG in R/3- delta on timestamp is it ok ?

Hi
I am creating Generic datasource based on table IMRG in R/3, This has stoppages related data. which we need in BI report. There is a field for Time-stamp in the table, i have checked values in table IMRG, but in R/3 it shows no data for the time-stamp.
Now i want to create delta basis for this generic datasource based on table, so shall i create delta based on time-stamp or date field.
If I create delta based on time-stamp will it create problem in delta extraction subsequently? Please share your experience in such a cases.

There is a field for Time-stamp in the table, i have checked values in table IMRG, but in R/3 it shows no data for the time-stamp.
Delta specific field should be something which defines changes in your table, not something which is blank always.Based on the change in this delta specific field only delta will be pulled.Having it blank will never pull you delta.
Hope this helps.

Generic DataSource using function module

Hello experts,
I created a generic dataSource using copy of function module RSAX_BIW_GET_DATA. It is syntactilly correct. But when I execute and debug associated generic DataSource in RSA3, this generic function module could not identify DataSource(i_isource) and update mode(i_updmode).
Could you please answer what went wrong?
I also created by using copy function module RSAX_BIW_GET_DATA_SIMPLE. I did not find above such problem. The generic DataSource is executed fine in this case.
Thanks in advance,
Zak.

http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/c062a3a8-f44c-2c10-ccb8-9b88fbdcb008
/people/p.renjithkumar/blog/2009/10/07/generic-datasource-creation-using-function-module

Can anybody explain me creating Generic Datasource using Function module?

Hi,
can anybody explain me creating Generic Datasource using Function module?
Thax in advance,
Ravi.

Generic Extraction via Function Module
/people/siegfried.szameitat/blog/2005/09/29/generic-extraction-via-function-module
1. Create s structure with the fields that you need from the 4 tables . Activate.
2. Goto SE 80 Select The Function Group , Copy , Select the Function module
" RSAX_BIW_GET_DATA_SIMPLE " and Give a New name starting With
Y or Z .
3. SE37 ->Your Function module name -> Change , In table tab give your structure
name by deleting the associated type given in " E_T_DATA " .
4. Now select source code and Do the coding . Give Data source name in Coding .
In your case you have to take data from more that 1 table .
5. Activate the Function Group .
6. In RSO2 Create the Data source , Give the Function Module Name , And Save.
7. RSA3 -> Give data source name and Check for the Records .
Creation of custom datasource. (Using function module)
<b>is an example</b>
1.Create a function group .
2. Structure ZTEST123
ZMATNR MATNR CHAR 18 0 Material Number
ZMTART MTART CHAR 4 0 Material type
ZMBRSH MBRSH CHAR 1 0 Industry sector
ZMATKL MATKL CHAR 9 0 Material group
ZBISMT BISMT CHAR 18 0 Old material number
ZMAKTX MAKTX CHAR 40 0 Material description
3. Create function module (i.e. ZTEST.) .
FM - YMARA_DATA_TRNS
FUNCTION YMARA_DATA_TRNS.
""Local Interface:
*" IMPORTING
*" VALUE(I_REQUNR) TYPE SRSC_S_IF_SIMPLE-REQUNR
*" VALUE(I_DSOURCE) TYPE SRSC_S_IF_SIMPLE-DSOURCE OPTIONAL
*" VALUE(I_MAXSIZE) TYPE SRSC_S_IF_SIMPLE-MAXSIZE OPTIONAL
*" VALUE(I_INITFLAG) TYPE SRSC_S_IF_SIMPLE-INITFLAG OPTIONAL
*" VALUE(I_READ_ONLY) TYPE SRSC_S_IF_SIMPLE-READONLY OPTIONAL
*" TABLES
*" I_T_SELECT TYPE SRSC_S_IF_SIMPLE-T_SELECT OPTIONAL
*" I_T_FIELDS TYPE SRSC_S_IF_SIMPLE-T_FIELDS OPTIONAL
*" E_T_DATA STRUCTURE ZTEST123 OPTIONAL
*" EXCEPTIONS
*" NO_MORE_DATA
*" ERROR_PASSED_TO_MESS_HANDLER
data : ZTEST123 type ZTEST123 occurs 0 with header line.
Maximum number of lines for DB table
STATICS: S_S_IF TYPE SRSC_S_IF_SIMPLE,
S_COUNTER_DATAPAKID LIKE SY-TABIX.
DATA: begin of t_mara occurs 0,
ZMATNR type MATNR,
ZMTART type MTART,
ZMBRSH type MBRSH,
ZMATKL type MATKL,
ZBISMT type BISMT,
end of t_mara.
DATA: begin of t_makt occurs 0,
ZMATNR type MATNR,
ZMAKTX type MAKTX,
end of t_makt.
Initialization mode (first call by SAPI) or data transfer mode
(following calls) ?
IF I_INITFLAG = SBIWA_C_FLAG_ON.
Check DataSource validity
CASE I_DSOURCE.
WHEN 'ZZMARA_DATA'.
WHEN OTHERS.
IF 1 = 2. MESSAGE E009(R3). ENDIF.
this is a typical log call. Please write every error message like this
LOG_WRITE 'E' "message type
'R3' "message class
'009' "message number
I_DSOURCE "message variable 1
' '. "message variable 2
RAISE ERROR_PASSED_TO_MESS_HANDLER.
ENDCASE.
Fill parameter buffer for data extraction calls
S_S_IF-REQUNR = I_REQUNR.
S_S_IF-DSOURCE = I_DSOURCE.
S_S_IF-MAXSIZE = I_MAXSIZE.
ELSE. "Initialization mode or data extraction ?
Data transfer: First Call OPEN CURSOR + FETCH
Following Calls FETCH only
First data package -> OPEN CURSOR
IF S_COUNTER_DATAPAKID = 0.
Determine number of database records to be read per FETCH statement
from input parameter I_MAXSIZE. If there is a one to one relation
between DataSource table lines and database entries, this is trivial.
In other cases, it may be impossible and some estimated value has to
be determined.
select MATNR
MTART
MBRSH
MATKL
BISMT
from mara up to 10 rows
into table t_mara.
if not t_mara[] is initial.
select MATNR
maktx
from makt
into table t_makt
for all entries in t_mara
where matnr = t_mara-zmatnr.
endif.
loop at t_mara.
read table t_makt with key zmatnr = t_mara-zmatnr.
ZTEST123-zmatnr = t_mara-zmatnr.
ZTEST123-ZMTART = t_mara-ZMTART.
ZTEST123-ZBISMT = t_mara-ZBISMT.
ZTEST123-ZMBRSH = t_mara-ZMBRSH.
ZTEST123-ZMATKL = t_mara-ZMATKL.
ZTEST123-zmaktx = t_makt-zmaktx.
append ZTEST123.
clear ZTEST123.
endloop.
clear E_T_DATA.
refresh E_T_DATA.
E_T_DATA[] = ZTEST123[].
ENDIF.
S_COUNTER_DATAPAKID = S_COUNTER_DATAPAKID + 1.
ENDIF. "Initialization mode or data extractio
ENDFUNCTION.
3. Create the data source using transaction (RSO2).
4. If structure exists for the table parameter of your function module then ok else create a structure for the table parameter E_T_DATA.
5. Test the datasource in R/3 using transaction RSA3.
6. Transfer the data source to BW System and replicate it in the BW-System.

Time Lag using Timestamp - Generic Datasource

Similar Messages

Maybe you are looking for