Common issues in data load monitoring...

Hi all,
Can u please tell me what are the common issues that occur during data load monitoring and how to rectify them??

This is a bit dependent on your system and landscape. but to mention some of issues:
- Deadlock in cube because the inxedes were not dropped before loading data into cube
- Unallowed signs in master data prevent system from creating SID
- Duplicate values in master data load (can be avoided by setting a flag in DTP)
- Loading delta package without having intitialized before
- Source package delivers key figure without units (this happens when laoding into a cube or an DSO with SID generation)
- Missing replication of data source after transporting data source in source system
Regards
Aban

Similar Messages

Assistance Needed on Data Load Monitoring

presently i'm working in a support proj which is data load monitoring ( mainly process chains) , As a result of which i will the responsible person to fix some of the loads when it fails eg : Duplicate records, errorneous records, attrbutute chain run etc .
As a fresher in BW i need to learn some of the things like Types of updates, process types & process chains proficiently thick & fast , i request you to please send in some PDF's or ppt regarding the same , if any books are there then please suggest one.
i Need mainly regarding
Dataflow & update Types Briefly .
process Types , chains
Delta mechanism .
Hope you will bail me out of this situation.
Thanks in Advance ,
HP

Here are all the links:
sap document on process chains:
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/8da0cd90-0201-0010-2d9a-abab69f10045
help.sap.com link for creation of process chains:
http://help.sap.com/saphelp_nw04/helpdata/en/67/13843b74f7be0fe10000000a114084/frameset.htm
helpful threads on issues related to process chains:
Process Chains creation and monitoring
Process Chain
Re: OPEN HUB with Process Chain
http://help.sap.com/saphelp_nw04/helpdata/en/67/13843b74f7be0fe10000000a114084/frameset.htm
Re: OPEN HUB with Process Chain
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=3806122
Re: attribute change run
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=3790051
Re: Process Chain Scheduling
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=4426820
Re: Process Chain
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=3692343
Re: Process Chain
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=3841608
Re: Can a process can have more than one variant?
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=3855067
Re: about the open hub...!
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=3700389
Re: Process chain statistics
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=4162319
Re: Process Types in BI 7.0
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=3759916
Re: How to deactivate the local chain in Main chain
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=3591699
Re: changing a process type during running of process chain
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=3750639
Re: Node for Process chain--Urgent
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=3692720
Re: Process Chains Events
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=3707415
Re: process chain event trigger problem
https://forums.sdn.sap.com/click.jspa?searchID=6646868&messageID=4374184
Thanks.,...
Shambhu

Data Load Monitoring.

Dear Experts,
I would like to know on what circumstances we should use following Data load monitoring tools:
1.     RSMO
2.     SSA/BWT
3.     ST13
4.     RZ20
It would be more helpfull if you can describe pros and cons of each tool.
Regards
Vivek Tripathi

Hi Vivek,
RSMO is used to monitor the dataloads coming into the BI system. Here you can find the details for each and Every load happened.
SSA/BWT is a Program which provide you the details about Process Chain Analysis, Detailed Request Analysis ,Aggregate Toolset etc.
Refer this Wiki for more details.
https://www.sdn.sap.com/irj/scn/wiki?path=/display/bi/bw%252btools
ST13- This provides a set of tools which talk mostly about Performance of the BI system.
Refer this Blog
Overview important BI performance transactions
Regarding RZ20 - It is called as CCMS Monitor Sets
Here in CCMS you have different monitoring tools for different components.
If BI is concerned you can monitor the details about BI Accelerator Monitor,BI Key Performance Indicators ,BI Monitor etc.
Regards
Karthik

Common errors in Data Loading

Can anybody tell me what are the common error we come across in BW/BI for following:-
1] Data Loading in Infocube/ODS/DSO
2] Aggregates
3] PSA
4] DTP
5] Transformations
Thanks in advance

Hi,
Here are the list of common issues we face while data loading in to BW:
Data Loading in Infocube/ODS/DSO:
1) Missing SID issue or missing master data
2) Data load cancelled becasue of various exceptions. Eg: Message Type 'x', DBIF SQL Error,
3) Data records found in duplicate
4) Alpha Confirming Vaue error
5) Invalid time interval
6) Time overlap error
7) Job Cancelled in source system
8) RFC Connection Error
9) Data Source Replication error
10) Data load locked by active change run
11) Attributes to target by user 'xyz'
12) Job cancelled as the previous load is still running
13) Target locked by a change run
(Some times data loads dont fail but run for long time then usual with out any progess, because of struck tRFCs in source sytem, source sytem performance is poor and the job is in release state for long time, etc...)
Aggregate Rollups:
1) Nofilled aaggregates available, rollup not possible
2) Rollup locked by active change run
3) Job cancelled because of various exceptions
PSA Updations:
1) Job cancelled because of various exception
2) Missing SID value
ODS Activaitons:
1) Request to be activate shoud be green - (Loading of data in to ODS in still going on)
2) Key exists in duplicate
3) Job cancelled because of various exceptions (Short Dumps)
Attribue Change Run:
1) Locked by a rollup
2) Job cancelled because of various exceptions
3) Locked by another change run
Hope it helps....
Cheers,
Habeeb

Issue with Data Load Table

Hi All,
       i am facing issue with apex 4.2.4 ,using the Data Load Table concept's and in this look up used the
      Where Clause option ,it seems to be not working this where clause ,Please help me on this

hi all,
    it looks this where clause not filter with 'N' data ,Please help me ,how to solve this or help me on this

Issue with Data Load to InfoCube with Nav Attrivutes Turned on in it

Hi,
I am having a issue with loading data to a InfoCube. When i turn
on the navgational attributes in the cube the data load is failing
and it just says "PROCESSED WITH ERRORS". when i turn them off
the data load is going fine. I have done a RSRV test both on
the infoobject as well as the cube and it shows no errors. What
could be the issue and how do I solve it.
Thanks
Rashmi.

Hi,
To activate a navigation attribute in the cube the data need not be dropped from the cube.
You can always activate the navigation attribute in the cube with data in the cube.
I think you have tried to activate it in the master data as well and then in the cube or something like that??
follow the correct the procedure and try again.
Thanks
Ajeet

Issue with Data Load

HI All,
I am trying to load data from CRM System to ODS. I am coming across warning
"Processing (data packet): No data " ( Yellow Clolor )
Rest all is fine.(Requests (messages): Everything OK , Extraction (messages): Everything OK ,
Transfer (IDocs and TRFC): Everything OK .
I checked in CRM Box in RSA3 and i can see around 30 records for this extractor.
I checked the IDOCs in BE87 and every thing looks fine . can some one help in this issue .
Thanks,
Abraham

In RSMO i dont see any data records beeing Pulled, i tried loading data to the PSA but it gives back the same Warning messages in the Details Tab .
Requests (messages): Everything OK
Extraction (messages): Everything OK
Transfer (IDocs and TRFC): Everything OK
Processing (data packet): No data ( This is in Yellow Color )
But it says that the data Load is Successfull though it is pulling 0 records .

Latest PowerQuery issues with data load to data models built with older version + issue when query is changed

We have a tool built in excel + Powerquery version 2.18.3874.242 - 32 Bit (No PowerPivot) using data load to data model (not to workbook). There are data filters linked to excel cells, inserted in OData query before data is pulled.
The Excel tool uses organisational credentials to authenticate.
System config: Win 8.1, Office 2013 (32 bit)
The tool runs for all users as long as they do not upgrade to PowerQuery_2.20.3945.242 (32-bit).
Once upgraded users can no longer get the data to load to the Model. Data still loads to the Workbook but the model breaks down. Resetting load to data model erases all measures.
Here are the exact errors users get:
1. [DataSource.Error] Cannot parse OData response result. Error: Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host.
2. The Data Model table could not be refreshed: There isn't enough memory to complete this action. Try using less data or closing other applications. To increase memory available, consider ......

Hi Nitin,
Is this still an issue? If so, can you kindly provide the details that Hadeel has asked for?
Regards,
Michael Amadi
Please use the 'Mark as answer' link to mark a post that answers your question. If you find a reply helpful, please remember to vote it as helpful :)
Website: http://www.nimblelearn.com, Twitter:
@nimblelearn

BW Data Load Monitoring

Hi,
Could anybody say me how to monitoring a load from R3(4.6C) to BW(3.5)?
I need to know the size in MB transfered in a load. In transaction RSMON i can see the records transfered but i don´t know how to calculate the mb. I need to know the size of the records to calculate this. Or there is a transaction where can i find the information?
Thanks.

Hi,
The perfect way to calculate the size of your daily data load in MB is to.
Goto Transaction DB02
Press the Space Statistics which you can find at the end of the screen..
A small pop window will open - in that select table statistics
Now a new screen will open, give the name of your table(PSA, DSO, Cube ) and make sure you give the technical name that starts with /BIC/ and you can see
the size and other details for a day, week and month.
Regards,
Kadriks

Issue in Data Loading in BW

Dear BW GURUS,
We are facing data loading in BW. When we start process chain. it is showing Job id. But the data loading is not starting. We could not trace the log files for the same.
Please throw some light on this. Any pointers would be appreciable.
Thanks in advance.
Regards,
Mohankumar.G

Hi Mohan,
By buffering the number ranges, the system reduces the number of database reads to the NRIV table, thus speeding up large data loads.
The SAP BW system uses number ranges when loading master data or transactional data into BW. The system uses a unique master data number ID for each loaded record. Each new record reads the number range table NRIV to determine the next number in sequence. This ensures that there are no duplicate numbers. Not using unique number range values could compromise the datau2019s integrity.
Number ranges can cause significant overhead when loading large volumes of data as the system repeatedly accesses the number range table NRIV to establish a unique number range. If a large volume of data is waiting for these values, then the data loading process becomes slow.
One way to alleviate this bottleneck is for the system to take a packet of number range values from the table and place them into memory. This way, the system can read many of the new records from memory rather than repeatedly accessing and reading table NRIV. This speeds the data load.
Regards,
Vamsi Krishna Chandolu

Issue with Data Loading

Hi Experts,
Need your kind help in overcoming the following issue.
We are doing a full load to an ODS daily from flat file system. Due to certain change request the update rule was changed in between and later on we found out that it was not correct. So the update rule was corrected again. Now its working fine. But still some requests are there where the data has been updated in ODS with the faulty update rule. All the data fields in the update rule for the ODS are using overwrite functionality. The problem lies here is we are not sure if the faulty records in the ODS have not been updated by the following requests. As we are not sure of the exact nature of the data coming in.
From this ODS one Infocube and one more ODS is being updated. The Key figure calculation in the Cube uses the 'maximum', 'minimum' & 'Addition' calculations.
And the load from ODS to cube is delta.
Kindly let me know what can we do to close the above issue.
I was planning to delete the concerned requests from ODS and reconstruct it. But that way I can correct the data in ODS only. I am not sure if the changes made to the ODS data will be properly relayed to the cube in the proper fashion. please let me know if it will be correct?
All the flat file data is still residing in the PSA. Also kindly let me know if there is any method to check the PSA for the requests spanning the whole period apart from going to each request and check it one by one.
Thanks in advance.

Hi Experts,
My concern was Say I delete the requests from the day the data was loaded with thw wrong update rule, I have the data sitting in the PSA and I can reconstruct them. I understand that the data can be corrected in ODS.
But in the cube, some key figures are there with the update method as 'addition'. So say I delete the content of the cube and reload it from the ODS all over again, wont the key figures get corruipted yet again?
Also as I was thinking, say we delete the respective request from the cube as well, and reconstruct the data in the ODS. can I fire the delta request again to capture the changed records to be loaded to cube. to be exact will all the data from the date of the data corruption(as I am going to delete the requests from the cube from that day also) will be loaded to the cube?
Also another thing is will it be a better idea to reconstruct a request in the ODS and run the delta package for the cube.. And go on ..
Kindly suggest..
Thanks in advance !!!

Issue with Data Load from R/3

Hi,
I have created a generic data source in R/3 based on the option Extraction from SAP Query. the SAP Query (Infoset) created in the TCODE SQ02 is based on the tables BKPF and BSEG. I have generated a Data source on this and successfully replicate dinto BW but when i trigger the load uing infopackage it immediately fails and gives the following messages.
*If the source system is a Client Workstation, then it is possible that the file that you wanted to load was being edited at the time of the data request. Make sure that the file is in the specified directory, that it is not being processed at the moment, and restart the request.*
+Job terminated in source system --> Request set to red+
Can you point where the issues is. I have tested the source system connection and it is fine as other extractors are working fine and data can be pulled
Thanks
Rashmi.

Hi Rashmi,
Try the following:
- RSA3 in source system -> test extraction OK?
- Shortdump (ST22) found in BW or R/3?
- Locate the job of the extraction in R/3 (SM37) and look at the joblog...
Hope this leads you to the cause...
Grtx
Marco

Issue: No Data loaded from Query - MDX, SQL issue

Hello,
I'm having a problem with a report based on Query with a hierarchy (0GLACCEXT Hierarchie, Data in Cube 0FIGL_V10), first version of query had 3 filters, but I also tried to load the data without filters thinking it coused the problem - didn't help to fix the issue.
If I put some characteristics into the report - the fields are empty - i did "browse data" in the database and found out that only the data for the "year" was fetched by the SQL expression even though I have some similar reports with hierarchies based on 0GL_Account and data is fetched correctly in those ones.
I tried MDXTEST on SQL expression
"SELECT {[Measures].[D5LABJ7EYP982LUFOJAXZ3Z3E]} ON COLUMNS, NON EMPTY [0GLACCEXT CVIS].MEMBERS DIMENSION PROPERTIES [0GLACCEXT CVIS].[40GLACCEXT] ON ROWS FROM [0FIGL_V10/ZEN_FIGL_V10_Q0001]"
Data is being loaded.
What else can I try?
ps: just found out that data is not fetched when i assign a hierarchie no matter which one (could it be the issue due to the size of hierarchy?)
Edited by: Elizaveta Nikitina on May 5, 2009 3:33 PM

Please re-post if this is still an issue to the Data Connectivity - Crystal Reports Forum or purchase a case and have a dedicated support engineer work with you directly

Issue with Data Loading between 2 Cubes

Hi All
I have a Cube A which has huge amount of data. Around 7 years of data. This cube is on BWA. In order to empty out space from this Cube we have created a new Cube B.
We have now starting to load data from Cube A to Cube B based on created on. But we are facing a lot of memory issues hence we are unable to load data for a week in fact. As of now we are loading based on 1 date which is not useful as it will take lot of time to load 4 years of data.
Can you propose some alternate way by which we can make this data transfer faster between 2 cubes ? I though of loading Cube B from DSO under Cube A but that's not possible as the DSO does not have that much old data.
Please share your thoughts.
Thanks
Prateek

HI SUV / All
I have tried running based on Parallel process as there are 4 for my system. there are no routines between Cube to Cube. There is already a MP for this cube. I just want to shift data for 4 years from this cube into another.
1) Data packet as 10, 000 - 8 out of some 488 packets failed
2) Data packet as 20, 000 - 4 out of some 244 packets failed
3) Data packet as 50,000 - Waited for some 50 min. No extraction. So killed the job.
Error : Dump: Internal session terminated with runtime error DBIF_RSQL_SQL_ERROR (see ST22)
In ST22:
Database error text........: "ORA-00060: deadlock detected while waiting for
resource"
Can you help resolving this issue or some pointers ?
Thanks
Prateek

Regading Process chains data load monitoring

Hi All,
In my current project, I need to monitor process chains. I am kind of new to this environment as I had not done this before. My tasks are as follows.
1. Process chains are scheduled for a periodic job for every on hour starting at 6 a.m and ending at 12 a.m. After that I need to stop the chain and reschedule it for next day at 6 a.m. How do I do that?
2. Also if a delta process chain fails in one of the processes, I need to stop the chain before the next delta run starts filling the cube. How do I do that?
Also how to see why the process failed?
Please do respond.
Thanks in advance.

You can stop your process chain in SM37 tcode. Just select the schedules processes, and here you can see your process chain, just select it, and cancel it for next release.
You can restart it, just by clicking on Execute button. Before executing PC, just cross check by right clicking process chain, and go to change selection option of maiantain variant of start variant. And see if process chain schedule option is starting at 6A.M. or not, and also check it is selected as period job of ` hour or not.
You can see log of process chain by right clicking it, and checking the message. It depends on what option for next process is you selected, like if your next variant connected to failed variant is selected as only if success, then you don;t need to stop ot. It will automatically not go to next process. or right click and you can select stop.
By right clicking on failed process you can see the logs in details.

Common issues in data load monitoring...

Similar Messages

Maybe you are looking for