DTP running long time to load master data due to lock on SID table
Hi,
we are facing a problem while DTP loading master data into targets(Info Objects).
It is taking long time to load data due to below error.
18.03.2014 01:03:23 All records forwarded RSM2 730 S
18.03.2014 01:13:39 EXTRACTION OF DATAPACKAGE 000009 RSAR 051 S
18.03.2014 01:13:40 All records forwarded RSM2 730 S
18.03.2014 01:24:50 EXTRACTION OF DATAPACKAGE 000010 RSAR 051 S
18.03.2014 01:24:51 All records forwarded RSM2 730 S
18.03.2014 01:38:34 EXTRACTION OF DATAPACKAGE 000011 RSAR 051 S
18.03.2014 01:38:41 All records forwarded RSM2 730 S
18.03.2014 01:52:10 EXTRACTION OF DATAPACKAGE 000012 RSAR 051 S
18.03.2014 01:52:10 All records forwarded RSM2 730 S
18.03.2014 02:06:51 EXTRACTION OF DATAPACKAGE 000013 RSAR 051 S
18.03.2014 02:06:53 All records forwarded RSM2 730 S
18.03.2014 02:22:32 EXTRACTION OF DATAPACKAGE 000014 RSAR 051 S
18.03.2014 02:22:33 All records forwarded RSM2 730 S
18.03.2014 02:38:36 EXTRACTION OF DATAPACKAGE 000015 RSAR 051 S
18.03.2014 02:38:37 All records forwarded RSM2 730 S
18.03.2014 02:55:25 EXTRACTION OF DATAPACKAGE 000016 RSAR 051 S
18.03.2014 02:55:25 All records forwarded RSM2 730 S
18.03.2014 03:13:56 SQL: 18.03.2014 03:13:56 ALEREMOTE DBMAN 099 I
18.03.2014 03:13:56 TRUNCATE TABLE "/BI0/0600000066" DBMAN 099 I
18.03.2014 03:13:56 SQL-END: 18.03.2014 03:13:56 00:00:00 DBMAN 099 I
18.03.2014 03:13:56 SQL: 18.03.2014 03:13:56 ALEREMOTE DBMAN 099 I
18.03.2014 03:13:56 LOCK TABLE "/BI0/0600000066" IN EXCLUSIVE MODE DBMAN 099 I
18.03.2014 03:13:56 NOWAI DBMAN 099 I
18.03.2014 03:13:56 SQL-END: 18.03.2014 03:13:56 00:00:00 DBMAN 099 I
18.03.2014 03:13:58 EXTRACTION OF DATAPACKAGE 000017 RSAR 051 S
18.03.2014 03:13:59 All records forwarded RSM2 730 S
18.03.2014 03:34:24 EXTRACTION OF DATAPACKAGE 000018 RSAR 051 S
18.03.2014 03:34:25 All records forwarded RSM2 730 S
18.03.2014 03:56:03 EXTRACTION OF DATAPACKAGE 000019 RSAR 051 S
18.03.2014 03:56:03 All records forwarded RSM2 730 S
18.03.2014 04:19:55 EXTRACTION OF DATAPACKAGE 000020 RSAR 051 S
18.03.2014 04:19:56 All records forwarded RSM2 730 S
18.03.2014 04:44:07 SQL: 18.03.2014 04:44:07 ALEREMOTE DBMAN 099 I
18.03.2014 04:44:07 TRUNCATE TABLE "/BI0/0600000068" DBMAN 099 I
18.03.2014 04:44:09 SQL-END: 18.03.2014 04:44:09 00:00:02 DBMAN 099 I
18.03.2014 04:44:09 SQL: 18.03.2014 04:44:09 ALEREMOTE DBMAN 099 I
18.03.2014 04:44:09 LOCK TABLE "/BI0/0600000068" IN EXCLUSIVE MODE DBMAN 099 I
18.03.2014 04:44:09 NOWAI DBMAN 099 I
18.03.2014 04:44:09 SQL-END: 18.03.2014 04:44:09 00:00:00 DBMAN 099 I
18.03.2014 04:44:12 EXTRACTION OF DATAPACKAGE 000021 RSAR 051 S
18.03.2014 04:44:13 All records forwarded RSM2 730 S
For this long running data load we didnt find any short dumps and no locks available on SM12 also.
Please help on this.
Thanks,
Sankar.
Can we know what kind of data source is this. attribute or text data source.
what is data volume? its less or more?
Actually we load direct access data thru dtp(No psa) into info objects for text data sources where have less data only.
While running your dtp is any attribute change run for the same info object ot any transactional loads are happening?
Is this happens on particular day or weekend or anydays?
Thanks
Similar Messages
-
DTP loading to master data is running long due to lock on SID table
Hi All,
We have DTP loading directly from infoobject to master data infobject. DTP usually takes less than 30min to update but at times its observed the DTP runs for hours to update. No dump was found on ST22. and no locks on sm12 apart from this DTP. On analysing the log in sm37, we found exclusive locks on the SID tables.
18.03.2014 02:06:53 All records forwarded RSM2 730
18.03.2014 02:22:32 EXTRACTION OF DATAPACKAGE 000014 RSAR 051
18.03.2014 02:22:33 All records forwarded RSM2 730
18.03.2014 02:38:36 EXTRACTION OF DATAPACKAGE 000015 RSAR 051
18.03.2014 02:38:37 All records forwarded RSM2 730
18.03.2014 02:55:25 EXTRACTION OF DATAPACKAGE 000016 RSAR 051
18.03.2014 02:55:25 All records forwarded RSM2 730
18.03.2014 03:13:56 SQL: 18.03.2014 03:13:56 ALEREMOTE DBMAN 099
18.03.2014 03:13:56 TRUNCATE TABLE "/BI0/0600000066" DBMAN 099
18.03.2014 03:13:56 SQL-END: 18.03.2014 03:13:56 00:00:00 DBMAN 099
18.03.2014 03:13:56 SQL: 18.03.2014 03:13:56 ALEREMOTE DBMAN 099
18.03.2014 03:13:56 LOCK TABLE "/BI0/0600000066" IN EXCLUSIVE MODE DBMAN 099
18.03.2014 03:13:56 NOWAI DBMAN 099
18.03.2014 03:13:56 SQL-END: 18.03.2014 03:13:56 00:00:00 DBMAN 099
18.03.2014 03:13:58 EXTRACTION OF DATAPACKAGE 000017 RSAR 051
18.03.2014 03:13:59 All records forwarded RSM2 730
18.03.2014 03:34:24 EXTRACTION OF DATAPACKAGE 000018 RSAR 051
18.03.2014 03:34:25 All records forwarded RSM2 730
18.03.2014 03:56:03 EXTRACTION OF DATAPACKAGE 000019 RSAR 051
18.03.2014 03:56:03 All records forwarded RSM2 730
18.03.2014 04:19:55 EXTRACTION OF DATAPACKAGE 000020 RSAR 051
18.03.2014 04:19:56 All records forwarded RSM2 730
18.03.2014 04:44:07 SQL: 18.03.2014 04:44:07 ALEREMOTE DBMAN 099
18.03.2014 04:44:07 TRUNCATE TABLE "/BI0/0600000068" DBMAN 099
18.03.2014 04:44:09 SQL-END: 18.03.2014 04:44:09 00:00:02 DBMAN 099
18.03.2014 04:44:09 SQL: 18.03.2014 04:44:09 ALEREMOTE DBMAN 099
18.03.2014 04:44:09 LOCK TABLE "/BI0/0600000068" IN EXCLUSIVE MODE DBMAN 099
18.03.2014 04:44:09 NOWAI DBMAN 099
Is the lock on the SID table reason for the delay?? if so how to avoid this delay?
if not, What are the other possibilties to avoid this issue ??
Thanks in advance.Hello Yogesh,
priority of the Job is 'A' . Is this related to lock on SID table as when i observe system logs for successful runs i don see the lock on SID table.
please refer the below log for successful run.
19.03.2014 07:16:21 EXTRACTION OF DATAPACKAGE 000051
19.03.2014 07:16:22 All records forwarded
19.03.2014 07:16:34 EXTRACTION OF DATAPACKAGE 000052
19.03.2014 07:16:34 All records forwarded
19.03.2014 07:16:47 EXTRACTION OF DATAPACKAGE 000053
19.03.2014 07:16:48 All records forwarded
19.03.2014 07:17:02 EXTRACTION OF DATAPACKAGE 000054
19.03.2014 07:17:03 All records forwarded
19.03.2014 07:17:17 EXTRACTION OF DATAPACKAGE 000055
19.03.2014 07:17:17 All records forwarded
19.03.2014 07:17:31 EXTRACTION OF DATAPACKAGE 000056
19.03.2014 07:17:32 All records forwarded
19.03.2014 07:17:45 EXTRACTION OF DATAPACKAGE 000057
19.03.2014 07:17:45 All records forwarded
19.03.2014 07:17:58 EXTRACTION OF DATAPACKAGE 000058
19.03.2014 07:17:59 All records forwarded
19.03.2014 07:18:11 EXTRACTION OF DATAPACKAGE 000059
19.03.2014 07:18:11 All records forwarded
19.03.2014 07:18:24 EXTRACTION OF DATAPACKAGE 000060
19.03.2014 07:18:24 All records forwarded
19.03.2014 07:18:37 EXTRACTION OF DATAPACKAGE 000061
19.03.2014 07:18:37 All records forwarded
19.03.2014 07:18:50 EXTRACTION OF DATAPACKAGE 000062
19.03.2014 07:18:51 All records forwarded
19.03.2014 07:19:04 EXTRACTION OF DATAPACKAGE 000063
19.03.2014 07:19:06 All records forwarded
19.03.2014 07:19:19 EXTRACTION OF DATAPACKAGE 000064
19.03.2014 07:19:20 All records forwarded
19.03.2014 07:19:32 EXTRACTION OF DATAPACKAGE 000065
19.03.2014 07:19:33 All records forwarded
19.03.2014 07:19:47 EXTRACTION OF DATAPACKAGE 000066
19.03.2014 07:19:47 All records forwarded
19.03.2014 07:19:53 EXTRACTION OF DATAPACKAGE 000067
19.03.2014 07:19:53 Start of Serial Processing Processing is Executed in the Same LUW
19.03.2014 07:19:53 Processing started for batch ID DTPR_1739894_1 process 3
19.03.2014 07:19:53 Processing completed for batch ID DTPR_1739894_1 process 3
19.03.2014 07:19:53 End of Serial Processing Executed in the Same LUW
19.03.2014 07:19:54 Technical status 'Green' (user ALEREMOTE)
19.03.2014 07:19:57 Set overall status to 'Green' (user ALEREMOTE)
19.03.2014 07:20:41 Processing completed for batch ID DTPR_1739894_1 process 2
19.03.2014 07:20:41 Job finished
Thanks -
Taking long time to load the data
Hi All,
When my BI colleague is trying to load data from a source system, it is taking too long.
And the corresponding job BI_BOOK* is taking around 90000 seconds already.
Can anyone suggest how to tackle this problem?
Thanks so much in advance.
Best Regards, PradeepHi
If your Flat File Source System Takes, time there is no other go than Make the Request Red and Delete the same.Repeat the Upload.
Make sure that your Flat file is closed while upload,
If Infopackage loads data from a flat file on your workstation, then you cannot execute the Infopackage in a Process Chain you need to put your flat file on the Application Server(AL11) and change your Infopackage to load from there instead of the workstation
The file should be closed while scheduling
The file path mentioned in the external data tabpage of the infopackage should be correct
Records in the file should be in uppercase you can use lowercase for a particular characteristic.provided the lowercase checkbox in the general tabpage of the maintenance screen of the infoobject is checked.
Calendar day should be of the format yyyymmdd in the file
Hope ithelps
Edited by: Aduri on Jan 30, 2009 11:19 AM -
Infopath form taking long time to load sql data
In infopath form having with multple views. In one of the view SQL Data will be loaded on selection of dropdown to repeating table. If it is lessthan 1000 items its working, if it is morethan 1500 items form will hanging for 15-20 mins.
Form is developed by C# code. Can anyone suggest to relsolve this issue. Thanks in Advance.Hello,
I also had same problem while querying connection via rule so i gave chance to code and query executes within 2-5 seconds which was taking 10-15 mins earlier. Try this
AdoQueryConnection myAdoQueryConnection = (AdoQueryConnection)(this.DataConnections["SQL Con"]);
myAdoQueryConnection.Command = "select * from table1 where col1 = " + "'" + InstallationID + "'";
myAdoQueryConnection.Timeout = 60;
myAdoQueryConnection.Execute();
Hope it could help
Hemendra:Yesterday is just a memory,Tomorrow we may never see<br/> Please remember to mark the replies as answers if they help and unmark them if they provide no help -
Best Practices for Loading Master Data via a Process Chain
Currently, we load attributes, text, and hierarchies before loading the transactional data. We have one meta chain. To load the master data it is taking more than 2 hours. Most of the master data is full loads. We've noticed that a lot of the master data, especially text, has not changed or changed very little since we implemented 18 months ago. Is there a precedence or best practice to follow such as do we remove these processes from the chain? If so, how often should it be run? We would really like to reduce the amount of the master data loading time. Is there any documentation that I can refer to? What are other organizations doing to reduce the amount of time to load master data?
Thanks!
DebbyHi Debby,
I assume you're loading Master Data from a BI system? The forum here are related to SAP NetWeaver MDM, so maybe you should ask this question in a BI forum?
Nevertheless, if your data isn't changed this much, maybe you could use a delta mechanism for extraction? This would send only the changed records and not all the unchanged all the time. But this depends on your master data and of course on your extractors.
Cheers
Michael -
DTP error: Lock NOT set for: Loading master data attributes
Hi,
I have a custom datasource from ECC which loads into 0CUST_SALES. I'm using DTP & transformation which has worked for loading data in the past for this infoobject. The infopackage loads with a green status but when i try to load data, the DTP fails with an error message at "Updating attributes for InfoObject 0CUST_SALES Processing Terminated" & the job log says: "Lock NOT set for: Loading master data attributes". I've tried reactivating everything but it didn't help. Does anyone know what this error means? We're on SP7. Thanks in advance!Hello Catherine
I have had this problem in the past (3.0B) --> the reason is that our system was too slow and could not crunch the data fast enough, therefore packets where loacking each other.
The fix: load the data into the PSA only, and then send it in background from the PSA to the info object. By doing this, only a background process will run, therefore locks cannot happen.
Fix#2: by a faster server (by faster, I mean more CPU power)
Now, maybe you have another issue with NW2004s, this was only my 2 cents quick thought
Good luck!
Ioan -
Loading Master data using DTP's
Hi,
I have got a problem with loading master data,we use DTP's for loading it,but the requests were failing due to prior incorrect requests for that master data infoobject,inspite of the fact that Master data always overwrites and also the DTP's were full update enabled.
To load successfully we need to go and delete the previous requests all the time.
I think there must be some way of solving this problem,help from you all will be really appreciated.
Regards,
G.Monica Roja Flora.yeah you would need to delete the incorrect requests before you can load again. Though the master data is overwrite, with the incorrect request the status can never be A.
-
Long time to load data from PSA to DSO / CUBE. Sequential read RSBKDATA_V
Hi Gurus
The process stays for several hours on sequential read from RSBKDATA_V - temporary storage for DTPs.
After several hours, the processing finally starts, but even when I assign several BGDs to the DTP it takes hours to load the data.
We have BI7.0 with SP22, so all relevant notes are already implemented.
Does any one had similar problem, please?
Thanks in advance
MartinHi Martin,
this issue has cropped up a few times. Please check and implement the following notes:
1338465 P22:DTP:LOG: Performance problem when messages are added +
1331544 P22:HINT:Slow performance when accessing RSMONFACT +
1312701 70SP21: Performance on view RSBKDATA_V selects
1304234 70SP21: Performance on the hashed table p_th_rsbkdata_v **
1168098 70SP19: Performance during DataStore object extraction
1080027 70SP16: Performance during parallel processing
These notes should improve the performance of the DTPs in your system.
After you've added the notes, please check in tables RSBKDATA and RSBKDATAINFO whether they contain any data. If the tables are empty, please reorganise the tables, and restart the dtp.
Hope this helps you.
Rgds,
Colum -
Long time to load data from PSA to DSO -Sequential read RSBKDATA_V
Hi ,
It is taking long time to load data from PSA to DSO. It is doing Sequential read on RSBKDATA_V and table contents no data .
we are at - SAPKW70105. It started since yesterday . There is no changes in system parameters.
Please advice.
Thanks
NileshHi Nilesh,
I guess the following SAP Note will help you in this situation.
[1476842 - Performance: read RSBKDATA only when needed|https://websmp107.sap-ag.de/sap/support/notes/1476842]
Just note that the reference to Support Packages is wrong. It is also included in SAP_BW 701 06. -
Data form taking long time to load
Hi All,
My data form is taking a very long time to load. It has period dimension which is having 53 weeks. If I collase Period dimension then the dataform opens up quickly otherwise its taking a very long time (around 7 mins) to open up.
What can be done to improve the speed?
ThanksAbhishek wrote:
Hope this helps
Improving data form performance
So do I :)
Cheers
John
http://john-goodwin.blogspot.com/ -
It takes long time to load the parameter's value when running we run report
Hi,
It takes long time to load the parameter's value when running we run report. What could cause this? How to troubleshoot the behavior of the report? Could I use Profile and what events should i select?
ThanksHi jori5,
Based on my understanding, after changing the parameter, the report render very slow, right?
In Reporting Service, the total time to generate a report include TimeDataRetreval, TimeProcessing and TimeRendering. To analyze which section take much time, we can check the table Executionlog3 in the ReportServer database. For more information, please
refer to this article:
More tips to improve performance of SSRS reports.
In your scenario, since you mention the query spends less time, the delay might happens during report processing and report rendering section. So you should check Executionlog3 to check which section costs most of time, then you can refer to this article
to optimize your report:
Troubleshooting Reports: Report Performance.
If you have any question, please feel free to ask.
Best regards,
Qiuyun Yu -
Firefox is really starting to annoy me. Sometimes it runs slow and sluggishly, other times it doesn't. Usually it does though. When I open new tabs, the connection icon will just keep swirling. I constantly get High CPU Useage alerts from my virus protection. I've done everything listed in the below articles. Does anyone have some advice? Firefox didn't use to be like this.
Thank you.
https://support.mozilla.org/en-US/questions/864739?as=aaq
https://support.mozilla.org/en-US/questions/882138#answer-256718Alright, it's getting to the point where I can barely use FireFox anymore. It's getting worse by the day, I don't understand. Web pages take a LONG time to load, but sometimes they don't....it's hit or miss. But when they do take a long time, they take a long time.
It's getting very bad. I don't know much about computers, safe mode, and all that. It would really help if someone could walk me through what to do, like they would a 10-year old... actually a 10-year old probably knows more than me. Well you get the idea.
I really want to keep using this browser, but if I don't get it fixed I will have to stop. Like I said in the initial post, I've done all the things those two links suggested. It got better at first, but now it seems like it's gotten worse. -
DTP to load master data, gives the message 'No more data available'.
hi,
when i execute the DTP to load master data from DSO, it executes and gives the message 'No more data available'. The request is green but no data is transferred from the DSO to master data.
I want the DSO data to get into master data how do i do it?Hi Hardik,
Since the request is green, there is no error in extraction. But, as they've rightly pointed out, the Update mode of the DTP must be Delta and there must not be any new Master data that you are looking for.
Compare the data and check if the Delta DTP should bring anything at all i.e. new records. If there are no new records, then the Delta DTP will not bring any more data. Else, change mode to Full and check again.
Reg,
Dhaval -
Issue while loading Master Data through Process Chain in Production
Hi All,
We are getting an error in Process chain while loading Master Data
Non-updated Idocs found in Source System
Diagnosis
IDocs were found in the ALE inbox for Source System that are not updated.
Processing is overdue.
Error correction:
Attempt to process the IDocs manually. You can process the IDocs manually using the Wizard or by selecting the IDocs with incorrect status and processing them manually.
I had checked the PSA also but I could not find any record and the strange thing is, Job itself is not getting scheduled. Can any one help me out in order to resolve this issue.
Regards
BhanumathiHi
This problem is not related to Process chain..
u can try this..
In RSMO, select the particular load you want to monitor.
In the menu bar, Environment >>> Transact. RFC >>> Select whichever is required, BW or Source System.
In the next screen you can select the Execute button and the IDOCS will be displayed.
Check Note 561880 - Requests hang because IDocs are not processed.
OR
Transact RFC - status running Yellow for long time (Transact RFC will be enabled in Status tab in RSMO).
Step 1: Goto Details, Status get the IDoc number,and go to BD87 in R/3,place the cursor in the RED IDoc entroes in tRFC
queue thats under outbound processing and click on display the IDOC which is on the menu bar.
Step 2: In the next screen click on Display tRFC calls (will take you to SM58 particular TRFC call)
place the cursor on the particular Transaction ID and go to EDIT in the menu bar --> press 'Execute LUW'
(Display tRFC calls (will take you to SM58 particular TRFC call) ---> select the TrasnID ---> EDIT ---> Execute LUW)
Rather than going to SM58 and executing LUW directly it is safer to go through BD87 giving the IDOC name as it will take you
to the particular TRFC request for that Idoc.
OR
Go into the JOB Overview of the Load there you should be able to find the Data Package ID.
(For this in RSMO Screen> Environment> there is a option for Job overview.)
This Data Package TID is Transaction ID in SM58.
OR
SM58 > Give * / user name or background (Aleremote) user name and execute.It will show you all the pending TRFC with
Transaction ID.
In the Status Text column you can see two status
Transation Recorded and Transaction Executing
Don't disturb, if the status is second one Transaction Executing. If the status is first one (Transation Recorded) manually
execute the "Execute LUWs"
OR
Directly go to SM58 > Give * / user name or background (Aleremote) user name and execute. It will show TRFCs to be executed
for that user. Find the particular TRFC (SM37 > Req name > TID from data packet with sysfail).select the TrasnID (SM58) --->
EDIT ---> Execute LUW
(from JituK)
Hope it helps
Darshan -
Loading master data attributes
Hi.
When I am loading master data attributes, DTP process takes long time (approximately 30 minute) .
Although records count is just 193.
What may be a reason of this?
Information about system:
Software component Release Level
SAP_ABA 700 0023
SAP_BASIS 700 0023
SAP_BW 700 0025Hi...
Check the Package size in the DTP......try to increase or decrease it.....if it makes any differerence......
Secondly....in the DTP in the tab "Update" select the option " Valid records update, No reporting"....then the "Semantic Groups" in the tab " Extraction" will work.....it will improve the performance....
Regards,
Debjani........
Maybe you are looking for
-
Oracle 11g R2 Architecture Diagram
Hi, I trust this is the right way to go about the following Few years ago I created an architecture diagram for 10g. I have now updated that diagram to include new features of Oracle 11g. Obviously there is so much one can detail in one page PDF Arch
-
BOM for the materials in plant
Hi, What is the tcode to find the materials i have in plant is having BOM? Rex
-
I'm trying to convert an old Excel sheet to Numbers and TRUNC is failing to do its job. Example: =TRUNC(G8, 0) >>will look at G8 and truncate properly. =TRUNC(G8, 0) & ":" >>When trying to add text, the number loses its truncation and adds 2 decimal
-
Hi, Please tell me about procedure, how to create logical host name in sun cluster.
-
My pro 13" with retina display is shutting down automatically? what to do
Hey Uers My macbook pro 13" retina display is shutting down automatically and it restarts itself. What should i do on this????