Loading master data in BI production

Dear Experts,
While loading master data in BI production we are facing error when updating IDOCS.
__MONITOR ADMINISTRATOR WORKBENCH__
STATUS:
ERROR:Error when updating IDOCS in source system.
DIAGNOSIS:Errors have been reported in source system during IDOCS Update
SYSTEM RESPONSE:Some IDOCS have error status
PROCEDURE:
Check the IDOCS in source system.You do this using the extraction monitor.
ERROR:How you ressolve the errors depends on the error message you get.
SO can anyone tell why this type of errors occured? What will be the reason behind this?
Thanks in advance.
Warm Regards,
Bunty.

Hi Bunty,
Your Idoc error is a general error, the first of all will be to know what is the concrete error with the Idoc, for this reason, please do the following checks and let us know the results:
1.-) Execute the tx.code SM58. BD87 and WE05 and give us your feedback, tell us for each tx,.code if some errors are shown.
2.-) Do you display some error if you go to tx.code SM59 - Select RFC Destination "Source system" -> Authorization test?
3.-) Please ensure that your remote user has the correct authorization profiles in both BW and R/3. You need to set your
     profiles for ALEREMOTE as such:
   1) in BW -> the remote user (usually 'ALEREMOTE') must have
       profile 'S_BI-WHM_RFC'
   2) in R/3 -> the remote user (usually 'ALEREMOTE') must have
       profile 'S_BI-WX_RFC'
This is explained in more detail in note 150315.
Also, you must ensure that you have sufficient DIA processes in both your BW and R/3 systems. DIA work processes are necessary for the processing of IDOC's. And if there are not sufficient DIA work processes, the load may hang in status 'yellow'. Note 561880 gives more information about this:
1. Make sure there is always sufficient DIA, that is, at least 1 DIA more than all other work processes altogether, for
      example, 8 DIA for a total of 15 work processes (see also note 74141)."
4.- ) Please identify if the Idocs get hanged in the the source system, and if these Idocs cannot be processed manually in        Tcode SM58 please implement the correction from note 1280898. // I hope it helps you. Best regards. Fran.

Similar Messages

Issue while loading Master Data through Process Chain in Production

Hi All,
We are getting an error in Process chain while loading Master Data
Non-updated Idocs found in Source System
Diagnosis
IDocs were found in the ALE inbox for Source System that are not updated.
Processing is overdue.
Error correction:
Attempt to process the IDocs manually. You can process the IDocs manually using the Wizard or by selecting the IDocs with incorrect status and processing them manually.
I had checked the PSA also but I could not find any record and the strange thing is, Job itself is not getting scheduled. Can any one help me out in order to resolve this issue.
Regards
Bhanumathi

Hi
This problem is not related to Process chain..
u can try this..
In RSMO, select the particular load you want to monitor.
In the menu bar, Environment >>> Transact. RFC >>> Select whichever is required, BW or Source System.
In the next screen you can select the Execute button and the IDOCS will be displayed.
Check Note 561880 - Requests hang because IDocs are not processed.
OR
Transact RFC - status running Yellow for long time (Transact RFC will be enabled in Status tab in RSMO).
Step 1: Goto Details, Status get the IDoc number,and go to BD87 in R/3,place the cursor in the RED IDoc entroes in tRFC
queue thats under outbound processing and click on display the IDOC which is on the menu bar.
Step 2: In the next screen click on Display tRFC calls (will take you to SM58 particular TRFC call)
place the cursor on the particular Transaction ID and go to EDIT in the menu bar --> press 'Execute LUW'
(Display tRFC calls (will take you to SM58 particular TRFC call) ---> select the TrasnID ---> EDIT ---> Execute LUW)
Rather than going to SM58 and executing LUW directly it is safer to go through BD87 giving the IDOC name as it will take you
to the particular TRFC request for that Idoc.
OR
Go into the JOB Overview of the Load there you should be able to find the Data Package ID.
(For this in RSMO Screen> Environment> there is a option for Job overview.)
This Data Package TID is Transaction ID in SM58.
OR
SM58 > Give * / user name or background (Aleremote) user name and execute.It will show you all the pending TRFC with
Transaction ID.
In the Status Text column you can see two status
Transation Recorded and Transaction Executing
Don't disturb, if the status is second one Transaction Executing. If the status is first one (Transation Recorded) manually
execute the "Execute LUWs"
OR
Directly go to SM58 > Give * / user name or background (Aleremote) user name and execute. It will show TRFCs to be executed
for that user. Find the particular TRFC (SM37 > Req name > TID from data packet with sysfail).select the TrasnID (SM58) --->
EDIT ---> Execute LUW
(from JituK)
Hope it helps
Darshan

36 duplicate record found. -- error while loading master data

Hello BW Experts,
Error while loading master data
( green light )Update PSA ( 50000 Records posted ) No errors
( green light )Transfer rules ( 50000 ³ 50000 Records ): No errors
( green light )Update rules ( 50000 ³ 50000 Records ): No errors
( green light ) Update ( 0 new / 50000 changed ): No errors
( red light )Processing end: errors occurred
     Processing 2 finished
Þ     36 duplicate record found. 15718 recordings used in table /BIC/PZMATNUM
Þ     36 duplicate record found. 15718 recordings used in table /BIC/XZMATNUM
This error repeats with all the data-packets.
what could be the reason of the error. how to correct the error.
Any suggestions appreciated.
Thanks,
BWer

BWer,
We have exactly the same issue when loading the infoobject 0PM_ORDER, the datasource is 0PM_ORDER_ATTR.
The workaround we have been using is 'Manual push' from the details tab of the monitor. Weirdly we don't have this issue in our test and dev systems, even in Production, this doesn't occur somedays. We have all the necessary settings enabled in the infopackage.
Did you figure out a solution for your issue, if so please let me know and likewise I will.
-Venkat

Caller-70 Error while loading master data into infoobject

hi ,
I am getting following error while loading master data into infoobject (0tb-account). I am loading this master data in production environment for the first time. there are about 300000 records. All have got loaded upto PSA. Infopackage settings were PSA and then into data target.
Short dump in the Warehouse
Diagnosis
The data update was not finished. A short dump has probably been logged in BI. This provides information about the error.
System Response
"Caller 70" is missing.
ST22 dump analysis is as below:
Termination occurred in the ABAP program "GP476CZYBEF2WX53UZ8TXFG6XOS" - in
"VALUE_TO_SID_CONVERT_DB".
The main program was "RSMO1_RSM2 ".
Please help as soon as you can..Production problem....
Regards
Rakesh

Hi rakesh,
May be IDOCs not processed completely,
Idoc Problem, Either wait till time out & process Idoc from detail monitor screen, or go to BD87 & process Idoc with status = YELLOW ( be careful while processing IDOCS from BD87, choose only relevant Idocs
Cheers
Raj

Error 0 update while loading master data

Hi,
Iam facing a problem while loading master data.Data has comes to PSA but it getting failed to load into infoobject it is showing the error " error in the 0 update".
Ihave tried for manual update, even though it is showing same problem .masterdata 0material is copy back from production to Quality.presently iam uploading data in quality.can anybody give your valuable suggestions.
Thanks & Regards,
Mahi.

I've a compounding characteristic in this characteristic.
And the master data loading was fine yesterday but today it doesn't work.
When I check with rsrv this characteristic, a dump with message:
Error in ABAP application program.
The current ABAP program "SAPLRRSI" had to be terminated because one of the
statements could not be executed.
This is probably due to an error in the ABAP program.
In program "GP47HH4A9VROVK98YR0TT9S7TQ5 ", the following syntax error occurred
in the Include "GP47HH4A9VROVK98YR0TT9S7TQ5 " in line 25:
"Field "/BIC/MZCATWRT" is unknown. It is neither in one of the specifie"
"d tables nor defined by a "DATA" statement. "DATA" statement."
So I think something is wrong in this Char.
But what can I do for that?
Thanks a lot for all idea.
Juan

How to copy master data backwards from production to QA

Hello BI community,
Our transactional QA system was refreshed with a database copy of production, and the BW landscape was not refreshed. We cannot refresh the BW QA system because the production BW database is far too large to be duplicated.
So I'm searching for a way to bring all of the MASTER DATA up to date in the BW QA environment, without performing manual reloads.
Would it be possible to perform a copy of just the P,Q, X, Y, and T tables from production database to QA ? I believe this would cause inconsistencies with the S tables. But then, to copy the S tables backwards from production to QA would cause inconsistencies with the transational data providers.
Is it possible to do a "client copy" in BW where only the master data is transferred ? I think we'd be comfortable with reloading all new transactional data as necessary, just as long as the master data were brought back in its entirety from production to QA.
Any thoughts our guidance will be greatly appreciated !
Thanks,
Keith

big thanks to everyone who has replied, and especially for this suggestion!
The reason why we don't load the data from BW production is simply a matter of volume. It's a 7 TB data warehouse, and the master data sizes are huge.
One other option I was thinking of, since I used to be a basis guy, is to copy the entire production database and then delete, delete, delete away the transactional data until it's all gone. The only thing needed after that is a database real work to give the space back. Of course, the basis guy see that as a last resort
I'll try this suggestion above & then report back with the results... but I'm afraid the data sizes, again, will be prohibitive. We'll see.

Loading Master Data - Select the 'right' attributes

Hello everybody,
hopefully some expert can answer my question.
I want to load Master Data for the InfoObject 0CRM_PROD.
When I look at the tree beneath the 0CRM_PROD attributes following DataSources are listed:
- 0CRM_PRODUCT_ATTR
- 0CRM_PROD_ATTR (obsolete)
- 0CRM_PR_MAT_ATTR
- 0CRM_PR_REST_IN_ATTR
- 0CRM_TR_CONTROL_ATTR
- 0PRODUCT_ATTR (obsolete)
- 0PRODUCT_GENERAL_ATTR
- 0PRODUCT_STATUS_ATTR
- 0PR_BASE_UNIT_ATTR
- 0PR_COMMERCIAL_ATTR
- 0PR_IL_PROREF_ATTR
- 0PR_PROD_VAR_ATTR
- 0PR_PURCHASE_CATEG_ATTR
- 0PR_SALES_CATEG_ATTR
Now my question is which attributes for 0CRM_PROD do I have to load?
Are any of them mandatory or basic attributes?
And how do the attributes 0CRM_PRODUCT_ATTR and 0PRODUCT_ATTR differ from each other?
Thanks in advance!
Chris

Hello,
The BW DataSources used in CRM 4.0 for the SAP product are replaced with new DataSources.
Please see the Note 673053 - SAP product: New DataSources in PI_BASIS 2004_1_640
Just for Reference
[Integration of SAP Products in SAP BW|http://help.sap.com/saphelp_nw04/helpdata/en/f8/580f40763f1e07e10000000a1550b0/content.htm]
Thanks
Chandran

What are the tables will update while loading Master data ?

Hello Experts,
What are the tables will update while loading Master data ? And requesting you to provide more information about Master data loading and its related settings in the beginning of creation infoobjects.

It depends upon the type of Master data u r loading....
In all the master data loadings, for every new value of master data an SID will be created in the SID table /BI*/S<INFOOBJECT NAME> irrespective of the type of master data.
But the exceptional tables that get updated depending on the type of master data are.....
If it is a time Independent master data then the /BI*/P<INFOOBJECT NAME> table gets updated with the loaded data.
If it is a time dependent master data then the /BI*/Q<INFOOBJECT NAME> table gets updated with the loaded data.
If the master data is of time Independent Navigational attributes then for every data load the SID table will get updated first and then the /BI*/X<INFOOBJECT NAME> table gets updated with the SID's created in the SID table (NOT WITH THE MASTER DATA).
If the master data is of time dependent navigational attributes then for every data load the SID table will get updated first and then the /BI*/Y<INFOOBJECT NAME> table gets updated with the SID's created in the SID table (NOT WITH THE MASTER DATA).
NOTE: As said above, For all the data in P, Q, T, X, Y tables the SID's will be created in the S table /BI*/S<INFOOBJECT NAME>
NOTE: Irrespective of the time dependency or Independency the VIEW /BI*/M<INFOOBJECT NAME> defined on the top of /BI*/P<INFOOBJECT NAME> & /BI*/Q<INFOOBJECT NAME> tables gives the view of entire master data.
NOTE: it is just a View and it is not a Table. So it will not have any physical storage of data.
All the above tables are for ATTRIBUTES
But when it comes to TEXTS, irrespective of the Time dependency or Independency, the /BI*/T<INFOOBJECT NAME> table gets updated (and of course the S table also).
Naming Convention: /BIC/*<InfoObject Name> or /BI0/*<InfoObject Name>
C = Customer Defined Characteristic
0 = Standard or SAP defined Characteristic
* = P, Q, T, X,Y, S (depending on the above said conditions)
Thanks & regards
Sasidhar

Loading Master Data from a Flat File

Hi Guru, I have flat files of different SAP tables (Transactional data tables and Master Data ), I want to upload this flat files to a DSO, my question is in the case of Master Data Files example SAP table USR03 ( User Address Data) in a Flat file format which is better to create a Master data text and attributes Datasource or create it as a transactional data Datasource to upload it to a DSO.

Hi
Master data datasource should be used to load master data like customer details. customer data is the master data which does not change frequently. customer infoobject may have some attributes like customer name, customer contact number, customer address, etc. we have to maintain these attributes and text data.
Transaction data is something which keeps changing very frequently like price of the material, sales, etc. for loading such data we go for transaction datasources.
As mentioned above too,the changes in the address are very rare, therefore youshould not use transactional datasource.
Regards, Rahul
Edited by: Rahul Pant on Feb 7, 2011 12:24 PM

Error while loading master data to attribute ZMAJORGU(Major organisational unit)

Hi Experts,
While loading master data to ZMAJORGU(MOU)(info object texts) from datasource (ZOS_HRP1000)datasource iam getting error in DTP.
below is the error...
Diagnosis
    Data record 349 & with the key 'Ship &' is invalid in value 'Ship &' of
    the attribute/characteristic ZMAJORGU &.
System Response
    The system has recognized that the value mentioned above is invalid, and
    has processed this general error message. A subsequent message may give
    you more information on the error. This message refers to the same
    value, even though it does not state this explicitly.
Procedure
    If this message appears during a data load, maintain the attribute in
    the PSA maintenance screens. If this message appears in the master data
    maintenance screens, leave the transaction and call it again. This
    allows you to maintain your master data.
Please find the below screen shots
I have done the following regarding the issue ....Looking at the error i have gone trough the transformation and i didnt find any routines or formuales
I have checked the PSA and down loaded the data to spread sheet and put a filter on SHORT and STEXT assuming i will find the value
'Ship &' as mentioned in the Diagnosis description. However i was not able to find the relavent data(i went to se16 gave teh request ID from PSA and displayed the entire data)tarting with Ship .The closest value i could find in both the fileds was was AVP Shipment .
I have the following questions
1)In the screen short 2 it says record number 349 is it right to go to PSA table and check against the record number 349(i tried that but i was not able to find the error against that record)
2)why am i not finding the value 'Ship' in PSA ...but this is the value wich is creating a poblem in updating to the target ....does it mean the record value is Ship or it starts with Ship or is ir part of some word?
Please find the attached PSA data file (u have to convert it to Excel)
I request people to help me analyse the issue and fix the issue.
Regards
Kiran

Ram
I checked other records as well they were a lot of smallcharecters upper case charectres ,numeric special charecters .but nothing stopped ...when the system is even accpeting all other charectres like smallof caps or numeric... why on this record is creating an issue...
please have a look at error stack
and i have one more question when i look at PSA there are close to 300000 records
but when i do an SE16 with request id i see only close to one lakh records (i came to conclusion b dragging down and the last record number was (below screen shot)
Can you tell me what my mistake is numebr or records are not tallying in SE16 and PSA..

Lock NOT set for: Loading master data attributes error

Hi experts,
We were encountering this error before when trying to load master data. When we checked the system we could not find any locks at the time, and activation or kicking off the attribute change run failed again. We finally solved the problem running FM RSDDS_AGGR_MOD_CLOSE which sets the close flag to 'X' in table RSDDAGGRMODSTATE. I have read that it is possible this lock error happens when two change runs happen at the same time.
My question are:
1. is it possible to find out what process exactly "caused" the lock? the table RSDDAGGRMODSTATE does not have a reference to any object or job. I am curious as we are trying to find ways to avoid this in the future...
2. in our case, when we could not find any locks, is running this fm the only work around? is this a best practice?
mark
Message was edited by:
Mark Siongco
Message was edited by:
Mark Siongco

Hello Catherine
I have had this problem in the past (3.0B) --> the reason is that our system was too slow and could not crunch the data fast enough, therefore packets where loacking each other.
The fix: load the data into the PSA only, and then send it in background from the PSA to the info object. By doing this, only a background process will run, therefore locks cannot happen.
Fix#2: by a faster server (by faster, I mean more CPU power)
Now, maybe you have another issue with NW2004s, this was only my 2 cents quick thought
Good luck!
Ioan

Error while loading Master Data - BPC 10.0 NW

Hello gurus,
I am trying to load master data from a BW InfoObject to a dimension in BPC, but am getting the error as shown below:
The transformation and conversion files are configured as shown below:
I would greatly appreciate if you can help me troubleshoot the issue with the java script command. Thanks in advance for your help.
Best regards,
Vijay

Hello Vijay,
Which Patch are you using for EPM add in.
It seems that js:%external%.replace("#","_") does not work with some patches
so in that case you have to use js:%external%.toString().replace("#","_") in your conversion file.
Deepesh

Error while loading master data.

I am facing error while loading master data in a infoobject.
The error comes when I run DTP fo rloading data from PSA to infoobject.
The error wordings are : "MCK_PRDT1 : Data record 1 ('Bleach '): Version 'Bleach ' is not valid"
Please help me in understanding this Version errror and suggest a solution for this.

SAP metodology integration MDM & BW you can look at:
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/b0f1f135-0015-2b10-5e83-acca118e17aa
You can turn matching strategy in MDM Data manager for delete dublicate of records
and then use MDM Syndicator for export data to file and then load that file to BW
If you use OHD you cannot load from BW to MDM repository 10 records and unload only 5 because
in BW every record has unique key.
also you can use MDM ABAP or Java API for delete dublicate of records
Edited by: Kanstantsin Chernichenka on May 8, 2009 1:02 PM

Error 194 while loading Master Data.

Hi,
I've a custom Info Object which has 0MATERIAL as an attribute. While trying to load master data to this custom info object using DBConnect , I'm getting the error:
RSDMD 194
0MATERIAL: Data record 1('0001003') : Version '1009841' is not valid.
I think it's a problem with conversion exit. But I'm not able to solve this problem. It would be of great help if you could guide me on how to overcome this.
Thanks in advance.
Regards
Hari

Hari,
I'm thinking for DB Connected datasources we have Propose Tab Page and Fileds Tab Page. In the Propose tab Page you can see data type and Format(internal or External or check). select external, put data type of your Material Infoobject Data type in the Propose Tab Page.
all the best.
Note: I'm thinking DB Connected Datasources got Propose Tab page. Please correct me if i'm wrong.
Regards,
Nagesh Ganisetti.
*Assign Points if it helps

BI 7.0 - Duplicate Record Error while loading master data

I am working on BI 7.0 and I am trying to load master data to an info object.
I created an Infopackage and loaded into PSA.
I created transformation and DTP and I get an error after I execute the DTP about duplicate records.
I have read all previous threads about duplicate record error while loading master data and most of the them suggested to check 'Ignore duplicate records' option in the infopackage. But in 7.0, I can only load to PSA with infopackage and it doesn't have any option for me to ignore duplicate records.
My data is getting loaded to PSA fine and I get this error while loading to info object using DTP.
I would appreciate your help to resolve this issue.
Regards,
Ram.

Hi,
Refer:
http://help.sap.com/saphelp_nw2004s/helpdata/en/45/2a8430131e03c3e10000000a1553f6/frameset.htm
http://help.sap.com/saphelp_nw2004s/helpdata/en/d0/538f3b294a7f2de10000000a11402f/frameset.htm
With rgds,
Anil Kumar Sharma .P

Loading master data in BI production

Similar Messages

Maybe you are looking for