Procedure to load master data in bw and bi

Hi All,
How load master data and use master data as a reference while loading transaction data

Hello,
Loading Master Data without using the PSA in SAP BI 7.0 :
https://community.altiusconsulting.com/blogs/glenchambers/archive/2008/03/10/loading-master-data-without-using-the-psa-in-sap-bi-7-0.aspx
Data Upload from Flat File to Business Intelligence 7.0 System:
http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/60debae1-84dd-2b10-e7bf-bdedf1eabdf9
To load data from r3 data source , activate it at R3 side.
-- then replicate it in BI.
-- then you will get that data source in BI. Right click it & from pop up menu select appropriate options to create info package, transformation & DTP one by one. (activate each after creation)
-- execute info package. It will fetch data unto PSA.
-- execute DTP. It will load data to target according to mapping done in transformation.
Hope it helps.

Similar Messages

Critical Error in master data: Transffered 250056 and added 0 enhancement

Hi,
First we have loaded master data into 0CUSTOMER and there after enhanced the datasource and mapped the same in transfer rules and update rules.
We loaded data again into master data with full update. But the enhaced fields data is not getting updated. But in PSA data is available.
We deleted the all master data at Maitainence and relaoded data.
Now its showing 250056 as transffered and added as 0
we didnt seen any single record in master data now.
I have actovated data and attributre change also done.
But no success.
Please suggest us what should i do now.
Thnaks &Regards,
Revathi

Hi,
The data is available for the all enhanced fields in PSA.
For the master data Text also data there in infoobject maintainece.
For the enhanced and all the other attributes data is not aviale.
If i load data again with full load also it is Transffered 250056 and added 0
But In data load monitor i obseved one thing ....
in the details tabprocessingdatapavckages--update rules it saying Update rules ( 0 Records ) : No errors.
But for transfer rules istep it is giving message Transfer rules ( 4139 Records ) : No errors .
So till here data is processing...in update rules it is not.
We dont have any routines in update rules. and its one to one mapping.
Please suggest how to get it resolve.
Thanks &Regards,
Revathi

Why we will prefer our own programs to load master data .

Hi gurus ,
What are the techniques involved in using SAP supplied programs
why we will prefer to write our own programs to load master data.
Thanks and Regards :
B.Madhu sudhan reddy
Moderator message - Please ask a specific question - post locked
Edited by: Rob Burbank on Dec 2, 2009 9:20 AM

Hi Madhu,
Sap has already have their own predefined upload programs in LSMW for Master Data .
Techniques To Load Master Data in SAP :
1) BAPI
2) LSMW
3) BDC (Call Transaction & Session Method)
Regards,
Sudhakar Reddy.A

What happens internally while loading master data and transaction?

hello,
What happens internally and which tables are used while loading master data and transaction?
I have loaded the data in DSO, but i am not getting value of particular InfoObject after loading the data.
I have executed Attribute change run also.
Kindly explain ...
Thanks,
Sonu

Hi,
Master data,
Material Indipendent data can be sent without any dependency.
Material Dependent data sequence is as follow.
Plant,
MRP areas,
Supply area,
Material,
MRP area material,
planning material,
ATP check,
Purchase info recards,
schedule agg,
PPM or PDS (But before PPM or PDS work center should send to apo) If PDS is sending then BOM should send before PDS.
Transaction data.
As per the business requirement what is planning in apo.
Regards,
Kishore Reddy.

How to load master data and hierarchies from R/3 systems

HI all,
how to load master data and hierarchies from R/3 systems.
Please explain the steps.
Thanks,
cheta.

HI,
Its normally done following: Transferring the master datasources in RSA5 to RSA6 and then replicating the DS into BW and assignment of DS to Infosource and cretaion of Infopackage and load it into the master tables.
Generally, the control parameters for data transfer from a source system are maintained in extractor
customizing. In extractor customizing, you can access the corresponding source system in the source
system tree of the SAP BW Administrator Workbench by using the context menu.
To display or change the settings for data transfer at source system level, choose Business
Information Warehouse → General Settings → Maintaining Control Parameters for Data Transfer.
Note: The values for the data transfer are not hard limitations. It depends on the DataSource if these
limits can be followed.
In the SAP BW Scheduler, you can determine the control parameters for data transfer for individual
DataSources. You can determine the size of the data packet, the number of parallel processes for
data transfer and the frequency with which the status IDocs are sent, for every possible update
method for a DataSource.
To do so, choose Scheduler → DataSource → Default Settings for Data transfer.
In this way you can, for example, update transaction data in larger data packets in the PSA. If you
want to update master data in dialog mode, smaller packets ensure faster processing.
Hope this info helps.
Thanks,Ramoji.

Can I reuse objects without Master data and load master data into it?

Hai,
I have a standard object that doesnot have Master data. Its already used somewhere else. It matches the name I want but I need to load some master data into it. Does resuing it in my catalogue and loading Master data into it hurt anything? Or should I create a new one?
Thank you.

Hi Visu,
The same InfoObject can be included in more than one InfoObject catalog without any issue. Also loading master data would not hurt an existing InfoProviders where it is being used.
Hope this helps...

Error while loading master data to attribute ZMAJORGU(Major organisational unit)

Hi Experts,
While loading master data to ZMAJORGU(MOU)(info object texts) from datasource (ZOS_HRP1000)datasource iam getting error in DTP.
below is the error...
Diagnosis
    Data record 349 & with the key 'Ship &' is invalid in value 'Ship &' of
    the attribute/characteristic ZMAJORGU &.
System Response
    The system has recognized that the value mentioned above is invalid, and
    has processed this general error message. A subsequent message may give
    you more information on the error. This message refers to the same
    value, even though it does not state this explicitly.
Procedure
    If this message appears during a data load, maintain the attribute in
    the PSA maintenance screens. If this message appears in the master data
    maintenance screens, leave the transaction and call it again. This
    allows you to maintain your master data.
Please find the below screen shots
I have done the following regarding the issue ....Looking at the error i have gone trough the transformation and i didnt find any routines or formuales
I have checked the PSA and down loaded the data to spread sheet and put a filter on SHORT and STEXT assuming i will find the value
'Ship &' as mentioned in the Diagnosis description. However i was not able to find the relavent data(i went to se16 gave teh request ID from PSA and displayed the entire data)tarting with Ship .The closest value i could find in both the fileds was was AVP Shipment .
I have the following questions
1)In the screen short 2 it says record number 349 is it right to go to PSA table and check against the record number 349(i tried that but i was not able to find the error against that record)
2)why am i not finding the value 'Ship' in PSA ...but this is the value wich is creating a poblem in updating to the target ....does it mean the record value is Ship or it starts with Ship or is ir part of some word?
Please find the attached PSA data file (u have to convert it to Excel)
I request people to help me analyse the issue and fix the issue.
Regards
Kiran

Ram
I checked other records as well they were a lot of smallcharecters upper case charectres ,numeric special charecters .but nothing stopped ...when the system is even accpeting all other charectres like smallof caps or numeric... why on this record is creating an issue...
please have a look at error stack
and i have one more question when i look at PSA there are close to 300000 records
but when i do an SE16 with request id i see only close to one lakh records (i came to conclusion b dragging down and the last record number was (below screen shot)
Can you tell me what my mistake is numebr or records are not tallying in SE16 and PSA..

ABAP DUMP while loading master data

hi Gurus,
              I am trying to load master data but I am getting the following dump , I cannot infer anything from the Dump message, I would be grateful if anyone could throw some light on it..
Runtime Errors         SAPSQL_ARRAY_INSERT_DUPREC
Exception              CX_SY_OPEN_SQL_DB
       Occurred on     11/13/2006 at 13:17:57
The ABAP/4 Open SQL array insert results in duplicate database records.
What happened?
Error in ABAP application program.
The current ABAP program "CL_RSDMD_UPDATE_MASTER_DATA===CP " had to be
terminated because one of the
statements could not be executed.
This is probably due to an error in the ABAP program.
What can you do?
Print out the error message (using the "Print" function)
and make a note of the actions and input that caused the
error.
To resolve the problem, contact your SAP system administrator.
You can use transaction ST22 (ABAP Dump Analysis) to view and administer
termination messages, especially those beyond their normal deletion
date.
is especially useful if you want to keep a particular message.
rror analysis
n exception occurred. This exception is dealt with in more detail below
The exception, which is assigned to the class 'CX_SY_OPEN_SQL_DB', was
neither
aught nor passed along using a RAISING clause, in the procedure "_DB_FIRE"
"(METHOD)"
ince the caller of the procedure could not have expected this exception
to occur, the running program was terminated.
he reason for the exception is:
f you use an ABAP/4 Open SQL array insert to insert a record in
he database and that record already exists with the same key,
his results in a termination.
With an ABAP/4 Open SQL single record insert in the same error
ituation, processing does not terminate, but SY-SUBRC is set to 4.)
ow to correct the error
he exception must either be prevented, caught within the procedure "_DB_FIR
(METHOD)", or declared in the procedure's RAISING clause.
o prevent the exception, note the following:
se an ABAP/4 Open SQL array insert only if you are sure that none of
he records passed already exists in the database.
ou may able to find an interim solution to the problem
n the SAP note system. If you have access to the note system yourself,
se the following search criteria:
APSQL_ARRAY_INSERT_DUPREC" CX_SY_OPEN_SQL_DBC
L_RSDMD_UPDATE_MASTER_DATA===CP " or "CL_RSDMD_UPDATE_MASTER_DATA===CM00Y "
DB_FIRE"

one of the response says " In the infopackage set processing as 'Only PSA' and tick the checkboxes for 'Update subsequently in data targets' and 'delete duplicate records'.then try to reload."
I do not find the Delete duplicate records check box in the IP...cananyonepls tell me where to find thid check box?
thanks

Need help in loading master data.

Hi everyone,
I am just a beginner in BI 7.0 . I know Bw 3.5 . I need help in loading master data(flat file) in a step by step manner.
Before posting this forum i searched and checked out other related forums too, as i am a beginner i am unable to follow them. Lots of the forums gave the help.sap.com link which i used and got a little help but not fully, so please don't send that link. I need a step by step guideline from somebody, which says everything from the beginning till monitoring say like
e.g.. 1) create a InfoObject by right clicking on InfoObject catalog.
something like that.
please help me get a clear and detail step by step procedure to load a master data (Flat File should be good) which may help me get a start will other things without much help.
Please help me learn.
Thanks.
Ranjani.

HI,
Thanks for your reply. This is what i did.
1) Created a Info Area.
2) Created Info object catalog & activated
3) created info object with nothing except some 4 attributes.
4) Created Application compound in Infosource tab.
5) Right clicked on Application compound and chose create Infosource in which chose a option with 3.x and chose the flexible update and gave the info object name.
6) In info provider tab , in the Info Area right clicked and chose the Insert char as data target option.
Now, i am stuck. I have no idea what to do next.
I know i have to create a transformation - There are two tabs in Transformation box, what should i do there.
Please help me from point 6 to cont., to load the data.
Thanks.

Loading master data in BI production

Dear Experts,
While loading master data in BI production we are facing error when updating IDOCS.
__MONITOR ADMINISTRATOR WORKBENCH__
STATUS:
ERROR:Error when updating IDOCS in source system.
DIAGNOSIS:Errors have been reported in source system during IDOCS Update
SYSTEM RESPONSE:Some IDOCS have error status
PROCEDURE:
Check the IDOCS in source system.You do this using the extraction monitor.
ERROR:How you ressolve the errors depends on the error message you get.
SO can anyone tell why this type of errors occured? What will be the reason behind this?
Thanks in advance.
Warm Regards,
Bunty.

Hi Bunty,
Your Idoc error is a general error, the first of all will be to know what is the concrete error with the Idoc, for this reason, please do the following checks and let us know the results:
1.-) Execute the tx.code SM58. BD87 and WE05 and give us your feedback, tell us for each tx,.code if some errors are shown.
2.-) Do you display some error if you go to tx.code SM59 - Select RFC Destination "Source system" -> Authorization test?
3.-) Please ensure that your remote user has the correct authorization profiles in both BW and R/3. You need to set your
     profiles for ALEREMOTE as such:
   1) in BW -> the remote user (usually 'ALEREMOTE') must have
       profile 'S_BI-WHM_RFC'
   2) in R/3 -> the remote user (usually 'ALEREMOTE') must have
       profile 'S_BI-WX_RFC'
This is explained in more detail in note 150315.
Also, you must ensure that you have sufficient DIA processes in both your BW and R/3 systems. DIA work processes are necessary for the processing of IDOC's. And if there are not sufficient DIA work processes, the load may hang in status 'yellow'. Note 561880 gives more information about this:
1. Make sure there is always sufficient DIA, that is, at least 1 DIA more than all other work processes altogether, for
      example, 8 DIA for a total of 15 work processes (see also note 74141)."
4.- ) Please identify if the Idocs get hanged in the the source system, and if these Idocs cannot be processed manually in        Tcode SM58 please implement the correction from note 1280898. // I hope it helps you. Best regards. Fran.

What are the tables will update while loading Master data ?

Hello Experts,
What are the tables will update while loading Master data ? And requesting you to provide more information about Master data loading and its related settings in the beginning of creation infoobjects.

It depends upon the type of Master data u r loading....
In all the master data loadings, for every new value of master data an SID will be created in the SID table /BI*/S<INFOOBJECT NAME> irrespective of the type of master data.
But the exceptional tables that get updated depending on the type of master data are.....
If it is a time Independent master data then the /BI*/P<INFOOBJECT NAME> table gets updated with the loaded data.
If it is a time dependent master data then the /BI*/Q<INFOOBJECT NAME> table gets updated with the loaded data.
If the master data is of time Independent Navigational attributes then for every data load the SID table will get updated first and then the /BI*/X<INFOOBJECT NAME> table gets updated with the SID's created in the SID table (NOT WITH THE MASTER DATA).
If the master data is of time dependent navigational attributes then for every data load the SID table will get updated first and then the /BI*/Y<INFOOBJECT NAME> table gets updated with the SID's created in the SID table (NOT WITH THE MASTER DATA).
NOTE: As said above, For all the data in P, Q, T, X, Y tables the SID's will be created in the S table /BI*/S<INFOOBJECT NAME>
NOTE: Irrespective of the time dependency or Independency the VIEW /BI*/M<INFOOBJECT NAME> defined on the top of /BI*/P<INFOOBJECT NAME> & /BI*/Q<INFOOBJECT NAME> tables gives the view of entire master data.
NOTE: it is just a View and it is not a Table. So it will not have any physical storage of data.
All the above tables are for ATTRIBUTES
But when it comes to TEXTS, irrespective of the Time dependency or Independency, the /BI*/T<INFOOBJECT NAME> table gets updated (and of course the S table also).
Naming Convention: /BIC/*<InfoObject Name> or /BI0/*<InfoObject Name>
C = Customer Defined Characteristic
0 = Standard or SAP defined Characteristic
* = P, Q, T, X,Y, S (depending on the above said conditions)
Thanks & regards
Sasidhar

How to write a procedure to load the data into a table using xml file as input to the procedure?

Hi,
Iam new to the xml,
can u please anyone help me how to write procedure to load the data into a table using xml as input parameter to a procedure and xml file is as shown below which is input to me.
<?xml version="1.0"?>
<DiseaseCodes>
<Entity><dcode>0</dcode><ddesc>(I87)Other disorders of veins - postphlebitic syndrome</ddesc><claimid>34543></claimid><reauthflag>0</reauthflag></Entity>
<Entity><dcode>0</dcode><ddesc>(J04)Acute laryngitis and tracheitis</ddesc><claimid>34543></claimid><reauthflag>0</reauthflag></Entity>
<Entity><dcode>0</dcode><ddesc>(J17*)Pneumonia in other diseases - whooping cough</ddesc><claimid>34543></claimid><reauthflag>0</reauthflag></Entity>
</DiseaseCodes>.
Regards,
vikram.

here is the your XML parse in 11g :
select *
from xmltable('//Entity' passing xmltype
'<?xml version="1.0"?>
<DiseaseCodes>
<Entity><dcode>0</dcode><ddesc>(I87)Other disorders of veins - postphlebitic syndrome</ddesc><claimid>34543></claimid><reauthflag>0</reauthflag></Entity>
<Entity><dcode>0</dcode><ddesc>(J04)Acute laryngitis and tracheitis</ddesc><claimid>34543></claimid><reauthflag>0</reauthflag></Entity>
<Entity><dcode>0</dcode><ddesc>(J17*)Pneumonia in other diseases - whooping cough</ddesc><claimid>34543></claimid><reauthflag>0</reauthflag></Entity>
</DiseaseCodes>
') columns
"dcode" varchar2(4000) path '/Entity/dcode',
"ddesc" varchar2(4000) path '/Entity/ddesc',
"reauthflag" varchar2(4000) path '/Entity/reauthflag'
dcode                                                                            ddesc                                                                            reauthflag
0                                                                                (I87)Other disorders of veins - postphlebitic syndrome                           0
0                                                                                (J04)Acute laryngitis and tracheitis                                             0
0                                                                                (J17*)Pneumonia in other diseases - whooping cough                               0
SQL>
Using this parser you can create procedure as
SQL> create or replace procedure myXMLParse(x clob) as
2 begin
3    insert into MyXmlTable
4      select *
5        from xmltable('//Entity' passing xmltype(x) columns "dcode"
6                      varchar2(4000) path '/Entity/dcode',
7                      "ddesc" varchar2(4000) path '/Entity/ddesc',
8                      "reauthflag" varchar2(4000) path '/Entity/reauthflag');
9    commit;
10 end;
11
12 /
Procedure created
SQL>
SQL>
SQL> exec myXMLParse('<?xml version="1.0"?><DiseaseCodes><Entity><dcode>0</dcode><ddesc>(I87)Other disorders of veins - postphlebitic syndrome</ddesc><claimid>34543></claimid><reauthflag>0</reauthflag></Entity><Entity><dcode>0</dcode><ddesc>(J04)Acute laryngitis and tracheitis</ddesc><claimid>34543></claimid><reauthflag>0</reauthflag></Entity><Entity><dcode>0</dcode><ddesc>(J17*)Pneumonia in other diseases - whooping cough</ddesc><claimid>34543></claimid><reauthflag>0</reauthflag></Entity></DiseaseCodes>');
PL/SQL procedure successfully completed
SQL> select * from MYXMLTABLE;
dcode                                                                            ddesc                                                                            reauthflag
0                                                                                (I87)Other disorders of veins - postphlebitic syndrome                           0
0                                                                                (J04)Acute laryngitis and tracheitis                                             0
0                                                                                (J17*)Pneumonia in other diseases - whooping cough                               0
SQL>
SQL>
Ramin Hashimzade

Loading Master Data from a Flat File

Hi Guru, I have flat files of different SAP tables (Transactional data tables and Master Data ), I want to upload this flat files to a DSO, my question is in the case of Master Data Files example SAP table USR03 ( User Address Data) in a Flat file format which is better to create a Master data text and attributes Datasource or create it as a transactional data Datasource to upload it to a DSO.

Hi
Master data datasource should be used to load master data like customer details. customer data is the master data which does not change frequently. customer infoobject may have some attributes like customer name, customer contact number, customer address, etc. we have to maintain these attributes and text data.
Transaction data is something which keeps changing very frequently like price of the material, sales, etc. for loading such data we go for transaction datasources.
As mentioned above too,the changes in the address are very rare, therefore youshould not use transactional datasource.
Regards, Rahul
Edited by: Rahul Pant on Feb 7, 2011 12:24 PM

Lock NOT set for: Loading master data attributes error

Hi experts,
We were encountering this error before when trying to load master data. When we checked the system we could not find any locks at the time, and activation or kicking off the attribute change run failed again. We finally solved the problem running FM RSDDS_AGGR_MOD_CLOSE which sets the close flag to 'X' in table RSDDAGGRMODSTATE. I have read that it is possible this lock error happens when two change runs happen at the same time.
My question are:
1. is it possible to find out what process exactly "caused" the lock? the table RSDDAGGRMODSTATE does not have a reference to any object or job. I am curious as we are trying to find ways to avoid this in the future...
2. in our case, when we could not find any locks, is running this fm the only work around? is this a best practice?
mark
Message was edited by:
Mark Siongco
Message was edited by:
Mark Siongco

Hello Catherine
I have had this problem in the past (3.0B) --> the reason is that our system was too slow and could not crunch the data fast enough, therefore packets where loacking each other.
The fix: load the data into the PSA only, and then send it in background from the PSA to the info object. By doing this, only a background process will run, therefore locks cannot happen.
Fix#2: by a faster server (by faster, I mean more CPU power)
Now, maybe you have another issue with NW2004s, this was only my 2 cents quick thought
Good luck!
Ioan

Error while loading Master Data - BPC 10.0 NW

Hello gurus,
I am trying to load master data from a BW InfoObject to a dimension in BPC, but am getting the error as shown below:
The transformation and conversion files are configured as shown below:
I would greatly appreciate if you can help me troubleshoot the issue with the java script command. Thanks in advance for your help.
Best regards,
Vijay

Hello Vijay,
Which Patch are you using for EPM add in.
It seems that js:%external%.replace("#","_") does not work with some patches
so in that case you have to use js:%external%.toString().replace("#","_") in your conversion file.
Deepesh

Procedure to load master data in bw and bi

Similar Messages

Maybe you are looking for