Best Practices for Loading Master Data via a Process Chain

Currently, we load attributes, text, and hierarchies before loading the transactional data. We have one meta chain. To load the master data it is taking more than 2 hours. Most of the master data is full loads. We've noticed that a lot of the master data, especially text, has not changed or changed very little since we implemented 18 months ago. Is there a precedence or best practice to follow such as do we remove these processes from the chain? If so, how often should it be run? We would really like to reduce the amount of the master data loading time. Is there any documentation that I can refer to? What are other organizations doing to reduce the amount of time to load master data?
Thanks!
Debby

Hi Debby,
I assume you're loading Master Data from a BI system? The forum here are related to SAP NetWeaver MDM, so maybe you should ask this question in a BI forum?
Nevertheless, if your data isn't changed this much, maybe you could use a delta mechanism for extraction? This would send only the changed records and not all the unchanged all the time. But this depends on your master data and of course on your extractors.
Cheers
Michael

Similar Messages

Best practices for loading apo planning book data to cube for reporting

Hi,
I would like to know whether there are any Best practices for loading apo planning book data to cube for reporting.
I have seen 2 types of Design:
1) The Planning Book Extractor data is Loaded first to the APO BW system within a Cube, and then get transferred to the Actual BW system. Reports are run from the Actual BW system cube.
2) The Planning Book Extractor data is loaded directly to a cube within the Actual BW system.
We do these data loads during evening hours once in a day.
Rgds
Gk

Hi GK,
What I have normally seen is:
1) Data would be extracted from APO Planning Area to APO Cube (FOR BACKUP purpose). Weekly or monthly, depending on how much data change you expect, or how critical it is for business. Backups are mostly monthly for DP.
2) Data extracted from APO planning area directly to DSO of staging layer in BW, and then to BW cubes, for reporting.
For DP monthly, SNP daily
You can also use the option 1 that you mentioned below. In this case, the APO cube is the backup cube, while the BW cube is the one that you could use for reporting, and this BW cube gets data from APO cube.
Benefit in this case is that we have to extract data from Planning Area only once. So, planning area is available for jobs/users for more time. However, backup and reporting extraction are getting mixed in this case, so issues in the flow could impact both the backup and the reporting. We have used this scenario recently, and yet to see the full impact.
Thanks - Pawan

BPC:NW - Best practices to load Transaction data from ECC to BW

I have a very basic question for loading GL transaction data into BPC for variety of purposes, would be great if you can point me towards best practices/standard ways of making such interfaces.
1. For Planning
When we are doing the planning for cost center expenses and need to make variance reports against the budgets, what would be the source Infocube/DSO for loading the data from ECC via BW, if the application is -
YTD entry mode:
Periodic entry mode:
What difference it makes to use 0FI_GL_12 data source or using 0FIGL_C10 cube or 0FLGL_O14 or 0FIGL_D40 DSOs.
Based on the data entry mode of planning application, what is the best way to make use of 0balance or debit_credit key figures on the BI side.
2. For consolidation:
Since we need to have trading partner, what are the best practices for loading the actual data from ECC.
What are the typical mappings to be maintained for movement type with flow dimensions.
I have seen multiple threads with different responses but I am looking for the best practices and what scenarios you are using to load such transactions from OLTP system. I will really appreciate if you can provide some functional insight in such scenarios.
Thanks in advance.
-SM

For - planning , please take a look at SAP Extended Financial Planning rapid-deployment solution: G/L Financial Planning module. This RDS captures best practice integration from BPC 10 NW to SAP G/L. This RDS (including content and documentation) is free to licensed customers of SAP BPC. This RDS leverages the 0FIGL_C10 cube mentioned above.
https://service.sap.com/public/rds-epm-planning
For consolidation, please take a look at SAP Financial Close & Disclosure Management rapid-deployment solution. This RDS captures best practice integration from BPC 10 NW to SAP G/L. This RDS (including content and documentation) is also free to licensed customers of SAP BPC.
https://service.sap.com/public/rds-epm-fcdm
Note: You will require an SAP ServiceMarketplace ID (S-ID) to download the underlying SAP RDS content and documentation.
The documentation of RDS will discuss the how/why of best practice integration. You can also contact me direct at [email protected] for consultation.
We are also in the process of rolling out the updated 2015 free training on these two RDS. Please register at this link and you will be sent an invite.
https://www.surveymonkey.com/s/878J92K
If the link is inactive at some point after this post, please contact [email protected]

What are the steps for loading master data

Hello
what are the steps for loading master data? i want to learn about loading all master data and the steps to choose the best way to load the data.
if anyone has documents please send me the documents i will be really greatful
[email protected] thanks everyone
Evion

Hi Heng,
Download the data into a CSV file.
Write a program using GUI_UPLOAD to upload the CSV file and insert records.Chk the below link for example
http://www.sap-img.com/abap/vendor-master-upload-program.htm
Reward Points for the useful solutions.
Regards,
Harini.S

Best practice for putting binary data on the NMR

Hi,
We're creating a component that will consume messages off the NMR, encode them, and subsequently put them back on the NMR. What's the best practice for sending binary data over the NMR?
1. setContent()?
2. addAttachment()?
3. setProperty()?
If NormailzedMessage.setContent() is the desired approach, then how can you accomplish that?
Thanks,
Bruce

setContent() is used only for XML messages. The recommended way to accommodate binary data is to use addAttachment().

DTP error: Lock NOT set for: Loading master data attributes

Hi,
I have a custom datasource from ECC which loads into 0CUST_SALES. I'm using DTP & transformation which has worked for loading data in the past for this infoobject. The infopackage loads with a green status but when i try to load data, the DTP fails with an error message at "Updating attributes for InfoObject 0CUST_SALES Processing Terminated" & the job log says: "Lock NOT set for: Loading master data attributes". I've tried reactivating everything but it didn't help. Does anyone know what this error means? We're on SP7. Thanks in advance!

Hello Catherine
I have had this problem in the past (3.0B) --> the reason is that our system was too slow and could not crunch the data fast enough, therefore packets where loacking each other.
The fix: load the data into the PSA only, and then send it in background from the PSA to the info object. By doing this, only a background process will run, therefore locks cannot happen.
Fix#2: by a faster server (by faster, I mean more CPU power)
Now, maybe you have another issue with NW2004s, this was only my 2 cents quick thought
Good luck!
Ioan

Lock NOT set for: Loading master data attributes error

Hi experts,
We were encountering this error before when trying to load master data. When we checked the system we could not find any locks at the time, and activation or kicking off the attribute change run failed again. We finally solved the problem running FM RSDDS_AGGR_MOD_CLOSE which sets the close flag to 'X' in table RSDDAGGRMODSTATE. I have read that it is possible this lock error happens when two change runs happen at the same time.
My question are:
1. is it possible to find out what process exactly "caused" the lock? the table RSDDAGGRMODSTATE does not have a reference to any object or job. I am curious as we are trying to find ways to avoid this in the future...
2. in our case, when we could not find any locks, is running this fm the only work around? is this a best practice?
mark
Message was edited by:
Mark Siongco
Message was edited by:
Mark Siongco

Hello Catherine
I have had this problem in the past (3.0B) --> the reason is that our system was too slow and could not crunch the data fast enough, therefore packets where loacking each other.
The fix: load the data into the PSA only, and then send it in background from the PSA to the info object. By doing this, only a background process will run, therefore locks cannot happen.
Fix#2: by a faster server (by faster, I mean more CPU power)
Now, maybe you have another issue with NW2004s, this was only my 2 cents quick thought
Good luck!
Ioan

Best Practice for disparately sized data

2 questions in about 20 minutes!
We have a cache, which holds approx 80K objects, which expired after 24 hours. It's a rolling population, so the number of objects is fairly static. We're over a 64 node cluster, high units set, giving ample space. But.....the data has a wide size range, from a few bytes, to 30Mb, and everywhere in between. This causes some very hot nodes.
Is there a best practice for handling a wide range of object size in a single cache, or can we do anything on input to spread the load more evenly?
Or does none of this make any sense at all?
Cheers
A

Angel 1058 wrote:
2 questions in about 20 minutes!
We have a cache, which holds approx 80K objects, which expired after 24 hours. It's a rolling population, so the number of objects is fairly static. We're over a 64 node cluster, high units set, giving ample space. But.....the data has a wide size range, from a few bytes, to 30Mb, and everywhere in between. This causes some very hot nodes.
Is there a best practice for handling a wide range of object size in a single cache, or can we do anything on input to spread the load more evenly?
Or does none of this make any sense at all?
Cheers
AHi A,
It depends... if there is a relationship between keys and sizes, e.g. if this or that part of the key means that the size of the value will be big, then you can implement a key partitioning strategy possibly together with keyassociation on the key in a way that it will evenly spread the large entries across the partitions (and have enough partitions).
Unfortunately you would likely not get a totally even distribution across nodes because of having fairly small amount of entries compared to the square of the number of nodes (btw, which version of Coherence are you using?)...
Best regards,
Robert

What is the best practice for creating master pages and styles with translated text?

I format translated text all the time for my company. I want to create a set of master pages and styles for each language and then import those styles into future translated documents. That way, the formatting can be done quickly and easily.
What are the best practices for doing this? As a company this has been tried in the past, but without success. I'd like to know what other people are doing in this regard.
Thank you!

I create a master template that is usually void of content, with the exception I define as many of the paragraph styles I believe can/will be used with examples of their use in the body of the document--a style guide for that client. When beginning a new document for that client, I import those styles from the paragraph styles panel.
Exception to this is when in a rush I begin documentation first, then begin new work. Then in the new work, I still pull in those defined paragraph and or object styles via their panels into the new work.
There are times I need new styles. If they have broader applicability than a one-off instance or publication, then I open the style template for that client and import that style(s) from the publication containing the new style(s) and create example paragraphs and usage instructions.
Take care, Mike

Best Practice for Using Static Data in PDPs or Project Plan

Hi There,
I want to make custom reports using PDPs & Project Plan data.
What is the Best Practice for using "Static/Random Data" (which is not available in MS Project 2013 columns) in PDPs & MS Project 2013?
Should I add that data in Custom Field (in MS Project 2013) or make PDPs?
Thanks,
EPM Consultant
Noman Sohail

Hi Dale,
I have a Project Level custom field "Supervisor Name" that is used for Project Information.
For the purpose of viewing that "Project Level custom field Data" in
Project views , I have made Task Level custom field
"SupName" and used Formula:
[SupName] = [Supervisor Name]
That shows Supervisor Name in Schedule.aspx
============
Question: I want that Project Level custom field "Supervisor Name" in
My Work views (Tasks.aspx).
The field is enabled in Task.aspx BUT Data is not present / blank column.
How can I get the data in "My Work views" ?
Noman Sohail

Best practices for loading swf's

Greetings,
Using CS5 AS2
I'm creating a website in flash (all the files will be in one directory/folder on SharePoint) and want to make sure that what seems to be working fine is best practice.
I have an index.swf with many buttons which will take the user to landing pages/content/other swfs. On these different buttons I have the script...
on (release) {loadMovieNum("name.swf", 0);} I could also do just {loadMovie("name.swf", 0);} ??
The movie transitions nicely to name.swf and on this page I have a button that returns the user to the index.swf...
on (release) {loadMovieNum("index.swf", 0);} Things move back to index.swf nicely and user can chose to go to another landing page.
It looks like I'm on the right track, bc nothing is going awry? but want to check. Am I following best practices for moving from one swf to another within a website?
Thanks for help or confirmation!!

loading into _level0 (and you should use loadMovieNum, not loadMovie, when loading into a level) undermines some of the benefits of a flash application: all the assets must load with each display change and the user sees a flash instead of appearing to transition seamlessly from one display to the next.

Best practice for retraction of data from BPC 10.0 to General Ledger

Hi All,
I have the requirement to retract data from BPC 10.0 to General Ledger.
What is the best practice for doing this?
I have read the "How To... Retract data from BPC 7.5 NetWeaver to SAP ERP Cost Center Accounting, Part I", but this is prepared to transfer data to Cost Center accounting. Will General Ledger be populated automatically?
What is your opinion on this?
Best regards,
JA

Hi Rich,
In BPC 10 NW, the data entered in Input Forms has to be retracted to ECC.
For this retraction we are following below link.
http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/c029accf-6d95-2d10-79aa-cc291180bf73?QuickLink=index&overridelayout=true&59180354379512
In this document, I am unable to get the details of class ZCL_BPC_RTRCT_SUPERCLASS.
as it is Z class, i am unable to create in my system.
could you please help me.

Best practices for submitting CF data to an AJAX page?

Hi everyone,
I've got a project I'm working on for work and have hit a
little problem.
I am extracting data from my database and then after each
piece of data (just numbers, usually 10 chunks of numbers), I tack
a "|" onto the end of each number. Then, I output the data to the
page. Back on my AJAX enabled page, I get the "responseText" from
that page, and then split it up using javascript and the
pre-inserted "|".
This seems to work fine, but it is quite a bit more messy.
Also, It would really, really be nice to be able to do sorting and
various other operations on the data with javascript instead of
having to rely on CF's icky code logic.
Can someone please enlighten me as to best practices for this
type of thing? I get the suspicion that I'll probably be using XML
somehow, but I'd your opinion.
Thanks!

Check out the Samples and Documentation portions of Adobe's
Spry website for client side use of JSON with Spry.
http://labs.adobe.com/technologies/spry/home.html
Here is link to Adobe's Spry Forums:
http://www.adobe.com/cfusion/webforums/forum/categories.cfm?forumid=72&catid=602
If you are using CF8 you can use the SerializeJSON function
to convert a variable to JSON. You might also be interested in the
cfsprydataset tag. CF 8 documentation:
http://livedocs.adobe.com/coldfusion/8/htmldocs/
If you are using a previous version of CF there is 3rd party
JSON support. You can find links at
http://json.org.

Loading master data via process chain

hi experts,
I have to load data in infoObject via process chain, my infopackage has update mode as full update. Now my question is do I have to delete the previously added data from infoObject and then run this full update infopackage in process chain or system will only fetch the newly added records from source.
regards,
ray

You can not delete the data from master data once the transcational data is posted against the master data value. Attribute value can be deleted, but you can not delete the value of the main characteristics from master data table.
Moreover, you dont need to delete the data when loading master data. Master data always overwritten with the new reocrds.
As described, first load the full load and then on daily basis you can load the delta.
DO NOT FOGET TO SCHEDULE ATTRIBUTE CHANGE RUN to activate the newly loaded data into master data.
Make sure that your master data is not enhanced, otherwise any change in the enhanced field will not generate delta record. If this is the case, then load in full mode everyday.
- Danny

Best practice for loading config params for web services in BEA

Hello all.
I have deployed a web service using a java class as back end.
I want to read in config values (like init-params for servlets in web.xml). What
is the best practice for doing this in BEA framework? I am not sure how to use
the web.xml file in WAR file since I do not know how the name of the underlying
servlet.
Any useful pointers will be very much appreciated.
Thank you.

It doesnt matter whether the service is invoked as part of your larger process or not, if it is performing any business critical operation then it should be secured.
The idea of SOA / designing services is to have the services available so that it can be orchestrated as part of any other business process.
Today you may have secured your parent services and tomorrow you could come up with a new service which may use one of the existing lower level services.
If all the services are in one Application server you can make the configuration/development environment lot easier by securing them using the Gateway.
Typical probelm with any gateway architecture is that the service is available without any security enforcement when accessed directly.
You can enforce rules at your network layer to allow access to the App server only from Gateway.
When you have the liberty to use OWSM or any other WS-Security products, i would stay away from any extensions. Two things to consider
The next BPEL developer in your project may not be aware of Security extensions
Centralizing Security enforcement will make your development and security operations as loosely coupled and addresses scalability.
Thanks
Ram

Best Practices for Loading Master Data via a Process Chain

Similar Messages

Maybe you are looking for