How to handle heavy load caused by master data in XI

Hi all,
We have a situation where masterdata has to be send through XI. As you all would agree, the initial load for master data (done through the BD10,12,14 etc) is heavy. Even though we have low priority queues defined in our XI server for master data, our servers performance is getting affected heavily. Any suggestion to improve the situation would be highly appreciated.
Thanks in advance
cheers
danus

Hi Danus,
We manage this on the R/3 side. Schedule multiple jobs to run BD10 at spaced intervals of time with different variants. For example:
10:00 - Materials 1 - 10000
10:15 - Materials 10001 - 20000
10:30 - Materials 20001 - 30000
Thanks,
J Wolff

Similar Messages

What r the ways to reduce the load time of master data

Hi
The full load of the master data load IP is taking 18hr to 2 days loading on average 2516360 Records
Is their any option to reduce load time as its causing data base lock and impacting transports(other than data selection)
Thanks in advance
Anuj

You will have to do some research. What MD extractor are you talking about?
Test on R/3 system: First try to extract a considerable amount of records via transaction RSA3 in R/3 (10.000 or 100.000). Keep the time that it takes.
Extract the same into BW but only into PSA. Again measure the time.
Load data from PSA into datatarget and see how long this takes. You should now have a picture on where the performance problems are located.
Is the performance also bad for small loads or is there a boundary before which performance is ok. (in other words, is loading 200.000 records ten times longer then loading 20.000 records?)
Suspect the following in R/3:
- datasource enhancements in R/3. A redesign may improve your extraction in a big way.
- missing indexes. If you are extracting data from tables without proper indexes the extraction performance can be dramatic.
Suspect the following if loading to PSA is bad:
- Datapackage reads data in small chunks (much smaller than 50000 records). Overhead causes more time than the actual data transport.
- Network problems. Maybe the network is congested by other servers?
If loading from PSA to datatarget is slow:
- Check start routines for performance.
- Are enough batch partitions available? Sometimes activation of ODS can be improved by more parallel processes.
- Are you using a lot masterdata-lookups when filling the datatargets?
When you report you findings in this forum we may be able to help you further.

Transactional Data Load without Respective Master Data in Place

Hi Folks,
Could anyone let me know if i could load transactional data without loading the respective master data. If yes, well could you give me a scenario when you do it. Also could you let me know the option of how to load transactional data without master data in place.
Best Regards,
Prithvi

Hi,
You can load transaction data without loading master data.
You have the option in the info package to load data even if no master data exists..
You may use it in cases where your transfer rules/update rules or routines donot refer to master data tables to populate transaction data..
Ashish

Load Failure for Master Data object

Dear Sdns,
                    Am doing daily master data loading for VENODR_ATTR master data object.... Am loading it through DELTA Update.... I got an error in Status Tab.
rror message from the source system
Diagnosis
An error occurred in the source system.
System response
Caller 09 contains an error message.
Further analysis:
The error occurred in Service API .
Refer to the error message.
Procedure
How you remove the error depends on the error message.
Note
If the source system is a Client Workstation, then it is possible that the file that you wanted to load was being edited at the time of the data request. Make sure that the file is in the specified directory, that it is not being processed at the moment, and restart the request.
The Error Message is : - Update mode R is not supported by the extraction API.The application program for the extraction of the data was called using
update mode R . However, this is not supported by the InfoSource.
Kindly Help me if any of the Snd people might have face this kind of problem...
Answering Getz Appreciated,
Warm Regards,
Aluri

Hi Aluri,
The file might be used or being edited by some other person when you are doing the delta.
CHeck the source system connection @ AWB.activate it.
Follow these steps
1. Activate transfer rules for data source in source system.
2. Activate the ODS
3. Activate the update rules (ods to ods and also ods to cube)
5. Right-click at the ODS, choose 'Generate Export Data Source'
6. Replicate the data source
7.se38---->RS_TRANSTRU_ACTIVATE_ALL for source system .
Then start data loading again.
Hope this helps.
Assign points if useful.
Thanks & Regards,
Bindu

How to change specified hierachy node to master data attribute automatic?

Dear BW experts:
How to change specified hierachy node to master data attribute automatically? I have a retail business: I have a fixed material group hierachy in R3 Retail ,Now I will extract the material group hierachy ,my goal is that the specified material group hierachy node as dimension in query ,not show hierachy level,So I need change specified material group hierachy node to material group's attribute.
Anybody solve the requests?
Thank you for your help in advance !

If I understand your requirement correctly, you need to have a specific Material Group Hierarchy level (Say Level 2) to be an attribute of Material Group. Usually, this level represents a Brand or Segment, or something with specific meaning.
If this is correct, here are the things you need to do:
1) Create an InfoOnject for this specific attribute representing the specified hierarchy level
2) Add this InfoObject to Material Group as an navigational attribute
3) Select this navigational attribute in your InfoProvider
4) Create a transformation routine for this navigational attribute in Material Group Transformation so that the specified hierarchy level for Material Group will be found and populated. The detail of this routine will depend on your specific requirement. Also, you have to make sure Material Group Hierarchy is updated before Material Group attributes are loaded. If you are not family with ABAP, please ask an ABAPer to help you for the Transformation Routine.
5) Include this navigational attribute in your query along with other required InfoObjects.
Hope this help and good luck!
Bill

Load customer text master data error

Hi Experts:
When load customer text master data ,system show the following error message ,could you please
help me to solve the problem , thanks a lot
Error message from the source system
Diagnosis
An error occurred in the source system.
System Response
Caller 09 contains an error message.
Further analysis:
The error occurred in Extractor .
Refer to the error message.
Procedure
How you remove the error depends on the error message.
Note
If the source system is a Client Workstation, then it is possible that the file that you wanted to load was being edited at the time of the data request. Make sure that the file is in the specified directory, that it is not being processed at the moment, and restart the request.

Delete PSA request from Datasource -> manage
Do a fresh load and Goto to infopackage monitor
Environment --> Short Dump --> in Source System...... Click 'TODAY'
Next screen would show u all Runtime Error... Double click on the first one
from the next screen, u can do analysis by double clicking 'What Happend ?', What can u do? Error Analysis..
By doing this U can find out what exactly is the problem

GETWA_NOT_ASSIGNED short dump when load business partner master data

Hi
I've this error GETWA_NOT_ASSIGNED short dump when load business partner master data, it's running in BI 7.0 with support package 12.
The error is because the field symbol is that pointed to the line of an internal table that was deleted.
I think that it's an incompatibility between subroutine and unicode.
Do you have idea about correct this error?
Regards
Jose.

Hi Ravi
Yes, it's a dump
It's when running a process chain to load Business partner master data
The error say:
-.You address a field symbol that pointed to the line of an internal table that was deleted.
-.You address a field symbol that was previously reset using UNASSIGN or that pointed to a local field that no longer exist.
-. You address a global function interface, although the respective function module is not active - that is, is not in the list of active calls. the list of active calls can be taken from this short dump.
I think that it's for the unicode corversion because I've the last support package 12 installed and the rest of the process chain are running perfect.
My hotmail mail is [email protected] if you need the screen shot.
Regards and thanks a lot
Jose

Parallel load of InfoProvider master Data

Hi, I have a Master Data object configured as an infoprovider. I am trying to load the object from 2 different sources in parallel in my process chain. This seemed to work in my dev environement, but one of the loads is failing because of master data lock.
There are no duplicate characteristics between the 2 sources so no conflicts exist there. Is it just that I cannot load 2 sources into the master data infoprovider at the same time?
ThankS!

Hi Kenneth,
On the following (parallel) processes lock situations can occur:
- Hierarchy and attribute change runs is locking temporarily parts of a BW system
- Loading master data for the same InfoObject (risk when loading in parallel master data out of several source systems)
( Can be avoided (if wanted) by applying note 421419)
- Rolling up data of the same InfoCube
- Selective deletion on InfoCube and parallel loading
- Activation or deletion of ODS object data and loading it
Best regards,
Eugene

Loading time-dependent master data using update rules/transformations

Hi
I am trying to load time-dependent master data to an infoobject. It seems that I get an error message on duplicate records if I use a transformation or update rule. Does this only work with direct update ?

In the DTP you have the option to ignore duplicate records....
Just select that and then load data...

Please specify Transaction code to load SCM ROUTE MASTER DATA (EWM Routes)

Please specify Transaction code to load SCM ROUTE MASTER DATA (EWM Routes data).
Regards
Dhirendra
Moderator message - Moved to correct forum
Edited by: Rob Burbank on Apr 21, 2009 8:58 AM

Route definition is done at 0VTC. You have define the Route with its description, Transit time, factory calender, carrier info etc. It is stored in TVRO table
Then yoiu will maintain the route determination in 0VRF.
Route Determination:
Dep zone of the shipping point + Destination zone (T-zone) of the ship-to + Transportation group + shipping conditions.
Route determination details are stored in TROLZ table.

How to automate handling of dimension members? (master data loads)

Hi,
We want our users to be able to upload master data (i.e. dimension member data) from a flat file. It is only possible to upload transactional data from a flat file via the Data Manager...
Any suggestions?
Thanks,
Peter

Hi Peter,
1. use BULK INSERT to load the flat file into SQL SERVER and automate using the SQL job or Windows schedule job. Then call the AdminTask_MakeDim package in DM. This is also be scheduled in BPC DM.
You can also use SSIS packages to load flat file data into the SQL SERVER table.
2. SSIS packages are not complex, you should know to use it. Basically have learnt using these SSIS packages after started working in BPC Datamanager. You can find various online tutorials on SSIS packages.
Flow of data should be:
Flat file - staging table in BPC database - copy from staging tbale to mbr<dimension> table - Admintask to process Dimension.
The structure of staging table should be identical with mbr<dimension> table or mbr<dimension> table should be a subset of Staging table.
To schedule the BPC - DM packages:
Open the eDATA menu - 'Run Package' window. You have a option of 'New automation', use that to create schedules on SSIS packages (can be used for both BPC standard packages and customized packages).
hope it helps.
Hi Sam,
You can try by VBA into EXCEL, prepare the dimension member sheet and process. Basically it depends on our knowledge / ease on technology .
I never had a chance to try on this. By visualising, this is possible but ensure on the data type loading into the EXCEL.
example, CompCode is 0310, while loading into EXCEL load as 310... omit the 0 in the front.
Try and share with us how it works.
Cheers
Uma

How to handle SQL loader in stream,

Hi friends,
ANy experience to handle SQL*loader in stream? How to handel space and mamory for SQL*Loader Direct path loading?
we have a bi_direction stream. how to load huge data into stream without brokken stream system?
Thanks for your help!!
Jim

see also note
Note:222769.1
I have not use this parameter before in sqlldr.. Do need to do some research..
STREAMSIZE
Specifies the size, in bytes,      250 KB
New parameter introduced in for direct path streams.
Oracle 9i.

How to put heavy load on CPU

Some people report that their machine's whine is gone after putting some heavy load on the CPU for a while.
I don't see my self doing some photoshop for 6 hours, so is there a utility or benchmark tool I could use to put some load on the CPU for a long period of time?
Thanks!

The easiest way that I know would be to open up terminal and type (without the quotes) 'yes > /dev/null'. That will send a never-ending stream of y's to nowhere, and will max out your CPU in doing so.
I'm pretty sure that 'yes' is single-threaded, so it might only max out one of your cores (the redirection might max out the other one), but to be sure, just open up another terminal window and run the same command, so that you have 2 of them going at once.
PowerBook 17", 1.33GHz Mac OS X (10.4.5)

How to upload different views of customer master data using LSMW-IDOC

I need to upload customer master data using LSMW Idoc method for my client. Now customer will have different views like main view, Sales data, Company code data, Partner function data etc. And except main data all other data can be multiple for each customer. We are going to upload data from tab delimited .TXT file. Should I propose different LSMW for upload different views for the customer from different .TXT files? or we can upload all the customer related data (like main view data and partner function data )from a single .TXT file. Kindly suggest which one in convenient and how we can prepare the data file in both cases.

convinient is the method that you can handle.
but as the guy who loads the data you have to load the data like they are available, like it is convinient for others to prepare the data.
In general there is no problem to use an IDOC method to load a customer master with multiple comany codes and several sales orgs in one shot.
the data can be in one source file, but need then to be maintained in a certain way
Example1: all data in 1 structure
GD1 - CC1 - SO1
GD1 - CC2 - SO2
GD1 - CC2 - SO3
in this case the GD (general data) is redundand in each line which has different Company code data or different Sales Org data
Example2: all data in 3 sturcures but one file
GD1
.CC1
.CC2
..SO1
..SO2
..SO3
Example3: data delivered in 3 files - you join the files in LSMW, they must have a common identifier like the old customer number in the beginning of each file
FILE General data:
GD1
GD2
GD3
file Compamy code data:
CC1
CC2
CC3
file Sales org data:
SO1
SO2
SO3
LSMW is flexible and can handle each of this scenarios, are you flexible too?

How to restrict Invalid record in 0Material_Text Master Data

Hi,
In R/3 ,during legacy data loading through Excel file , invalid Material code ( with Balnk spaces ) gives error BW data .It comes upto PSA & gives error Invalid material code. Because there is no field in for deletion Flag in Material_ text . How we can stop the material in BW.
Thanks with Regards,
Anand Mehrotra.

Hi Anand,
First identify the list of invalid materials. If the list is small, say less than 10 or so, you can correct the data is PSA and then load the master data. This will save you from doing any change to the data model.
If there are huge number of records, follow any one of the below steps.
1) Try to edit the data in the Source file (Excel file)
2) Write a code in the Start Routine in the Material transformation, to eliminate the invalid materials.
Regards,
Balaji V

How to handle heavy load caused by master data in XI

Similar Messages

Maybe you are looking for