How to automate handling of dimension members? (master data loads)

Hi,
We want our users to be able to upload master data (i.e. dimension member data) from a flat file. It is only possible to upload transactional data from a flat file via the Data Manager...
Any suggestions?
Thanks,
Peter

Hi Peter,
1. use BULK INSERT to load the flat file into SQL SERVER and automate using the SQL job or Windows schedule job. Then call the AdminTask_MakeDim package in DM. This is also be scheduled in BPC DM.
You can also use SSIS packages to load flat file data into the SQL SERVER table.
2. SSIS packages are not complex, you should know to use it. Basically have learnt using these SSIS packages after started working in BPC Datamanager. You can find various online tutorials on SSIS packages.
Flow of data should be:
Flat file - staging table in BPC database - copy from staging tbale to mbr<dimension> table - Admintask to process Dimension.
The structure of staging table should be identical with mbr<dimension> table or mbr<dimension> table should be a subset of Staging table.
To schedule the BPC - DM packages:
Open the eDATA menu - 'Run Package' window. You have a option of 'New automation', use that to create schedules on SSIS packages (can be used for both BPC standard packages and customized packages).
hope it helps.
Hi Sam,
You can try by VBA into EXCEL, prepare the dimension member sheet and process. Basically it depends on our knowledge / ease on technology .
I never had a chance to try on this. By visualising, this is possible but ensure on the data type loading into the EXCEL.
example, CompCode is 0310, while loading into EXCEL load as 310... omit the 0 in the front.
Try and share with us how it works.
Cheers
Uma

Similar Messages

Choosing Dimension Members / Creating Data Load Rule Files

Hi
Let me explain this problem using an example. Let's say I have a dimension table called "Product" and its has ProductId, ProductCode & ProductName fields, and a Fact table with ProductId and Value columns. As you can see ProductId has beed used to link to Fact table. I want to display ProductCode as dimension members (ProductName as Alias). I have no problem creating this scenario using EIS. But when I am not sure whether I could do this with EAS. I tried but I cannot get it working. Does anybody know to do this in EAS please? Also, how to create the data load rule for this problem using ProductId?
Regards
Chandra

You can do this using a SQL load rule.
One rule to build your dimension, simply select statement on the one Dimension table.
Second rule to load data is going to require a Select statement with a join to pull the product name from the dimension table and the data from the fact table linked on the Product id.

Process Dimension after BW to BPC Master Data Load

Hi All,
i'm looking for the way to process a dimension after master data load from BW to BPC (following the corresponding how to guide in BPC 7.5 NW). The new members are visible from BPC Administrator -> Mantain Dimension Members, but not visible in BPC for Excel after "Refresh Dimension Member".
New members are visible only if i process dimension from BPC Administrator , but I want this task to be automatic.
¿Any ideas?
Thanks in advance,
Enrique

Thanks for your reply,
I'm using Standard Process Chain IMPORT_IOBJ_MASTER in BPC 7.5 NW SP03. I will open a Sap note.
As a quick solution, I found in SAP Help (is 7.0 but I suppose it's the same behaviour in 7.5) there is another Process Chain (ADMINTASK_MAKEDIM) that can be used to process a Dimension http://help.sap.com/saphelp_bpc70sp02/helpdata/en/36/339907938943ad95d8e6ba37b0d3cd/frameset.htm. It has two parameteres ("Dimension Name" and "Input File"). Help says that if you leave "Input File" field blank, the dimension is processed, but it is mandatory field in package.
I have tried to modify package parameters but always appears an error with MEM_XML_PATH parameter in process chain.
¿Does anybody know how this package/process chain works?
Thanks again,.
Enrique

How to change specified hierachy node to master data attribute automatic?

Dear BW experts:
How to change specified hierachy node to master data attribute automatically? I have a retail business: I have a fixed material group hierachy in R3 Retail ,Now I will extract the material group hierachy ,my goal is that the specified material group hierachy node as dimension in query ,not show hierachy level,So I need change specified material group hierachy node to material group's attribute.
Anybody solve the requests?
Thank you for your help in advance !

If I understand your requirement correctly, you need to have a specific Material Group Hierarchy level (Say Level 2) to be an attribute of Material Group. Usually, this level represents a Brand or Segment, or something with specific meaning.
If this is correct, here are the things you need to do:
1) Create an InfoOnject for this specific attribute representing the specified hierarchy level
2) Add this InfoObject to Material Group as an navigational attribute
3) Select this navigational attribute in your InfoProvider
4) Create a transformation routine for this navigational attribute in Material Group Transformation so that the specified hierarchy level for Material Group will be found and populated. The detail of this routine will depend on your specific requirement. Also, you have to make sure Material Group Hierarchy is updated before Material Group attributes are loaded. If you are not family with ABAP, please ask an ABAPer to help you for the Transformation Routine.
5) Include this navigational attribute in your query along with other required InfoObjects.
Hope this help and good luck!
Bill

Read dimension member(master data) to ABAP internal table in BPC 10.0 NW

Hi all,
I manage to read transaction data using this example [replacement for IF_UJ_MODEL~GET_APPL_DATA;
I am now trying to read members(master data) from a dimension to a ABAP internal table but I have no idea how to.
Can anyone advise me on how to read members(master data) from a dimension to a ABAP internal table.
Some sample code would be really appreciated.
Regards
Edited by: HK Kang on Jan 3, 2012 4:26 AM

Hi Chanaveer,
UJD_ADMIN_RUN_OPTIMIZE can be used only for executing the FULL & LITE OPTIMIZER packages.
Looking at the code of UJD_RUN_OPTIMIZE_PACKAGE it seems this FM can be used to trigger process chain from BW.
Please refer below link on SDN showing how to load Master Data on FLY in SAP BPC 10.
http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/2020b522-cdb9-2e10-a1b1-873309454fce?QuickLink=index&overridelayout=true
Thanks,
Rohit

Automate Master data loads in BPC7(MS)

I need to update dimension members in SAP BPC7 (MS) from an external source.
The source system for my current project is BW, but if you have done any automated master data loads from any other system or even from a "temp" table please post your solution or tips.
Thanks!
Mez

Hi Mezert,
Would like to chime in with some of the things I've learned about this process over 3-4 years I've spent with BPC/Outlooksoft:
-- Automating maintenance of the dimension/master data might be the biggest single weakness of the BPC solution on the MS platform. It's one of the big reasons that the Netweaver platform basically replaces DTS/SSIS and has more direct linkage to BI/BW cubes and master data (InfoCubes).
-- It is also one a very common issue and in fact, you will have to deal with what the old-timers in BI call "slowly-changing dimensions" at almost every client eventually. For instance, you have a list of proucts/materials that every so often someone adds an item to. ...Well, before you can enter anything for it in BPC, you have to add the dimension member, of course.
-- So far, this challenge has been met by bringing in specialist DTS/SSIS experts in most cases who can employ the special "Custom Tasks" and build one of these packages to run in an automated way to populate the tables inside SQL Server and then execute the Admin MakeDim task to process the cube/application.
-- Usually the development/testing/deployment of these solutions is a non-trivial undertaking. It can be done, but there are peculiar challenges.
-- One example of a challenge is what happens if you need a dimension with > 65,000 members? Well, it can be created and populated by a DTS package, however, when you check the package and the custom task from the old Outlooksoft stuff out, you see that it CLEARS the entire dimension table before re-filling it. ...Yep, it wouldn't allow an "Append" function to run.
-- A second example of a peculiar challenge is that unless you update the Excel Dimension Sheet, you will have to do all the updates in SQL Server Mgmt. Studio and really won't be able to touch the BPC Admin again for that dimension.
Apologies for such a long post, but this is a fairly significant issue and I have to do a lot of research to piece together some of these things. ...If anyone else has something to add as a best-practice, please post.

How to rectify the errors in master data loads & transactional data loads?

hy,
please any one tell me
How to rectify the errors in master data loads & transactional data loads?
thnQ
Ravi

Hi,
Please post specific questions in the forum.
Please explain the error you are getting.
-Vikram

How many tables are created in Master data loading ( Including hierchy )

hi ,
Please anybody , can you tell us how many tables are created in Master data loading ( Including hierchy )
thanks
Phani

Hi PP,
Depending upon the definition of an infoobject, the tables are created when the objects are activated.
/BI<C OR DIGIT>/<TABLE CODE><INFOOBJECT>
<C or digit>: C = Customer-defined InfoObjects
digit = SAP-defined InfoObjects
<table code>: S = SID table
T = Text table
P = Time-independent master data attributes
Q = Time-dependent master data attributes
M = Union of time-dependent and time-independent master
data attributes
X = SID table for time-independent navigational attributes
Y = SID table for time-dependent navigational attributes
H = Hierarchy table
K = Hierarchy SID table
I = Hierarchy SID structure table
J = Hierarchy interval table
Thnaks...
Shambhu

How do we improve master data load performance

Hi Experts,
Could you please tell me how do we identify the master data load performance problem and what can be done to improve the master data load performance .
Thanks in Advance.
Nitya

Hi,
-Alpha conversion is defined at infoobject level for objects with data type CHAR.
A characteristic in SAP NetWeaver BI can use a conversion routine like the conversion routine called ALPHA. A conversion routine converts data that a user enters (in so called external format) to an internal format before it is stored on the data base.
The most important conversion routine - due to its common use - is the ALPHA routine that converts purely numeric user input like '4711' into '004711' (assuming that the characteristic value is 6 characters long). If a value is not purely numeric like '4711A' it is left unchanged.
We have found out that in customers systems there are quite often characteristics using a conversion routine like ALPHA that have values on the data base which are not in internal format, e.g. one might find '4711' instead of '004711' on the data base. It could even happen that there is also a value '04711', or ' 4711' (leading space).
This possibly results in data inconsistencies, also for query selection; i.e. if you select '4711', this is converted into '004711', so '04711' won't be selected.
-The check for referential integrity occurs for transaction data and master data if they are flexibly updated. You determine the valid InfoObject values.
- SID genaration is must for loading transaction data with respect to master data, to cal master data at bex level.
Regards,
rvc

Master Data load does not extract Hierarchy nodes in BPC Dimension ACCOUNT

Hi Experts,
I am performing master data load through standard DM package with Filter selection as:
1. Chart of Accounts
2. Hieararchy selection has 4 hierarchy names
3. Selected Import Text nodes
4. Selected Set Filters by Attribute OR Hierarchies
I have run this DM package for a set of data and selections a week ago and it worked fine.
However when i run it now, it is giving issues,
It extracts any new GL maintained in the BI system however it does not extract any hierarchy nodes at all! (Have tested this by deleting the hierarchy nodes and tried to run the master data load)
I am running the DM package in Update and have selection as External.
Any sugestions for checks / has anyone encountered this issue earlier?
Regards,
Shweta Salpe

Hi Guyz,
Thanks.
I found that the issue was with the transformation file where i was maintaining the RATETYPE.
When i removed the mapping of RATETYPE this works fine. (Pulls the nodes of hierarchies)
however now i do not have Ratetype populated in the system.
my rate type mapping is:
RATETYPE=*IF(ID(1:1)=*STR(C) then *STR(TOSKIP);ID(1:1)=*STR(H) then *STR(TOSKIP);ID)
and in conversion file i have TOSKIP *skip
I have to skip the ratetypes for the hierarchy nodes and my hierarchy nodes start with C and H.
So now that i have removed the mapping for RATETYPE can anyone suggest me a correct way to achieve this? (Note the above mapping formula was skipping all of the hierarchy nodes starting with C and H)
Regards,
Shweta Salpe

BPC NW 10.0 - Master data load

Hey guys have you tried the automatic master data load in BPC 10.0?
Would it be possible to perform a delta load for master data?
When you do a delata load whether the exisiting dimensions and properties will be overwritten or just add another column/row with new members and properties?
Please provide your thoughts.
Thanks a million

By automatic do you mean scheduled? If yes, you can schedule the 'Import Master Data Attrib and Text InfoObj' data manager package. The second prompt will ask if the process should 'Overwrite' or 'Update' (you can also modify the advanced script if you want to always update) Depending on what properties are you populating with your transformation file, those will be updated with what's in the source InfoObject. Assume for example the transformation file in the Mapping section is blank, you have ID '123' with description 'Test' in your dimension and ID '123' and description 'Test - changed' in BW, when the update runs the description will be changed from Test to Test - changed. All other IDs will be added to the dimension. Hope this makes sense.

7.5 Hierarchy Master Data Load

Hi experts,
I am trying to load material masterdata with a hierarchy.
When I was loading my members I applied an attribute filter.
It loaded OK and loaded the hierarchy nodes ok.
Then as I went to load the hierarchy it gave me an error saying that "Hierarchy nodes include dimension members that do not exist"
When I checked through the log I could see that the "missing" members where all the ones that I had filtered out with the attribute filter.
But it seems the hierarchy load needs them?
Is there a way to apply the same filter in the hierarchy load? Or any other way around this?
Or can an attribute filter only be used if you are not loading hierarchies?
Thanks

Hi Joergen,
Thanks so much for your quick reply.
My problem is not that my nodes don't load. They do actually come through fine in my first master data load.
But then when I load the hierarchy BPC complains that the node I want to now create as parents has members that don't exist in BPC. These are basemembers, not nodes.
For example:
BW:
Parent A:
   Child A
   Child B
   Child C
BPC
I only load Child A and Child B because Child C does not meet the attribute filter
When I then load Parent A I get an error that Child C is missing?
Regardless I tried your method and it didn't work for me?
-First I loaded my members only with the attribute filter - no problem
-but then I put in a rubbish filter like you said and ticked to load the hierarchy nodes. When I choose the AND filter nothing is being loaded at all. when I choose the OR filter it loads everything (incl the members that I excluded in the first load)?
Did I understand that wrong?
Thanks
Sabine

Master data loading issue

Hi gurus,
    Presently i am working on BI 7.0.I have small issue regarding master data loading.
    I have generic data soruce for master data loading.i have to fetch this data to BW side.Always i have to do full data load to the master data object.first time i have scheduled info package and run DTP to load data to master data object, no issues, data got loaded successfully.whenever i run infopacage for second time and run DTP i am getting error saying that duplicated records.
   How can i handle this.
Best Regards
Prasad

Hi Prasad,
Following is happening in your case:
<b>Loading 1st Time:</b>
1. Data loaded to PSA through ipack.It is a full load.
2. data loaded to infoobject through DTP.
<b>Loading 2nd Time:</b>
1. Data is again loaded to PSA. It is a full load.
2. At this point, data in PSA itself is duplicate. So when you are running the DTP, it picks up the data of both the requests that were loaded to PSA. And hence, you are getting the Duplicate record error.
Please clear the PSA after the data is loaded to infoobject.
Assign points if helpful.
Regards,
Tej Trivedi

BPC:: Master data load from BI Process chain

Hi,
we are trying to automatize the master data load from BI.
Now we are using a package with:
PROMPT(INFILES,,"Import file:",)
PROMPT(TRANSFORMATION,%TRANSFORMATION%,"Transformation file:",,,Import.xls)
PROMPT(DIMENSIONNAME,%DIMNAME%,"Dimension name:",,,%DIMS%)
PROMPT(RADIOBUTTON,%WRITEMODE%,"Write Mode",2,{"Overwirte","Update"},{"1","2"})
INFO(%TEMPNO1%,%INCREASENO%)
INFO(%TEMPNO2%,%INCREASENO%)
TASK(/CPMB/MASTER_CONVERT,OUTPUTNO,%TEMPNO1%)
TASK(/CPMB/MASTER_CONVERT,FORMULA_FILE_NO,%TEMPNO2%)
TASK(/CPMB/MASTER_CONVERT,TRANSFORMATIONFILEPATH,%TRANSFORMATION%)
TASK(/CPMB/MASTER_CONVERT,SUSER,%USER%)
TASK(/CPMB/MASTER_CONVERT,SAPPSET,%APPSET%)
TASK(/CPMB/MASTER_CONVERT,SAPP,%APP%)
TASK(/CPMB/MASTER_CONVERT,FILE,%FILE%)
TASK(/CPMB/MASTER_CONVERT,DIMNAME,%DIMNAME%)
TASK(/CPMB/MASTER_LOAD,INPUTNO,%TEMPNO1%)
TASK(/CPMB/MASTER_LOAD,FORMULA_FILE_NO,%TEMPNO2%)
TASK(/CPMB/MASTER_LOAD,DIMNAME,%DIMNAME%)
TASK(/CPMB/MASTER_LOAD,WRITEMODE,%WRITEMODE%)
But we need to include these tasks into a BI process chain.
How can we add the INFO statement into a process chain?
And how can we declare the variables?
Regards,
EZ.

Hi,
i have followed your recomendation, but when i try to use the process /CPMB/MASTER_CONVERT, with the parameter TRANSFORMATIONFILEPATH and the root of the transformation file as value, i have a new problem. The value only have 60 char, and my root is longer:
\ROOT\WEBFOLDERS\APPXX\PLANNING\DATAMANAGER\TRANSFORMATIONFILES\trans.xls
How can we put this root???
Regards,
EZ.

Master Data loading got failed: error "Update mode R is not supported by th

Hello Experts,
I use to load master data for 0Customer_Attr though daily process chain, it was running successfully.
For last 2 days master data loading for 0Customer_Attr got failed and it gives following error message:
"Update mode R is not supported by the extraction API"
Can anyone tell me what is that error for? how to resolve this issue?
Regards,
Nirav

Hi
Update mode R error will come in the below case
You are running a delta (for master data) which afils due to some error. to resolve that error, you make the load red and try to repeat the load.
This time the load will fail with update mode R.
As repeat delta is not supported.
So, now, the only thing you can do is to reinit the delta(as told in above posts) and then you can proceed. The earlier problem has nothing to do with update mode R.
example your fiorst delta failed with replication issue.
only replicating and repeaing will not solve the update mode R.
you will have to do both replication of the data source and re-int for the update mode R.
One more thing I would like to add is.
If the the delat which failed with error the first time(not update mode R), then
you have to do init with data transfer
if it failed without picking any records,
then do init without data transfer.
Hope this helps
Regards
Shilpa
Edited by: Shilpa Vinayak on Oct 14, 2008 12:48 PM

How to automate handling of dimension members? (master data loads)

Similar Messages

Maybe you are looking for