Data load in SAP-BW
Hi all,
What is the strategy to load for example 500,000 entries in BW (material master, transactional data)?
How to separate this entries in small packages and transfer it to BW in automatic?
Is there some strategy for that?
Is there some configuration for that?
regards
ashwin
hi
See OSS note 411464 (example concerning Info Structures from purchasing documents) to create smaller jobs in order to integrate a large amount of data.
For example, if you wish to split your 500,000 entries in five intervals:
- Create 5 variants in RMCENEAU for each interval
- Create 5 jobs (SM36) that execute RMCENEAU for each variant
- Schedule your jobs
- You can then see the result in RSA3
regards
ashwin
Similar Messages
-
Data load into SAP ECC from Non SAP system
Hi Experts,
I am very new to BODS and I have want to load historical data from non SAP source system into SAP R/3 tables like VBAK,VBAP using BODS, Can you please provide steps/documents or guidelines on how to achieve this.
Regards,
MonilHi
In order to load into SAP you have the following options
1. Use IDocs. There are several standard IDocs in ECC for specific objects (MATMAS for materials, DEBMAS for customers, etc., ) You can generate and send IDocs as messages to the SAP Target using BODS.
2. Use LSMW programs to load into SAP Target. These programs will require input files generated in specific layouts generated using BODS.
3. Direct Input - The direct input method is to write ABAP programs targetting on specific tables. This approach is very complex and hence a lot of thought process needs to be applied.
The OSS Notes supplied in previous messages are all excellent guidance to steer you in the right direction on the choice of load, etc.,
However, the data load into SAP needs to be object specific. So targetting merely the sales tables will not help as the sales document data held in VBAK and VBAP tables you mentioned are related to Articles. These tables will hold sales document data for already created articles. So if you want to specifically target these tables, then you may need to prepare an LSMW program for the purpose.
To answer your question on whether it is possible to load objects like Materials, customers, vendors etc using BODS, it is yes you can.
Below is a standard list of IDocs that you can use for this purpose to load into SAP ECC system from a non SAP system.
Customer Master - DEBMAS
Article Master - ARTMAS
Material Master - MATMAS
Vendor Master - CREMAS
Purchase Info Records (PIR) - INFREC
The list is endless.........
In order to achieve this, you will need to get the functional design consultants to provide ETL mapping for the legacy data to IDoc target schema and fields (better to ahve sa tech table names and fields too). You should then prepare the data after putting it through the standard check table validations for each object along with any business specific conversion rules and validations applied. Having prepared this data, you can either generate flat file output for load into SAP using LSMW programs or generate IDoc messages to the target SAPsystem.
If you are going to post IDocs directly into SAP target using BODS, you will need to create a partner profile for BODS to send IDocs and define the IDocs you need as inbound IDocs. There are few more setings like RFC connectivity, authorizations etc, in order for BODS to successfully send IDocs into the SAP Target.
Do let me know if you need more info on any specific queries or issues you may encounter.
kind regards
Raghu -
EDT Cat. 15 Data loaded to SAP but failed when updating
Hi,
I have an structure to load data into BP using KCLJ with Cat 15.
Here it is.
AKTYP
TYPE
PARTNER
ROLE1
KUNNR
KUNNR_EXT
BU_GROUP
FIBUKRS
CHIND_ADDR
NAME_CO
NAME_ORG1
NAME_ORG2
STREET
STR_SUPPL1
STR_SUPPL2
STR_SUPPL3
LOCATION
HOUSE_NUM1
POST_CODE1
CITY1
COUNTRY
REGION
LANGU
CHIND_TEL
TEL_NUMBER
TEL_EXTENS
We had the data loaded to SAP with ROLE 000000 and TR0100 but somehow when we tried to update the address thru ROLE TR0100, we had a dump and failed to update. However, the update is good when we use ROLE 000000 to update.
Anyone would have a clue of this?
ThanksI am new to EDT also. I know Cat 15 which can load BP. SAP has more categories which can load more using KCLJ. Here's my experience.
Under Tcode SIMGH, find IMG structure External Data Transfer for SAP Banking. Under that structure, you can find Display Required and Optional Entry Fields for SEM Banking. When you enter 15 in the Category box, you'll see a whole list of fields about BP. You can use these fields to create your own structure.
After you created your structure, use Define Sender Structure under External Data Transfer for SAP Banking to define your structure. After that, it is done. You can try use KCLJ to load your BP.
If you still have other issues, mostly will be the configuration.
Enjoy. -
Mass data load into SAP R/3 - with XI?
Hi guys!
I have an issue - mass data migration into SAP R/3. Is XI a good solution? It will be about 60GB of data. Or is there a better way of this data load?
Thanx a lot!
Olianhi,
SAP doesn't recomment using XI for mass data migration
and 60 Gb is certainly too much
use LSMW for that purpose
Regards,
michal -
Full and delta Data loads in SAP BI 7.0
Hi,
Kindly explain me the difference between full and delta data loads in cube and DSO.
When do we select change log or active table(with or without archive) with full/delta in DTP for DSO.
Please explain the differences in data load for above different combinations.
With thanks and regards,
MukulPlease search the forums. This topic has already been discussed a lot of times.
-
Data load from SAP ECC to SAP BI
Hello Gurus and Experts
I am new to BI and I m almost struggling to find a step by step process in loading data from SAP ECC to SAP BI through generic extractors from VBAK. The Problem is I can create an Infopackage for full update and loaded the records.(Lets say Upto this step 100 records are moved to PSA)
Then I create a sale order in ECC which is a new record that has to be transfered as delta record.
Now my questions are:
Am I correct if I moved the initial records into PSA with Full Mode InfoPackage?
Should I create another infopackage for delta records with Delta Mode or to change the update mode of the infopackage created earlier for Full Update mode?
Should I create a new infopackage every time to load the delta records?
Does separate DTP has to be created for Full and Delta updates?
Please dont be frustrated if my questions are pointless or childish
I would be glad if someone demonstrate the solutions in steps
Thanks in Advance
KarthikHi Ram,
I have followed all the steps mentioned by you, yet something is lagging in my end.
Let me lists the steps done by me and please correct me if i am wrong anywhere.
1. RSO2 in ECC..
2. Created DS with short, med and long names in SD application component for VBAK with all the fields unchecked in hide selection except document number, time of document, document date, net
value of the document and document currency.
3. mentioned a numeric pointer as Document number for delta and used new status for changed records.
3. saved the datasource. checked the newly created ds using the tcode RSA3.
4. Replicated the datasource under SD Application Component in BI and Activated it
6. Performed Transformations
7. created an Info Package with FULL UPDATE and executed. I got 6898 records in my PSA
6. Created DTP with DELTA. Saved and Executed it. Got 6898 records in my DSO
7. Created Info Package with INIT WITHOUT DATA TRANSFER and scheduled it.
8. Switched over to ECC and added a sale order
9. Created an InfoPackage with DELTA UPDATE and Scheduled it.
-----I didnt receive any records in my PSA
10. performed DTP.
---- I didnt received any new records in my DSO as my delta run is not working..
PS: I am using WO DSO
Please correct me if i am wrong anywhere
Thanks in advance
Karthik -
MASTER DATA LOADING IN SAP BI7.0
how to load master data attribute, text , hierarchies in sapBI7.0
check these
http://help.sap.com/saphelp_nw2004s/helpdata/en/e8/2cd937651f1a13e10000009b38f8cf/content.htm
http://help.sap.com/saphelp_nw70/helpdata/en/c8/e92637c2cbf357e10000009b38f936/content.htm -
How to avoid duplicate data loading from SAP-r/3 to BI
Hi !
I have created one process chain that will load data into some ODS from R/3,where(in R/3)the datasources/tables r updated daily.
I want to scheduled the system such that ,if on any day the source data is not updated (if the tables r as it is) then that data shuold not be loaded into ODS.
Can any one suggest me such mechanism,so that I can always have unique data in my data targets.
Pls ! Reply soon.
Thank You !
Pankaj K.Hello Pankaj,
By setting the unique records option, you pretty much are letting the system know to not check the uniqueness of the records using the change log and the ODS active table log.
Also, in order to avoid the problem where you are having dual requests which are getting activated at the same time. Please make sure you select the options "Set Quality Status to 'OK' Automatically" and "Activate Data Automatically" that way you would be having an option to delete a request as required without having to delete the whole data.
This is all to avoid the issue where even the new request has to be deleted to delete the duplicate data.
Untill and unless the timestamp field is available in the table on top of which you have created the datasource it would be difficult to check the delta load.
Check the table used to make sure there is no timestamp field or any other numeric counter field which can be used for creating a delta queue for the datasource you are dealing with.
Let me know if the information is helpful or if you need additional information regarding the same.
Thanks
Dharma. -
Hierarchy data loading in sap bw 7.3 for 0 costcenter-dtp error
Hi ,
I am loading data from ECC with data source 0COSTCENTER_0101_HIER to BW.For this i have created transformations between info object HIERARCHIES 0COSTCENTER and data source and DTP as well.I have loaded data upto PSA with info package no issues,while loading data from PSA to hierarchy i got error in DTP like "Node [00000006, 00000010 ]: Leaf ' ' already exists as child of node 00000005 ".
Can any one faced similar issue in BW7.3 ,please share your thoughts
Thanks,
Sri.Hi Srivardhan,
I too got the same error. This error probably rises if you are entering hierarchy with some characteristics in your infoObject whose data type is numc (character string with only digits).
Instead try using a infoobject with Char as data type. or simply change the infoobject in which u are implementing your hierarchy to char data type.
And give suitable sufficient length.
Regards. -
Last Data packet for the data load.
Hi All,
How to find the last data packet loaded to target for the data load in SAP BI? In the Table?
Thank you,
AdhviHi Adhvirao,
When u r loading the data from ECC go to monitor ---> details ---> check the data pacaket which are failed double click on that data packet then in bottom u will able to see the IDOC no for ecc side which are pending in ecc containing some data. you can excute them manually to BI side thorgh BD87.
Thanks,
Deepak -
Issue:
I have SAP BW system and SAP HANA System
SAP BW to SAP HANA connecting through a DB Connection (named HANA)
Whenever I created any Open Hub as Destination like DB Table with the help of DB Connection, table will be created at HANA Schema level ( L_F50800_D )
Executed the Open Hub service without checking DELETING Data from table option
Data loaded with 16 Records from BW to HANA same
Second time again executed from BW to HANA now 32 records came ( it is going to append )
Executed the Open Hub service with checking DELETING Data from table option
Now am getting short Dump DBIF_RSQL_TABLE_KNOWN getting
If checking in SAP BW system tio SAP BW system it is working fine ..
will this option supports through DB Connection or not ?
Please follow the attachemnet along with this discussion and help me to resolve how ?
From
Santhosh KumarHi Ramanjaneyulu ,
First of all thanks for the reply ,
Here the issue is At OH level ( Definition Level - DESTINATION TAB and FIELD DEFINITION )
in that there is check box i have selected already that is what my issue even though selected also
not performing the deletion from target level .
SAP BW - to SAP HANA via DBC connection
1. first time from BW suppose 16 records - Dtp Executed -loaded up to HANA - 16 same
2. second time again executed from BW - now hana side appaended means 16+16 = 32
3. so that i used to select the check box at OH level like Deleting data from table
4. Now excuted the DTP it throws an Short Dump - DBIF_RSQL_TABLE_KNOWN
Now please tell me how to resolve this ? will this option is applicable for HANA mean to say like , deleting data from table option ...
Thanks
Santhosh Kumar -
Master Data Load to APO from SAP MDM through SAP PI
Hi SDners,
This is a Parts Master Data Solution for one of the Largest Auto Manufacturer where SAP MDM will be the central hub of all the Global and Local attributes of Parts . The subscribing system is SAP SCM APO . Please advice if there is any possibility of direct integration between APO -MDM through PI. Does PI has the standard IDOC types to communicate with APO.
Also does APO has some RFC/BAPI to do master data load for Product Master /n/sapapo/mat1
Thanks,
PrabuddhaHi,
Check the LUWs in SM58 in source system and then execute it. Else check in BD87 and push the IDocs manually in ECC.
Thanks
Reddy
Edited by: Surendra Reddy on Feb 24, 2009 10:59 AM -
Hi
We running windows server with ERP 6.0 and this was coppied from another server.
The JSPM fails with the following error.
Trouble Ticket Report
Java Support Package Manager for SAP NetWeaver'04s
SID................: $(/J2EE/StandardSystem/SAPSystemName)
Hostname...........: $(/J2EE/SAPGlobalHost)
Install directory..: $(/J2EE/StandardSystem/SAPSIDDirectory)
Database...........: $(/J2EE/DBSystem/DBInfoName)
Operating System...: $(/J2EE/StandardSystem/CentralInstance/J2EEEngineInstanceHost/OpSysType)
JDK version........: $(/SystemProperties/JavaVersion) $(/SystemProperties/JavaVendor)
JSPM version.......: $(/MAIN_VERSION)
System release.....: $(/J2EE/StandardSystem/Version)
ABAP stack present.: $(/J2EE/StandardSystem/BCSystemPresent)
The execution ended in error.
Could not load data model com.sap.sdt.jspm.model.JspmDataModel. See previous messages.
Class with name com.sap.sdt.j2ee.model.NWDISystemRole not found.
More information can be found in the log file .
Use the information provided to trouble-shoot the problem. There might be an OSS note providing a solution to this problem. Search for OSS notes with the following search terms:
com.sap.sdt.tools.model.LoadException
Could not load data model com.sap.sdt.jspm.model.JspmDataModel. See previous messages.
JSPM_MAIN
JSPMPhases
NetWeaver Upgrade
SAPJup
Java Upgrade
SAPJup.LOG
<!LOGHEADER[START]/>
<!HELP[Manual modification of the header may cause parsing problem!]/>
<!LOGGINGVERSION[1.5.3.7185 - 630]/>
<!NAME[D:
usr
sap
ERP
DVEBMGS10
j2ee
JSPM
log
log_2008_11_17_12_39_25
SAPJup.LOG]/>
<!PATTERN[SAPJup.LOG]/>
<!FORMATTER[com.sap.tc.logging.ListFormatter]/>
<!ENCODING[UTF8]/>
<!LOGHEADER[END]/>
#1.5 #C0000A0A0A3D00000000000F010E329300045BE031D40CA8#1226918373625#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.build.BuilderDirector.extractElements(BuilderDirector.java:132)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.build.BuilderDirector.extractElements(BuilderDirector.java:132)#Java###Tag with name found.#2#ControlUnit#JSPM#
#1.5 #C0000A0A0A3D000000000010010E329300045BE031D577F0#1226918373718#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.build.BuilderDirector.createUnits(BuilderDirector.java:186)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.build.BuilderDirector.createUnits(BuilderDirector.java:186)#Java###Creating control unit .#1#JSPM#
#1.5 #C0000A0A0A3D000000000011010E329300045BE031D6E720#1226918373812#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.ctrl.ExecutionDialog.showWelcomeDialog(ExecutionDialog.java:421)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.ctrl.ExecutionDialog.showWelcomeDialog(ExecutionDialog.java:421)#Java###Could not process dialog because execution dialogs have been suppressed.#1#JspmWelcomeDialog#
#1.5 #C0000A0A0A3D000000000012010E329300045BE031D6E720#1226918373812#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#Java###Starting execution of action with name and type .#2#Unit#JSPM#
#1.5 #C0000A0A0A3D000000000013010E329300045BE032541218#1226918382015#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#Java###Starting execution of action with name and type .#2#Modul#JSPMPhases#
#1.5 #C0000A0A0A3D000000000014010E329300045BE032541218#1226918382015#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#Java###Starting execution of action with name and type .#2#Phase#JSPM_MAIN#
#1.5 #C0000A0A0A3D000000000015010E329300045BE0333D02E8#1226918397281#/System/Server/Upgrade/Jump##com.sap.sdt.tools.model.AbstractDataModelElement.getClassByName(AbstractDataModelElement.java:743)#######Thread[main,5,main]##0#0#Error#1#com.sap.sdt.tools.model.AbstractDataModelElement.getClassByName(AbstractDataModelElement.java:743)#Java###Class with name com.sap.sdt.j2ee.model.NWDISystemRole not found.##
#1.5 #C0000A0A0A3D000000000016010E329300045BE0333D3D80#1226918397296#/System/Server/Upgrade/Jump##com.sap.sdt.tools.model.DataModel.load(DataModel.java:89)#######Thread[main,5,main]##0#0#Error#1#com.sap.sdt.tools.model.DataModel.load(DataModel.java:89)#Java###Could not load data model com.sap.sdt.jspm.model.JspmDataModel. See previous messages.##Hi Patrick ,
What user did you use to start JSPM? Was it <sid>adm? Also based on the error it seems there is something wrong with DataModel.xml JSPM uses. And you've mentioned it was copied from another system if I get it right.
So as a quick workaround you could try removing:
- Jspm.DataModel.xml
- Jspm.J2EE.DataModel.xml
- Jspm.JSPM.DataModel.xml
from ../j2ee/JSPM/data/variables directory and give JSPM another try.
Please make sure the rest of the XMLs are in place otherwise JSPM won't start.
Regards,
Vasil -
Can some1 tell me abt sap data loader in hr..
hi every1,
can some 1 tell me abt sap data loader in hr..if u have some documentatiom it will be great. apart from lsmw,bapi,direct inputs,bdc what are the other ways of data conversions.. thanx in advancePL check this <a href="https://forums.sdn.sap.com/click.jspa?searchID=1350793&messageID=11323">thread</a>.
~Suresh -
Sap bw 7.3 master data load error
sap bw 7.3 master data load error
erroe: Exception in Substep RulesHi Jayram,
I am assuming that you are getting this error when you are loading data from PSA to IO. If so, the error might be because of
1. Duplicate records
PSA might have duplicate records. But you will be able to load only one record to Master data IO. In DTP Update tab, there is an option for "Handle Duplicate Record Keys" . Just enable this & try to load again.
2. Erroneous records.
Some special reocrds are allowed in PSA where as thye might not be allowed in Master Data/Data Targets like Lower case letters/ some speacial characters etc. If error is because of this, then you might need to correct the data at PSA level & reload the data to Master data. Else get it corrected in source system itself & fetch the data to BW. Or write some code to take care of these special characters.
Hope it helps!
Regards,
Pavan
Maybe you are looking for
-
Is it possible to have 2 trans with the same tcode but different langs
Dear forum members, I would like to know if it is possible to have in the TSTCT table u2013 two entries with the same TCODE value but different SPRAS value (the language field) Thanks for your help, Roy
-
How do I command a single video track (with many clips) to an action?
Hi, This is my first post in this forum, and I am a beginner on FCE. I want to take one of my video tracks and reduce the size to 1/4 and put it in the upper right corner of the screen. I want my screen split into 4 equal sections. My first track has
-
Is this SQL DELETE statement correct ?
Hi Guys Is the following code correct: String strUpdate = "DELETE * FROM table_name"; Connection conn = DriverManager.getConnection("jdbc:mysql://localhost/newdb?user=root&password=123" ) ; Statement stmt = conn.createStatement() ; stmt.executeUpdate
-
Address parameters in the signature definitions (4.1)
Is there any way to change the action triggered by the signature based upon the network/host source/destination address in all kinds of engines? In Atomic engine it is possible - for example triggering different levels of alarms, based upon the victi
-
My adobe cloud will not open, how do I fix this?
I have tied to repair, uninstall and reinstall. The most I have gotten is the window for the cloud to open showing the program is there but it does not open at all. How do I fix this on windows 7?