Data load in SAP-BW

Hi all,
What is the strategy to load for example 500,000 entries in BW (material master, transactional data)?
How to separate this entries in small packages and transfer it to BW in automatic?
Is there some strategy for that?
Is there some configuration for that?
regards
ashwin

hi
See OSS note 411464 (example concerning Info Structures from purchasing documents) to create smaller jobs in order to integrate a large amount of data.
For example, if you wish to split your 500,000 entries in five intervals:
- Create 5 variants in RMCENEAU for each interval
- Create 5 jobs (SM36) that execute RMCENEAU for each variant
- Schedule your jobs
- You can then see the result in RSA3
regards
ashwin

Similar Messages

  • Data load into SAP ECC from Non SAP system

    Hi Experts,
    I am very new to BODS and I have want to load historical data from non SAP source system  into SAP R/3 tables like VBAK,VBAP using BODS, Can you please provide steps/documents or guidelines on how to achieve this.
    Regards,
    Monil

    Hi
    In order to load into SAP you have the following options
    1. Use IDocs. There are several standard IDocs in ECC for specific objects (MATMAS for materials, DEBMAS for customers, etc., ) You can generate and send IDocs as messages to the SAP Target using BODS.
    2. Use LSMW programs to load into SAP Target. These programs will require input files generated in specific layouts generated using BODS.
    3. Direct Input - The direct input method is to write ABAP programs targetting on specific tables. This approach is very complex and hence a lot of thought process needs to be applied.
    The OSS Notes supplied in previous messages are all excellent guidance to steer you in the right direction on the choice of load, etc.,
    However, the data load into SAP needs to be object specific. So targetting merely the sales tables will not help as the sales document data held in VBAK and VBAP tables you mentioned are related to Articles. These tables will hold sales document data for already created articles. So if you want to specifically target these tables, then you may need to prepare an LSMW program for the purpose.
    To answer your question on whether it is possible to load objects like Materials, customers, vendors etc using BODS, it is yes you can.
    Below is a standard list of IDocs that you can use for this purpose to load into SAP ECC system from a non SAP system.
    Customer Master - DEBMAS
    Article Master - ARTMAS
    Material Master - MATMAS
    Vendor Master - CREMAS
    Purchase Info Records (PIR) - INFREC
    The list is endless.........
    In order to achieve this, you will need to get the functional design consultants to provide ETL mapping for the legacy data to IDoc target schema and fields (better to ahve sa tech table names and fields too). You should then prepare the data after putting it through the standard check table validations for each object along with any business specific conversion rules and validations applied. Having prepared this data, you can either generate flat file output for load into SAP using LSMW programs or generate IDoc messages to the target SAPsystem.
    If you are going to post IDocs directly into SAP target using BODS, you will need to create a partner profile for BODS to send IDocs and define the IDocs you need as inbound IDocs. There are few more setings like RFC connectivity, authorizations etc, in order for BODS to successfully send IDocs into the SAP Target.
    Do let me know if you need more info on any specific queries or issues you may encounter.
    kind regards
    Raghu

  • EDT Cat. 15 Data loaded to SAP but failed when updating

    Hi,
    I have an structure to load data into BP using KCLJ with Cat 15.
    Here it is.
    AKTYP
    TYPE
    PARTNER
    ROLE1
    KUNNR
    KUNNR_EXT
    BU_GROUP
    FIBUKRS
    CHIND_ADDR
    NAME_CO
    NAME_ORG1
    NAME_ORG2
    STREET
    STR_SUPPL1
    STR_SUPPL2
    STR_SUPPL3
    LOCATION
    HOUSE_NUM1
    POST_CODE1
    CITY1
    COUNTRY
    REGION
    LANGU
    CHIND_TEL
    TEL_NUMBER
    TEL_EXTENS
    We had the data loaded to SAP with ROLE 000000 and TR0100 but somehow when we tried to update the address thru ROLE TR0100, we had a dump and failed to update. However, the update is good when we use ROLE 000000 to update.
    Anyone would have a clue of this?
    Thanks

    I am new to EDT also. I know Cat 15 which can load BP. SAP has more categories which can load more using KCLJ. Here's my experience.
    Under Tcode SIMGH, find IMG structure External Data Transfer for SAP Banking. Under that structure, you can find Display Required and Optional Entry Fields for SEM Banking. When you enter 15 in the Category box, you'll see a whole list of fields about BP. You can use these fields to create your own structure.
    After you created your structure, use Define Sender Structure under External Data Transfer for SAP Banking to define your structure. After that, it is done. You can try use KCLJ to load your BP.
    If you still have other issues, mostly will be the configuration.
    Enjoy.

  • Mass data load into SAP R/3 - with XI?

    Hi guys!
    I have an issue - mass data migration into SAP R/3. Is XI a good solution? It will be about 60GB of data. Or is there a better way of this data load?
    Thanx a lot!
    Olian

    hi,
    SAP doesn't recomment using XI for mass data migration
    and 60 Gb is certainly too much
    use LSMW for that purpose
    Regards,
    michal

  • Full and delta Data loads in SAP BI 7.0

    Hi,
    Kindly explain me the difference between full and delta data loads in cube and DSO.
    When do we select change log or active table(with or without archive) with full/delta in DTP for DSO.
    Please explain the differences in data load for above different combinations.
    With thanks and regards,
    Mukul

    Please search the forums. This topic has already been discussed a lot of times.

  • Data load from SAP ECC to SAP BI

    Hello Gurus and Experts
                     I am new to BI and I m almost struggling to find a step by step process in loading data from SAP ECC to SAP BI through generic extractors from VBAK. The Problem is I can create an Infopackage for full update and loaded the records.(Lets say Upto this step 100 records are moved to PSA)
    Then I create a sale order in ECC which is a new record that has to be transfered as delta record.
    Now my questions are:
    Am I correct if I moved the initial records into PSA with Full Mode InfoPackage?
    Should I create another infopackage for delta records with Delta Mode or to change the update mode of the infopackage created earlier for Full Update mode?
    Should I create a new infopackage every time to load the delta records?
    Does separate DTP has to be created for Full and Delta updates?
    Please dont be frustrated if my questions are pointless or childish
    I would be glad if someone demonstrate the solutions in steps
    Thanks in Advance
    Karthik

    Hi Ram,
           I have followed all the steps mentioned by you, yet something is lagging in my end.
    Let me lists the steps done by me and please correct me if i am wrong anywhere.
    1. RSO2 in ECC..
    2. Created DS with short, med and long names in SD application component for VBAK with all the fields unchecked in hide selection except document number, time of document, document date, net
    value of the document and document currency.
    3. mentioned a numeric pointer as Document number for delta and used new status for changed records.
    3. saved the datasource. checked the newly created ds using the tcode RSA3.
    4. Replicated the datasource under SD Application Component in BI and Activated it
    6. Performed Transformations
    7.  created an Info Package with FULL UPDATE and executed. I got 6898 records in my PSA
    6. Created DTP with DELTA. Saved and Executed it. Got 6898 records in my DSO
    7. Created Info Package with INIT WITHOUT DATA TRANSFER and scheduled it.
    8. Switched over to ECC and added a sale order
    9. Created an InfoPackage with DELTA UPDATE and Scheduled it.
    -----I didnt receive any records in my PSA
    10. performed DTP.
    ---- I didnt received any new records in my DSO as my delta run is not working..
    PS: I am using WO DSO
    Please correct me if i am wrong anywhere
    Thanks in advance
    Karthik

  • MASTER DATA LOADING  IN SAP BI7.0

    how to load master data attribute, text , hierarchies in sapBI7.0

    check these
    http://help.sap.com/saphelp_nw2004s/helpdata/en/e8/2cd937651f1a13e10000009b38f8cf/content.htm
    http://help.sap.com/saphelp_nw70/helpdata/en/c8/e92637c2cbf357e10000009b38f936/content.htm

  • How to avoid duplicate data loading from SAP-r/3 to BI

    Hi !
           I have created one process chain that will load data into some ODS from R/3,where(in R/3)the datasources/tables r updated daily.
           I want to scheduled the system such that ,if on any day the source data is not updated (if the tables r as it is) then that data shuold not be loaded into ODS.
           Can any one suggest me such mechanism,so that I can always have unique data in my data targets.
           Pls ! Reply soon.
          Thank You !
           Pankaj K.

    Hello Pankaj,
    By setting the unique records option, you pretty much are letting the system know to not check the uniqueness of the records using the change log and the ODS active table log.
    Also, in order to avoid the problem where you are having dual requests which are getting activated at the same time. Please make sure you select the options "Set Quality Status to 'OK' Automatically" and "Activate Data Automatically" that way you would be having an option to delete a request as required without having to delete the whole data.
    This is all to avoid the issue where even the new request has to be deleted to delete the duplicate data.
    Untill and unless the timestamp field is available in the table on top of which you have created the datasource it would be difficult to check the delta load.
    Check the table used to make sure there is no timestamp field or any other numeric counter field which can be used for creating a delta queue for the datasource you are dealing with.
    Let me know if the information is helpful or if you need additional information regarding the same.
    Thanks
    Dharma.

  • Hierarchy  data loading  in sap  bw 7.3 for 0 costcenter-dtp error

    Hi ,
    I am loading data from ECC with data source 0COSTCENTER_0101_HIER to BW.For this i have created transformations between info object HIERARCHIES 0COSTCENTER and data source and DTP as well.I have loaded data upto PSA with info package  no issues,while loading data from PSA to hierarchy i got error in DTP like "Node [00000006, 00000010 ]: Leaf ' ' already exists as child of node 00000005 ".
    Can any one faced similar issue in BW7.3 ,please share your thoughts
    Thanks,
    Sri.

    Hi Srivardhan,
    I too got the same error. This error probably rises if you are entering hierarchy with some characteristics in your infoObject whose data type is numc (character string with only digits).
    Instead try using a infoobject with Char as data type. or simply change the infoobject in which u are implementing your hierarchy to char data type.
    And give suitable sufficient length.
    Regards.

  • Last Data packet for the data load.

    Hi All,
    How to find the last data packet loaded to target for the data load in SAP BI? In the Table?
    Thank you,
    Adhvi

    Hi Adhvirao,
    When u r loading the data from ECC go to monitor ---> details ---> check the data pacaket which are failed double click on that data packet then in bottom u will able to see the IDOC no for ecc side which are pending in ecc containing some data. you can excute them manually to BI side thorgh BD87.
    Thanks,
    Deepak

  • Open HUB ( SAP BW ) to SAP HANA through DB Connection data loading , Delete data from table option is not working Please help any one from this forum

    Issue:
    I have SAP BW system and SAP HANA System
    SAP BW to SAP HANA connecting through a DB Connection (named HANA)
    Whenever I created any Open Hub as Destination like DB Table with the help of DB Connection, table will be created at HANA Schema level ( L_F50800_D )
    Executed the Open Hub service without checking DELETING Data from table option
    Data loaded with 16 Records from BW to HANA same
    Second time again executed from BW to HANA now 32 records came ( it is going to append )
    Executed the Open Hub service with checking DELETING Data from table option
    Now am getting short Dump DBIF_RSQL_TABLE_KNOWN getting
    If checking in SAP BW system tio SAP BW system it is working fine ..
    will this option supports through DB Connection or not ?
    Please follow the attachemnet along with this discussion and help me to resolve how ?
    From
    Santhosh Kumar

    Hi Ramanjaneyulu ,
    First of all thanks for the reply ,
    Here the issue is At OH level ( Definition Level - DESTINATION TAB and FIELD DEFINITION )
    in that there is check box i have selected already that is what my issue even though selected also
    not performing the deletion from target level .
    SAP BW - to SAP HANA via DBC connection
    1. first time from BW suppose 16 records - Dtp Executed -loaded up to HANA - 16 same
    2. second time again executed from BW - now hana side appaended means 16+16 = 32
    3. so that i used to select the check box at OH level like Deleting data from table
    4. Now excuted the DTP it throws an Short Dump - DBIF_RSQL_TABLE_KNOWN
    Now please tell me how to resolve this ? will this option is applicable for HANA mean to say like , deleting data from table option ...
    Thanks
    Santhosh Kumar

  • Master Data Load to APO from SAP MDM through SAP PI

    Hi SDners,
    This is a Parts Master Data Solution for one of the Largest Auto Manufacturer where SAP MDM will be the central hub of all the Global and Local attributes of Parts . The subscribing system is SAP SCM APO . Please advice if there is any possibility of direct integration between APO -MDM through PI. Does PI has the standard IDOC types to communicate with APO.
    Also does APO has some RFC/BAPI to do master data load for Product Master /n/sapapo/mat1
    Thanks,
    Prabuddha

    Hi,
    Check the LUWs in SM58 in source system and then execute it. Else check in BD87 and push the IDocs manually in ECC.
    Thanks
    Reddy
    Edited by: Surendra Reddy on Feb 24, 2009 10:59 AM

  • JSPM fails to start: Could not load data model com.sap.sdt.jspm.model

    Hi
    We running windows server with ERP 6.0 and this was coppied from another server.
    The JSPM fails with the following error.
    Trouble Ticket Report
    Java Support Package Manager for SAP NetWeaver'04s
    SID................: $(/J2EE/StandardSystem/SAPSystemName)
    Hostname...........: $(/J2EE/SAPGlobalHost)
    Install directory..: $(/J2EE/StandardSystem/SAPSIDDirectory)
    Database...........: $(/J2EE/DBSystem/DBInfoName)
    Operating System...: $(/J2EE/StandardSystem/CentralInstance/J2EEEngineInstanceHost/OpSysType)
    JDK version........: $(/SystemProperties/JavaVersion) $(/SystemProperties/JavaVendor)
    JSPM version.......: $(/MAIN_VERSION)
    System release.....: $(/J2EE/StandardSystem/Version)
    ABAP stack present.: $(/J2EE/StandardSystem/BCSystemPresent)
    The execution ended in error.
    Could not load data model com.sap.sdt.jspm.model.JspmDataModel. See previous messages.
    Class with name com.sap.sdt.j2ee.model.NWDISystemRole not found.
    More information can be found in the log file .
    Use the information provided to trouble-shoot the problem. There might be an OSS note providing a solution to this problem. Search for OSS notes with the following search terms:
    com.sap.sdt.tools.model.LoadException
    Could not load data model com.sap.sdt.jspm.model.JspmDataModel. See previous messages.
    JSPM_MAIN
    JSPMPhases
    NetWeaver Upgrade
    SAPJup
    Java Upgrade
    SAPJup.LOG
    <!LOGHEADER[START]/>
    <!HELP[Manual modification of the header may cause parsing problem!]/>
    <!LOGGINGVERSION[1.5.3.7185 - 630]/>
    <!NAME[D:
    usr
    sap
    ERP
    DVEBMGS10
    j2ee
    JSPM
    log
    log_2008_11_17_12_39_25
    SAPJup.LOG]/>
    <!PATTERN[SAPJup.LOG]/>
    <!FORMATTER[com.sap.tc.logging.ListFormatter]/>
    <!ENCODING[UTF8]/>
    <!LOGHEADER[END]/>
    #1.5 #C0000A0A0A3D00000000000F010E329300045BE031D40CA8#1226918373625#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.build.BuilderDirector.extractElements(BuilderDirector.java:132)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.build.BuilderDirector.extractElements(BuilderDirector.java:132)#Java###Tag with name found.#2#ControlUnit#JSPM#
    #1.5 #C0000A0A0A3D000000000010010E329300045BE031D577F0#1226918373718#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.build.BuilderDirector.createUnits(BuilderDirector.java:186)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.build.BuilderDirector.createUnits(BuilderDirector.java:186)#Java###Creating control unit .#1#JSPM#
    #1.5 #C0000A0A0A3D000000000011010E329300045BE031D6E720#1226918373812#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.ctrl.ExecutionDialog.showWelcomeDialog(ExecutionDialog.java:421)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.ctrl.ExecutionDialog.showWelcomeDialog(ExecutionDialog.java:421)#Java###Could not process dialog because execution dialogs have been suppressed.#1#JspmWelcomeDialog#
    #1.5 #C0000A0A0A3D000000000012010E329300045BE031D6E720#1226918373812#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#Java###Starting execution of action with name and type .#2#Unit#JSPM#
    #1.5 #C0000A0A0A3D000000000013010E329300045BE032541218#1226918382015#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#Java###Starting execution of action with name and type .#2#Modul#JSPMPhases#
    #1.5 #C0000A0A0A3D000000000014010E329300045BE032541218#1226918382015#/System/Server/Upgrade/Jump##com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#######Thread[main,5,main]##0#0#Info#1#com.sap.sdt.ucp.pce.ctrl.ActionExecutor.execute(ActionExecutor.java:103)#Java###Starting execution of action with name and type .#2#Phase#JSPM_MAIN#
    #1.5 #C0000A0A0A3D000000000015010E329300045BE0333D02E8#1226918397281#/System/Server/Upgrade/Jump##com.sap.sdt.tools.model.AbstractDataModelElement.getClassByName(AbstractDataModelElement.java:743)#######Thread[main,5,main]##0#0#Error#1#com.sap.sdt.tools.model.AbstractDataModelElement.getClassByName(AbstractDataModelElement.java:743)#Java###Class with name com.sap.sdt.j2ee.model.NWDISystemRole not found.##
    #1.5 #C0000A0A0A3D000000000016010E329300045BE0333D3D80#1226918397296#/System/Server/Upgrade/Jump##com.sap.sdt.tools.model.DataModel.load(DataModel.java:89)#######Thread[main,5,main]##0#0#Error#1#com.sap.sdt.tools.model.DataModel.load(DataModel.java:89)#Java###Could not load data model com.sap.sdt.jspm.model.JspmDataModel. See previous messages.##

    Hi Patrick ,
    What user did you use to start JSPM? Was it <sid>adm? Also based on the error it seems there is something wrong with DataModel.xml JSPM uses. And you've mentioned it was copied from another system if I get it right.
    So as a quick workaround you could try removing:
    - Jspm.DataModel.xml
    - Jspm.J2EE.DataModel.xml
    - Jspm.JSPM.DataModel.xml
    from ../j2ee/JSPM/data/variables directory and give JSPM another try.
    Please make sure the rest of the XMLs are in place otherwise JSPM won't start.
    Regards,
    Vasil

  • Can some1 tell me abt sap data loader in hr..

    hi every1,
    can some 1 tell me abt sap data loader in hr..if u have some documentatiom it will be great. apart from lsmw,bapi,direct inputs,bdc what are the other ways of data conversions.. thanx in advance

    PL check this <a href="https://forums.sdn.sap.com/click.jspa?searchID=1350793&messageID=11323">thread</a>.
    ~Suresh

  • Sap bw 7.3 master data load error

    sap bw 7.3 master data load error
    erroe: Exception in Substep Rules

    Hi Jayram,
    I am assuming that you are getting this error when you are loading data from PSA to IO. If so, the error might be because of
    1. Duplicate records
    PSA might have duplicate records. But you will be able to load only one record to Master data IO. In DTP Update tab, there is an option for "Handle Duplicate Record Keys" . Just enable this & try to load again.
    2. Erroneous records.
    Some special reocrds are allowed in PSA where as thye might not be allowed in Master Data/Data Targets like Lower case letters/ some speacial characters etc. If error is because of this, then you might need to correct the data at PSA level & reload the data to Master data. Else get it corrected in source system itself & fetch the data to BW. Or write some code to take care of these special characters.
    Hope it helps!
    Regards,
    Pavan

Maybe you are looking for

  • Is it possible to have 2 trans with the same tcode but different langs

    Dear forum members, I would like to know if it is possible to have in the TSTCT table u2013 two entries with the same TCODE value but different SPRAS value (the language field) Thanks for your help, Roy

  • How do I command a single video track (with many clips) to an action?

    Hi, This is my first post in this forum, and I am a beginner on FCE. I want to take one of my video tracks and reduce the size to 1/4 and put it in the upper right corner of the screen. I want my screen split into 4 equal sections. My first track has

  • Is this SQL DELETE statement correct ?

    Hi Guys Is the following code correct: String strUpdate = "DELETE * FROM table_name"; Connection conn = DriverManager.getConnection("jdbc:mysql://localhost/newdb?user=root&password=123" ) ; Statement stmt = conn.createStatement() ; stmt.executeUpdate

  • Address parameters in the signature definitions (4.1)

    Is there any way to change the action triggered by the signature based upon the network/host source/destination address in all kinds of engines? In Atomic engine it is possible - for example triggering different levels of alarms, based upon the victi

  • My adobe cloud will not open, how do I fix this?

    I have tied to repair, uninstall and reinstall.  The most I have gotten is the window for the cloud to open showing the program is there but it does not open at all. How do I fix this on windows 7?