Tools to Auto load bulk data from SAP BW into Essbase?
Does any one know what is the most efficient way to retrieve a large amount of data from SAP BW into Essbase on a regular basis? We currenly export data from BW into several Excel files, which has the limitation of 64k row in a batch, we then load the excel files into essbase usng rules files. And it's a manual process. Do you know if there is a better tool/approach that we can use to do the data retrieve and load into essbase in one batch without need of human interference? Thanks for your good ideas!
you can use HAL to do the extraction and loading data from SAP. did you try this?
Similar Messages
-
How to load master data from SAP R/3 system like Customer master...........
How to load master data from SAP R/3 system like Customer master, materioal master , vendor master.............
Hi Bramha,
Check ...........
Re: master data loading in BI 7.0
/message/4708129#4708129 [original link is broken]
Re: Master data loading.
Regards,
Vijay. -
Loading Master Data from SAP R/3
Hi Friends.,
I'm going to load master data from SAP R/3 FI Modules to BW, but what do these objects mean by ?
0LOGSYS - Source System
0SOURSYSTEM - Source system ID
I'mn't understanding clearly, and also transfer rules aren't mapped properly.
can anybody clarify these things ?
Regards.,
Balaji K. ReddyHi Balaji,
You need to use these objects when your BW is feed by different source system and you want to map differences beetween Master and Transactional Data fed by the different systems (different R/3 - Flat File - Legacy Systems - ...).
If you do not have this situation you can avoid to use these objects (probably you find these objects in Tab compound of your MD).
Ciao.
Riccardo. -
How to load the data from excel file into table in oracle using UTL_FI
How to load the data from excel file into table in oracle
and from table to excel file
using UTL_FILE package
Please give me some exampleThis is something i tried in oracle apex
http://avdeo.com/2008/05/21/uploading-excel-sheet-using-oracle-application-express-apex/
Regards,
CKLP -
How to load the data from excel file into temprory table in Forms 11g?
Hi
How to Load the data from excel file(Extension is .CSV) into the temporary table of oracle in Forms11g.
My Forms Version is - Forms [64 Bit] Version 11.1.2.0.0 (Production)
Kindly Suggest the Solution.
Regards,
SachinDeclare
v_full_filename varchar2(500);
v_server_path varchar2(2000);
v_separator VARCHAR2(1);
v_filename VARCHAR2(400);
filename VARCHAR2 (100);
v_stop_load varchar2 (2000);
v_rec_error_log varchar2(4000);
v_error_log varchar2(4000);
ctr NUMBER (12);
cols NUMBER (2);
btn number;
RES BOOLEAN;
application ole2.obj_type;
workbooks ole2.obj_type;
workbook ole2.obj_type;
worksheets ole2.obj_type;
worksheet ole2.obj_type;
cell ole2.obj_type;
cellType ole2.OBJ_TYPE;
args ole2.obj_type;
PROCEDURE olearg
IS
args ole2.obj_type;
BEGIN
args := ole2.create_arglist;
ole2.add_arg (args, ctr);
ole2.add_arg (args, cols);
cell := ole2.get_obj_property (worksheet, 'Cells', args);
ole2.destroy_arglist (args);
END;
BEGIN
v_full_filename := client_get_file_name(directory_name => null
,file_name => null
,file_filter => 'Excel files (*.xls)|*.xls|'
||'Excel files (*.xlsx)|*.xlsx|'
,message => 'Choose Excel file'
,dialog_type => null
,select_file => null
If v_full_filename is not null Then
v_separator := WEBUTIL_CLIENTINFO.Get_file_Separator ;
v_filename := v_separator||v_full_filename ;
:LOAD_FILE_NAME := substr(v_filename,instr(v_filename,v_separator,-1) + 1);
RES := Webutil_File_Transfer.Client_To_AS(v_full_filename,"server_path"||substr(v_filename,instr(v_filename,v_separator,-1) + 1));
--Begin load data from EXCEL
BEGIN
filename := v_server_path||substr(v_filename,instr(v_filename,v_separator,-1) + 1); -- to pick the file
application := ole2.create_obj ('Excel.Application');
ole2.set_property (application, 'Visible', 'false');
workbooks := ole2.get_obj_property (application, 'Workbooks');
args := ole2.create_arglist;
ole2.add_arg (args, filename); -- file path and name
workbook := ole2.get_obj_property(workbooks,'Open',args);
ole2.destroy_arglist (args);
args := ole2.create_arglist;
ole2.add_arg (args, 'Sheet1');
worksheet := ole2.get_obj_property (workbook, 'Worksheets', args);
ole2.destroy_arglist (args);
ctr := 2; --row number
cols := 1; -- column number
go_block('xxx');
FIRST_RECORD;
LOOP
--Column 1 VALUE --------------------------------------------------------------------
olearg;
v_stop_load := ole2.get_char_property (cell, 'Text'); --cell value of the argument
:item1 := v_stop_load;
cols := cols + 1;
--Column 2 VALUE --------------------------------------------------------------------
olearg;
:item2 := ole2.get_char_property (cell, 'Text'); --cell value of the argument
cols := cols + 1;
--<and so on>
ole2.invoke (application, 'Quit');
ole2.RELEASE_OBJ (cell);
ole2.RELEASE_OBJ (worksheet);
ole2.RELEASE_OBJ (worksheets);
ole2.RELEASE_OBJ (workbook);
ole2.RELEASE_OBJ (workbooks);
ole2.RELEASE_OBJ (application);
END;
--End load data from EXCELPlease mark it as answered if you helped. -
BPC Error while loading master data from SAP BW
Hello Guru,
I have NW BPC 7.5 installed on BW server. Currently i have started to work on one application where i have to load master data first. I am loading master data for cost center.
I looked into the process chain "BPC: Import BW InfoObject master data" and i found that few processes are in GREEN color and few are in RED color (Display). is that correct or not ? then as per some of the thread i went to "BPC: Convert BW infoObject master data" --> SOURCE_TYPE = IP and added one parameter "FORMULA_FILE_NO". Then i saved this process chain and activated it.
I created transformation file in BPC and it got created successfully but while i try to load packages it throws me error.
Q. Do i need to have entire process chain with all processes in GREEN to have the master data in BPC ?
Q. Do i need to activate any BADI's for this or not ?
I appreciate your help in advance. I trieHello Guru,
Currently i am getting below error while loading costcenter master data from BW to BPC.
Task name MASTER DATA SOURCE:
Record count: 189
Task name TEXT SOURCE:
Record count: 189
Task name CONVERT:
No 1 Round:
Info provider is not available
Application: ZRB_SALES_CMB Package status: ERROR
Anybody can tell me, if i have missed anything ???
Regards,
BI NEW
Edited by: BI NEW on Feb 23, 2011 12:25 PM -
I need to BI Publisher to load the data from Disc worksheet into RTF
Can anyone help how to link the RTF and Data Source[Discoverer Worksheet] in BI Publisher.
Hi Rani,
You can also use the ALE IDOC method to load data from legacy to CRM system if you have some middlware tool(E.g. XI) in between. We have implemented this in our project where we were getting flat files from legacy, XI was converting the same into IDOC and the IDOC was sent to CRM where we read the IDOC data, populate the standard BAPI's or function modules to create the data in CRM.
You need to define an IDOC TYPE similar to the data structure on the legacy system. Maintain the ALE settings. Write the function module to validate and create data in the CRM system.
E.G. To create business partner SAP has provided BAPI_BUPA_CREATE_FROM_DATA bapi.
<b>Reward points if it helps.</b> -
Load the data from Legacy system into CRM
I'm new to CRM,I would like to know What is the procedure used to Load the data (ex: Business partners data ,Organization data,Sales data, etc.) from Legacy system into CRM system?
Can anyone explain me and send any documents,it would be very helpful.
I highly appreciate your help.
Thanks,
[email protected]Hi Rani,
You can also use the ALE IDOC method to load data from legacy to CRM system if you have some middlware tool(E.g. XI) in between. We have implemented this in our project where we were getting flat files from legacy, XI was converting the same into IDOC and the IDOC was sent to CRM where we read the IDOC data, populate the standard BAPI's or function modules to create the data in CRM.
You need to define an IDOC TYPE similar to the data structure on the legacy system. Maintain the ALE settings. Write the function module to validate and create data in the CRM system.
E.G. To create business partner SAP has provided BAPI_BUPA_CREATE_FROM_DATA bapi.
<b>Reward points if it helps.</b> -
Loading Data from multiple tables into essbase using ODI
Hi,
We have a scenario where data comes from multiple tables. I would like to know how will ODI load this data for the right combination of the membersHi,
I take it each data table has a field which maps to the other table. You can just drag the datastores on to the source interface and create a join between the tables.
Cheers
John
http://john-goodwin.blogspot.com/ -
Load XML-data from large file into plain table
We have to load data from an XML file to a relational table row by row.
The structure of the data is very simple:
<ROOT>
<repReport>
<KNZ>XY</KNZ>
<LA>test123</LA>
<Ident>AA20</Ident>
</repReport>
<repReport>
</repReport>
</ROOT>.
The table econtains the fields KNZ, LA, Ident, ...
If the file is small the following PL/SQL-code works fine:
CREATE OR REPLACE PROCEDURE Loadxml_Epd AS
fil BFILE ;
len INTEGER;
insrow INTEGER;
ctxHdl NUMBER;
buffer_c CLOB ;
amt NUMBER := dbms_lob.lobmaxsize;
src_offset NUMBER := 1 ;
dst_offset NUMBER := 1 ;
lang_ctx NUMBER := dbms_lob.default_lang_ctx;
warning NUMBER;
errNo NUMBER;
errMsg VARCHAR2(1999);
BEGIN
fil := BFILENAME('XML_DIR','200412MKBReport.xml');
DBMS_LOB.OPEN(fil, DBMS_LOB.LOB_READONLY);
len := DBMS_LOB.GETLENGTH(fil);
INSERT INTO INIT_CLOB(init) VALUES( EMPTY_CLOB())
RETURNING init INTO buffer_c;
dbms_lob.loadfromfile(buffer_c,fil, amt, dst_offset, src_offset);
ctxHdl := dbms_xmlsave.newContext ('SST_XML_EPD');
dbms_xmlsave.setRowTag (ctxHdl , 'repReport');
dbms_xmlsave.SetIgnoreCase(ctxHdl , 1);
dbms_xmlsave.SetSqlToXmlnameEscaping (ctxHdl , TRUE);
dbms_xmlsave.propagateOriginalException(ctxHdl , TRUE);
dbms_xmlsave.SetCommitBatch(ctxHdl , 1);
dbms_xmlsave.SetBatchSize(ctxHdl , 1);
insrow := DBMS_XMLSAVE.insertXML(ctxHdl,buffer_c);
DBMS_OUTPUT.PUT_LINE('Anzahl Sätze:' || TO_CHAR(insrow,'999999999'));
IF DBMS_LOB.ISOPEN(fil) = 1 THEN
DBMS_LOB.CLOSE(fil);
END IF;
EXCEPTION
WHEN OTHERS THEN
DBMS_OUTPUT.PUT_LINE(SQLCODE);
errMsg := SQLERRM;
DBMS_OUTPUT.PUT_LINE(SUBSTR(errMsg,1,2000));
IF DBMS_LOB.ISOPEN(fil) = 1 THEN
DBMS_LOB.CLOSE(fil);
END IF;
END;
But if the file is larger (50 MB in our case) this does not work. In various documents we found that we have to use another sort of XML-parser but we did not find any example how this is really done.
Does anybody have an example how to load this data that is as simple as our problem?We have to load data from an XML file to a relational table row by row.
The structure of the data is very simple:
<ROOT>
<repReport>
<KNZ>XY</KNZ>
<LA>test123</LA>
<Ident>AA20</Ident>
</repReport>
<repReport>
</repReport>
</ROOT>.
The table econtains the fields KNZ, LA, Ident, ...
If the file is small the following PL/SQL-code works fine:
CREATE OR REPLACE PROCEDURE Loadxml_Epd AS
fil BFILE ;
len INTEGER;
insrow INTEGER;
ctxHdl NUMBER;
buffer_c CLOB ;
amt NUMBER := dbms_lob.lobmaxsize;
src_offset NUMBER := 1 ;
dst_offset NUMBER := 1 ;
lang_ctx NUMBER := dbms_lob.default_lang_ctx;
warning NUMBER;
errNo NUMBER;
errMsg VARCHAR2(1999);
BEGIN
fil := BFILENAME('XML_DIR','200412MKBReport.xml');
DBMS_LOB.OPEN(fil, DBMS_LOB.LOB_READONLY);
len := DBMS_LOB.GETLENGTH(fil);
INSERT INTO INIT_CLOB(init) VALUES( EMPTY_CLOB())
RETURNING init INTO buffer_c;
dbms_lob.loadfromfile(buffer_c,fil, amt, dst_offset, src_offset);
ctxHdl := dbms_xmlsave.newContext ('SST_XML_EPD');
dbms_xmlsave.setRowTag (ctxHdl , 'repReport');
dbms_xmlsave.SetIgnoreCase(ctxHdl , 1);
dbms_xmlsave.SetSqlToXmlnameEscaping (ctxHdl , TRUE);
dbms_xmlsave.propagateOriginalException(ctxHdl , TRUE);
dbms_xmlsave.SetCommitBatch(ctxHdl , 1);
dbms_xmlsave.SetBatchSize(ctxHdl , 1);
insrow := DBMS_XMLSAVE.insertXML(ctxHdl,buffer_c);
DBMS_OUTPUT.PUT_LINE('Anzahl Sätze:' || TO_CHAR(insrow,'999999999'));
IF DBMS_LOB.ISOPEN(fil) = 1 THEN
DBMS_LOB.CLOSE(fil);
END IF;
EXCEPTION
WHEN OTHERS THEN
DBMS_OUTPUT.PUT_LINE(SQLCODE);
errMsg := SQLERRM;
DBMS_OUTPUT.PUT_LINE(SUBSTR(errMsg,1,2000));
IF DBMS_LOB.ISOPEN(fil) = 1 THEN
DBMS_LOB.CLOSE(fil);
END IF;
END;
But if the file is larger (50 MB in our case) this does not work. In various documents we found that we have to use another sort of XML-parser but we did not find any example how this is really done.
Does anybody have an example how to load this data that is as simple as our problem? -
How to updata data from SAP EP into SAP R/3 ?
Hi,
How to create the material from SAP CE 7.1 into SAP R/3. Is BAPI the only way for this or there is some other solution.
Also, please explain how to use BAPI in this scenario.
Regards,
Yogita.Please look into the following link
http://help.sap.com/saphelp_nw70/helpdata/en/19/4554426dd13555e10000000a1550b0/frameset.htm
Thanks,
Raju Bonagiri -
Loading of transaction data from SAP ECC system failed
Hi!
I successfully connected SAP ECC system to SAP BI system.
The following steps have been executed:
- user ALEREMOTE with max. authorization
- RFC destination
- Distributing Data model
- Generated Partner profile
- Maintaining message types in WE20
Now when I try to load any data from SAP ECC system the loading process in hanging in status "yellow" and never comletes.
[0FI_AR_4|http://www.file-upload.net/view-1447743/0FI_AR_4.jpg.html]
The following steps within Load process are yellow:
Extraction (messages): Missing messages
Missing message: Request received
Missing message: Number of sent records
Missing message: Selection completed
Transfer (IDocs and TRFC): Missing messages or warnings
Request IDoc : Application document posted (is green)
Data Package 1 : arrived in BW ; Processing : 2nd processing step not yet finished
Info IDoc 1 : sent, not arrived ; Data passed to port OK
Info IDoc 2 : sent, not arrived ; Data passed to port OK
Info IDoc 3 : sent, not arrived ; Data passed to port OK
Info IDoc 4 : sent, not arrived ; Data passed to port OK
Subseq. processing (messages) : Missing messages
Missing message: Subseq. processing completed
DataStore Activation (Change Log) : not yet activated
Question:
Can some one give me some technical steps (tcode, report) to solve this problem?
Thank you very much!
HolgerHi!
Many thanks for your answer.
Via BD87 on BW system I detect that all the IDOC's (type: RSRQST) will be received from SAP ECC system.
Via tcode SM58 I could not detect any entries.
However the loading status from yesterday is set to "red".
The errors are:
Extraction (messages): Missing messages
Data Package 1 : arrived in BW ; Processing : 2nd processing step not yet finished
Info IDoc 1 : sent, not arrived ; Data passed to port OK
Info IDoc 2 : sent, not arrived ; Data passed to port OK
Can you investigate my issue again?
Thank you very much! -
How to load data from SAP MDM to SAP BI/BW
Hi Guys,
I want to load master data from SAP MDM to SAP BI and would appreciate if some could provide me the step by step guide do the same. I found one of the document which talks about using generic DataSource "0MDM_Generic" but i dont find this datasource in BI content in my SAP BI 7.0 System.
Please let me know if some has already worked on this scenario and have any document.
Thanks,
AmitHi,
Pls chk this links;
MDM-BI Integration part 1 -
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/b03b4c55-e63d-2b10-e2a2-f8310c8e795f
MDM-BI Integration part 2 -
https://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/d0a6985b-fbbd-2b10-76a5-de0ed43f1a96
MDM-BI Integration part 3 -
https://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/f08b9892-fbbd-2b10-4093-b2c21dfb90a7
Regards,
CSM Reddy -
Loadind data from SAP ECC 6.0 system
Hi!
I am about to implement SAP Best Practices scenario "B34: Accounts Receivable Analysis".
Therefore I load the data from SAP ERP IDES system into SAP NetWeaver 2004s system.
My problems are:
when I try to load the transaction data for Infosources 0FI_AR_4 and 0FI_AR_6 from SAP ERP system the following happens:
the status is getting u201Cyellowu201D (194 from 0 records)
at the next day the status is getting u201Credu201D and I received the following error:
Errors while sending packages from OLTP to BI
Diagnosis
No IDocs could be sent to BI using RFC.
System Response
There are IDocs in the source system ALE outbox that did not arrive in the ALE inbox of BI.
Further analysis:
Check the TRFC log.
You can access this log using the wizard or the menu path "Environment -> Transact. RFC -> In source system".
Error handling:
If the TRFC is incorrect, check whether the source system is fully connected to BI. In particular, check the authorizations of the background user in the source system.
Comment:
I did not find any entries on "Environment -> Transact. RFC -> In source system"
The Source system connection EC6CLNT100 is OK
Can some one help me to solve this problem?
Thank you very much!
regardsJgen,
check the t-code BD87 in BW and see if there is any IDOC pending...try to manually execute them.
Its a connection issues as the IDOC's are not getting exchanged between the system.
may be you are running out of processes and your job is just waiting.
check the partner files as well in WE20 and see if everything is OK.
take the help of your SAP basis team as well.
Also check whether user ALEREMOTE exists in the source system in R/3 and give him all the authorization.
check if the authorization objects like S_RFC and B_ALE_REC are assigned to its role.
Also check if the authorization profile is S_BI-WX_RFC.
check this thread and check the ALEREMOTE part.
http://help.sap.com/erp2005_ehp_04/helpdata/DE/ab/4c69f832429f419fa6f216c83dccb0/content.htm
Ajeet -
How we will pull the data from Sap-Bi to sap-Bpc
Dear Experts,
Thanks for watching this thread.The whole data is available in SAP-BI.
My system environment is SAP-BPC MS7.5.
Now i want to load the data from Sap-Bi to Sap-Bpc ms.For that we need any Interfaces.
How we will pull the data from SAP-BI to BPC-MS for Master data and Transaction Data.
could you please provide me step by step guide.
Please guide me what should i do.
Regards,
Srinivasan.
Edited by: srinivasan.singari on Jul 22, 2011 8:20 AMTough Ask..
Because i have done dashboarding thru scritping (Dyanamic fashion tough) ..It is very good ..But when, coming to the one you asked i have the idea how it works but cannot really tell you wich would be better.
Each Route has its own limitations.That really depends on what exaclty your client is looking after..
So if you new to xcelsius and eager to learn ..I suggest you to give a go at all those..May be you can let me know wich is the best one..
1. QAWS,
2. Bex Query --> Crystal Reports --> Live office --> DashBoard.
3. Bex Query --> WebI --> Live Office --> Dashboard..
4. Webservices consuming BI Query,
5. Xcelsius SAP Netwever Connector.
But i suggest as of now use Xcelsius SAP netweaver Connnection...
Maybe you are looking for
-
Adobe Download Assistant Not Responding
When I go to download a trial, the download assistant popus up and brings me to the screen to accept or quit (this is the terms of service screen before the download). The download manager does not let me click accept and It will not close so I have
-
How to use microsoft speech sdk 5.1 in java application?
I download the speech sdk 5.1 from microsoft site,and want to use it in my java application,the following are the codes of the application(it uses boot.jar,swt.jar,jface.jar,runtime.jar,swt-win32-3101.dll) ,but gives me the exception,how should i do?
-
I have created a database in mysql 5 and I have also created a basic input record form. I am using Dreamweaver to create web pages, but I am having a little trouble with the date function. I am trying to figure out how to have "todays date" automatic
-
Renaming files with Automator & Apple Spript
Hi there! I need the help of an expert in Automator & Apple Spript.... I've got to rename 500 files with the following names: 001-001 firstfilename.jpg 104-095a otherfilename.jpg Any idea on how to get rid of the second number (that is 3 or 4 charact
-
I inadvertantly turn off file vault in Security & Privacy preferences. I want to turn it back on. I clicked on the Turn On FileVault and got a message to restart. I did that multiple times, an endless loop. What to do?