Performance concerns in upload flat file into SEM-BPS.

Hi,
we are using HOW-TO document to upload flatfile into SEM-BPS.
in the same exit function, we have a need to derive missing characteristic values from reference data.
So, we are reading reference data using API_SEMBPS_GETDATA.
upload is taking around 10 minutes in test systems. our concern is, if taking so long for test systems with less data , what about production time with more data?
from what all I can see is, most of the time is being consumed at reading reference data.
I'm dealing around 14000 records of reference data & around the same number of uploaded records. Initially, system status is, "number of cells to be formed : 33092" and then immediately after 5 seconds, status changes to, "formed cells : 33000" and this status stays for like 8 minutes.
I'm not using any input/output layouts but just exit planning function in the planning folder. So, I anticipate that above status is while reading reference data but not due to huge amounts of uploaded records.
When I ran the same exit funciton by commenting just the "reading reference data" code, upload function execution time came out as 2 minutes.
What is the best bet in dealing this scenario?
Usually, what is the best approch to read reference data / to derive missing characteristic values?
I couldn't able to use "Char Relationship using reference data" as it might not be suitable in my case. Even if suits, am missing enough documents/info/examples to deal "Char Relationship". Documentation on help.sap.com is not enough in this case.
PS: initially, when I tried to read 14000 records at detailed level, exit funciton returned no reference data & in the debugging mode, I could see a message "too many records".
Can a given layout read only a maximum of 9999 records / excel rows?
records are at CALMONTH level. As I don't need CALMONTH for derivation of characteristic values, I have deleted CALMONTH from " READ reference data" level to avoid the above message. Does this anyway relates to peformance?
Appreciate any help

Hello Hari,
it is touch to say what exactly causes this performance problem. Since you are dealing with custom coding (the how-to + your derivation logic), I suggest to do an ABAP trace (SE30) to see where the time is really spent.
The API call to read data should not take more than a few seconds. Test it separately by putting the API call into a simple ABAP program.
As Mary pointed out already, there's a 9999 line limit for layouts and therefore the GETDATA API as well.
Note: The file upload/download how-to solution was never meant for mass data loads. This needs to be done using regular BW functionality.
Regards
Marc
SAP NetWeaver RIG

Similar Messages

Problem in upload flat file into bw-bps using web browser

Hi All,
I have follwed the steps as per the how to guide to upload flat file,its seems to be fine but when try to upload by running the URL its giving error "Value of variable Data Slice Global ( ZFIE0ALL ) cannot be determined " and warning "Errors occurred when executing planning function TUPLOAD(EXIT FOR UPLOAD DATA)/T0000000(WEB UPLOAD".
Since i am new to BW/BPS , also let me know, how test it , when i run file_upload URL directly its giving follwing error.
SAP Note
     The following error text was processed in the system:
     An exception with the type CX_SY_REF_IS_INITIAL occurred, but was neither      handled locally, nor declared in a RAISING clause
When i run page1 url and if i file_load url, then its prompt me to see upload function, path for flat file. But when enter path of flat file and press upload function button ts giving error "Value of variable Data Slice Global ( ZFIE0ALL ) cannot be determined " and warning "Errors occurred when executing planning function TUPLOAD(EXIT FOR UPLOAD DATA)/T0000000(WEB UPLOAD".
FYI..i am using new design HTMLB option in how-to-doc.
Please help me to resolve this. Thanks in advance.
Also pls let me know can i debug this application?How ?
Vishal
Message was edited by:
        vishal kashyap
Message was edited by:
        vishal kashyap

Hi Vishal
Can u guide me , by what condition the data is selected in XTH_data ( Hashed table ) before the data is written by flat file function module .
Reply me ASAP ,
Thanks
Anup Singh

Problem in upload flat file into BW-BPS

Hi All,
I have created created to function modules, planning function, parameter group created new web interface using transaction BpS_WC and added new BSP page to the web interface in SE80. Everything seems to be fine but its not working, when try to run the genarated URl, its showing nothing just showing blank page.
Please help me to how to make it work to upload a flat file through webinterface. Thanks in advance.
Regards,
Vishal

Hi Vishal,
i hope you are using following How to paper
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/7f6dd590-0201-0010-bca8-b1bb91f6951b
We have implemented the same solution using above How to Paper and it is working fine for us.
Hope it will help you.
Regards
Tarun

Uregnt - How to Load Flat File into BW-BPS using Web Browser

Hello,
We have followed the 'How to Load Flat File into BW-BPS using Web Browser' guide to build BSP web front-end to upload flat file. Everything works great but we have a requirement to populate the Planning Area Variables based on BSP drop down list with values. Does anyone know how to do this? We have the BSP coded with drop down list all we need to do now is populate variables. We can populate the variables through the planning level (hardcoded) but we need to populate them through the web interface.
Thanks,
Gary

Hello Gary,
We have acheived the desired result by not too a clean method but it works for us.
What we have done is, we have the link to load file in a page where the variables can be input. The user would then have the option to choose the link to load a file for the layout in that page.
By entering the variable values in the page, we are able to read the variables for the file input directly in the load program.
Maybe this approach might help.
Sunil

Load a flat file into BW-BPS using SAP GUI

Hi,
We are using BW BPS 3.5 version, i implemented how to guide " How to load a flat file into BW-BPS using SAP GUI" successfully without any errors.
I inlcuded three infoobjects in the text file   costelemt, Posting period and amount. the same three infoobjects i inlcuded the file structure in the global data as specified in the how to document
The flat file format is like this
Costelmnt      Postingperiod         Amount
XXXXX             #
XXXXX             1                          100
XXXXX             2                           800
XXXXX             3                           700
XXXXX             4                           500
XXXXX             5                           300
XXXXX             6                           200
XXXXX             7                           270
XXXXX             8                           120
XXXXX             9                           145
XXXXX            10                           340
XXXXX            11                           147
XXXXX            12                           900
I successfully loaded above flat file in to BPS cube and it dispalyed in the layout also.
But users are requesting to load flatfile in the below format
Costelmnt        Annual(PP=#)   Jan(PP=1)   Feb(PP=2) ........................................Dec(PP=12)
XXXXX              Blank                       100           800                                                   900
Is it possible to load a flat file like this
They wants load a single row instead of 13 rows for each costelement
How to do this. Please suggest me if anybody accorss this requirment.
In the infocube we have got only one Info object 0FISCPER3(Posting period) and one 0AMOUNT(Amount)
do we need 13 Infobjects for each posting period and amount.
Is there any possiblity we can implement any user exit which we use in BEX Quer's
Please share your ideas on this.
Thanks in advance
Best regards
SS

Hi,
There are 2 ways to do this.
One is to change the structure of the cube to have 12 key figures for the 12 posting periods.
Another way is to write an ABAP Function Module to fetch the values from each record based on the posting period and store it in the cube for the corresponding characteristic. This way, you dont have to change the structure of the cube.
If this particular cube is not used anywhere else, I would suggest to change the structure itself.
Hope this helps.

How to load flat file into BW BPS

hi,
how to load flat file into BW BPS ?

Have a read through this;
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/com.sap.km.cm.docs/library/biw/g-i/how%20to%20load%20a%20flat%20file%20into%20bw-bps%20using%20a%20web%20browser.pdf

Load a Flat File into BW-BPS Using a Web Browser

I experienced the same. The appendizes are missing. Can anybody provide the information, which properties have to be set for the bsp application to upload data from flat file to bw-bps?
Does anybody know contact information of the author of the HowTo Marc Bernard ?

Hello Friedrich, Everyone,
the coding is included in a separate ZIP file that you can download from the how-to guide page here on SDN:
Business Intelligence How-to Guides for SAP NetWeaver 2004
There's a "Download attached system files (ZIP 13KB)" included at the end of the description. I think you can figure out the rest
Regards,
Marc
SAP NetWeaver RIG

How to load a flat file into BW-BPS using Web Browser

Hello, i have a problem with the "How to do Paper". I want to upload a Excel CSV file , but the paper only describes a txt file Uplaod. Does anybody can help me ?Thanks !

You need to parse the line coming in from the flat file...
You can do this with generic types in your flat file structure (string).
Then you loop through the table of strings that is your flat file and parse the string so that it breaks up the line for each comma. There is an ABAP command called: SPLIT - syntax is as follows:
SPLIT dobj AT sep INTO
{ {result1 result2 ...} | {TABLE result_tab} }
[IN {BYTE|CHARACTER} MODE].
Regards,
Zane

How to Load a Flat File into BW-BPS Using a Web Browser

Hello,
I'm using the upload functionality described in the how to guide.
When we want to have this functionality available for 12 different Planning levels. Do I have to create the Web Interface (as described in the how to guide) for each Planning Level separately, or can i pass a parameter in the URL (wenn calling the File Upload functionality) to determine which Planning level and Function it is.
This pice of coding i want to have a bit more flexible
*Execute planning function
CALL FUNCTION 'API_SEMBPS_FUNCTION_EXECUTE'
 EXPORTING
 i_area = 'ZIPM0001' " <<<< ADJUST
 i_plevel = 'ZCAPB006' " <<<< ADJUST
 i_package = '0-ADHOC' " <<<< ADJUST
 i_function = 'ZEX00001' " <<<< ADJUST
 i_param = 'Z0000001' " <<<< ADJUST
 IMPORTING
 e_subrc = l_subrc
 TABLES
 etk_return = lt_bapiret.
Does someone have an idea ?
Thank you
Dieter

Hi Dieter,
you should be able to grab the variable value by the following statement (e.g. in this case 'area' is being passed along, works for whatever you want to send) is:
data: l_area type upc_y_area.
l_area = request->get_form_field( 'area' ).
in this case the calling URL looks like:
<normal URL>?area=example_area
example_area will then contain your value.
Then depending on the value execute your different SEM functions
Note that if you want to load different flatfile formats, more has to change in the functions as indicated in the white paper,
Hope it helps,
Regards,
MArc
I got it from the following document I found on SAPNet or SDN (forgot..) some time back:
How To Call a BPS Web Interface with Predefined Selections

Load Flat File into BW-BPS using a Web Browser....

Hallo,
I am trying to implement the titled How To with some modifications. I am trying to read the uploaded data in the extension class of the Web Interface. The details are as follows:
Modification 1) - Instead of using the standard submit button for triggering the File upload process, I used custom <htmlb:fileUpload> component coding as follows
<input type="file"
 class="urUpld1"
 id="htmlbfileUpload3b"
 ct="FileUpload"
 name="htmlbfileUpload3b"
 size="40"
 value="">

<a href="javascript:void(0);"
 onclick="if(!sapUrMapi_Button_checkClick('htmlbfileUpload3b_upload',event)){
 return true;};
htmlbSubmitLib('htmlb',this,'htmlb:button:click:null::CL_HTMLB_FILEUPLOAD::x','htmlb_form_1','htmlbfileUpload3b_upload','HandleUpload',0); return false" onkeypress="if(!sapUrMapi_Button_checkClick('htmlbfileUpload3b_upload',event)){
 return true;};
htmlbSubmitLib('htmlb',this,'htmlb:button:click:null::CL_HTMLB_FILEUPLOAD::x','htmlb_form_1','htmlbfileUpload3b_upload','HandleUpload',0);
 return false"
 class="urBtnStd1 urV"
 id="htmlbfileUpload3b_upload"
 ct="Button"
 style="white-space:nowrap;">
size=40</a>
I am able to identify/capture the event "Upload" in my extension class (When the user presses upload the button after choosing a file)
Observation 1) The Attribute Request of the extension class "mr_request" does not return a valid entity object from which I could query the data that was uploaded.
In other words, the method
get_multipart( 1 )
which should return a valid Entity Object fails and the entity object remains unbound (
num_multiparts( )
return 0 ).
Question 1 Has anybody tried to implement the How To with such kind of modifications?
Question 2 If yes how was the approach?
Question 3 Returning to my approach, perhaps could anybody (Marc) suggest me how to read the data (Please note that it should be done inside the extension class!

Hi RPR,
the how-to paper does not work with the new HTMLB design of BPS web interfaces. I have updated the how-to. It will be uploaded shortly.
Regards,
Marc
SAP NetWeaver RIG

Using Web Upload for Flat File in BW-BPS 3.5 Stack 13

Hi,
I am attempting to implement the "How To Guide Load a Flat File into BW-BPS Using a Web Browser" (the 7/2005 version). However, certain BSP files named in the How to Guide, such as "JS.htm" and "checkbrowser.htm" do not exist in my generated BSP application. We are on BW-BPS version 3.5 Stack 13. Is this guide compatible with this BW version?
Thanks,
Cynara
(Note: I have already attempted to correct the incompatibilities by changing the statement <%@include file="js.htm" %> to <%@include file="JS3.htm" %> and eliminating the code <%@include file="checkbrowser.htm" %>. However, I still get the JS3.htm error "field R_PAGE is unknown".)

Hi Cynara,
I try to do the same.
I left out those both lines and also the line concerning the style.
<link type="text/css" href="<%= cstyle %>" rel="stylesheet">
The upload worked then so far except that no data was written into the cube. Even if I press save button nothing happens.
Any ideas?
Regards,
Juergen

Upload [Flat File]

Hi I'm using oracle apps R12..
in oracle apps R12 is there any possibility to upload flat file into oracle apps? from client side?
plzz help

Hi,
IINM, DataLoad can be used for free (Basic version). If you do not want to use this tool, you could use WebADI instead of ADI (as you are on R12).
Build Custom WebADI Integrators with EBS 12.1.2 Desktop Integration Framework
http://blogs.oracle.com/stevenChan/2010/02/webadi_dif_ebs.html
Useful Web ADI custom integrators docs
Useful Web ADI custom integrators docs
Oracle Web Applications Desktop Integrator Implementation and Administration Guide
http://download.oracle.com/docs/cd/B53825_03/current/acrobat/121bneig.pdf
Thanks,
Hussein

Uploading the data from a flat file into ztable

Hi,
I have a requirement where I have to upload the data from 2 flat files into 2 z tables(ZRB_HDR,ZRB_ITM).From the 1st flat file only data for few fields have to be uploaded into ztable(ZRB_HRD) .Fromthe 2nd flat file data for all the fields have to me uploaded into ztable(ZRB_ITM). How can I do this?
Regards,
Hema

hi,
declare two internal table with structur of your tables.
your flat files should be .txt files.
now make use of GUI_UPLOAD function module to upload your flatfile into internal tables.
CALL FUNCTION 'GUI_UPLOAD'
    EXPORTING
      filename            = 'c:\file1.txt'
      has_field_separator = 'X'
    TABLES
      data_tab            = itab1
    EXCEPTIONS
      OTHERS              = 1.
use this function twice for two tables.
then loop them individually and make use of insert command.

To upload a flat file into BW using a variable entry in web application

hi guys,
how to upload a flat file into the web browser using a
a variable entry in the wad application.
Thanks,
your help will be duly appreciated
Message was edited by:
Vj.R T

thanks arun
but is it not possible to load the flat file at bex level which
might be the same at wad level
and also what do you mean the load package
triggered from the backend and how do i
manipulate the data is it at bex level or wad level
please elaborate.
thanks
your help will be rightly acknowledged.

How to upload a Flat file into sap database if the file is in Appl'n Server

Hello Sap Experts , Can you tel me
" How to upload a Flat file into sap database if the file is in Application Server.
what is Path for that ?
Plz Tel Me its Urgent
Thanks for all

Hi,
ABAP code for uploading a TAB delimited file into an internal table. See code below for structures.
*& Report ZUPLOADTAB                                                  *
*& Example of Uploading tab delimited file                             *
REPORT zuploadtab                    .
PARAMETERS: p_infile LIKE rlgrap-filename
                        OBLIGATORY DEFAULT '/usr/sap/'..
DATA: ld_file LIKE rlgrap-filename.
*Internal tabe to store upload data
TYPES: BEGIN OF t_record,
    name1 like pa0002-VORNA,
    name2 like pa0002-name2,
    age   type i,
    END OF t_record.
DATA: it_record TYPE STANDARD TABLE OF t_record INITIAL SIZE 0,
      wa_record TYPE t_record.
*Text version of data table
TYPES: begin of t_uploadtxt,
name1(10) type c,
name2(15) type c,
age(5) type c,
end of t_uploadtxt.
DATA: wa_uploadtxt TYPE t_uploadtxt.
*String value to data in initially.
DATA: wa_string(255) type c.
constants: con_tab TYPE x VALUE '09'.
*If you have Unicode check active in program attributes then you will
*need to declare constants as follows:
*class cl_abap_char_utilities definition load.
*constants:
*    con_tab type c value cl_abap_char_utilities=>HORIZONTAL_TAB.
*START-OF-SELECTION
START-OF-SELECTION.
ld_file = p_infile.
OPEN DATASET ld_file FOR INPUT IN TEXT MODE ENCODING DEFAULT.
IF sy-subrc NE 0.
ELSE.
DO.
    CLEAR: wa_string, wa_uploadtxt.
    READ DATASET ld_file INTO wa_string.
    IF sy-subrc NE 0.
      EXIT.
    ELSE.
      SPLIT wa_string AT con_tab INTO wa_uploadtxt-name1
                                      wa_uploadtxt-name2
                                      wa_uploadtxt-age.
      MOVE-CORRESPONDING wa_uploadtxt TO wa_upload.
      APPEND wa_upload TO it_record.
    ENDIF.
ENDDO.
CLOSE DATASET ld_file.
ENDIF.
*END-OF-SELECTION
END-OF-SELECTION.
*!! Text data is now contained within the internal table IT_RECORD
* Display report data for illustration purposes
loop at it_record into wa_record.
    write:/     sy-vline,
           (10) wa_record-name1, sy-vline,
           (10) wa_record-name2, sy-vline,
           (10) wa_record-age, sy-vline.
endloop.

Performance concerns in upload flat file into SEM-BPS.

Similar Messages

Maybe you are looking for