BPC 7.5 - Data Manager filling tablespace

We are installing a brand new BPC for NW 7.5 SP4 system.  When trying to import data from .txt files via the data manager, the system is generating /1CPMB/DM0000xxx (example /1CPMB/DM0000001) tables.  The problem is these tables are being generated with a size category of 9.  This defaults to a next extent of 320MB.  This is on an Oracle-based backend BI 701 system with Dictionary-based tablespace.
If you only upload 1-2 records, then it falls under the initial extent of 16KB.  But if you upload enough records to get past that initial extent, then it will blow up and take up 320MB of space, most of it being wasted.
We've engaged SAP Support and thus far they have not been able to provide a means to have these tables generated with a lower size category, such as 1, or any other work-around to this issue.
Initially, we were trying to load 60-100 smaller datafiles.  But seeing how BPC is dealing with them by wasting so much space, we are looking at combining the number of files to a smaller number.  If not, you could theoretically try to take up 32TB of space.
We can reorg the tables after the fact, but that doesn't help the newly generated tables every time we upload a file using data manager.
1) Login to BPC for Netweaver website
2) Go into the excel portion
3) log into the applicationset
4) click on edata at the top of the screen
5) select upload data file
6) enter source and target locations. the file is a .txt file (40KB in
size)
7) click OK to start the
upload
*error*
Any thoughts?

Further digging, the tables are hardcoded by SAP code to default to a size category of 9...
class:
CL_UJF_FILE_SERVICE_MGR
  METHOD upload_document_dm.
    TRY .
        lo_file_service_mgr->put_document_data_mgr(
                    EXPORTING i_docname     = lv_docname
                              i_append      = lv_append
                              i_doc_content = lt_content
                              i_content_delivery = im_is_cd ).
      CATCH cx_ujf_file_service_error INTO lo_exception.
        imess = convert_ex_to_message( lo_exception ).
        IF imess IS NOT INITIAL.
          READ TABLE imess INTO xmess INDEX 1.
          MESSAGE e001(00) WITH xmess-message.
        ENDIF.
    ENDTRY.
method:
PUT_DOCUMENT_DATA_MGR
If document is found, that means that there is probably
a database table already created,
  CASE me->is_document_found( ).
    WHEN abap_true.
      lv_tabname = me->ds_document-doc_content_db.
    WHEN abap_false.
Check if this call is for content delivery, if so, then generate the table using
a different name space, otherwise use the default naming  for data manager files.
      CASE i_content_delivery.
        WHEN abap_false.
          lv_tabname = do_file_service_dao->generate_doc_content_table( i_namespace = 'DM' ).
        WHEN abap_true.
          lv_tabname = do_file_service_dao->generate_doc_content_table( i_namespace = 'CD' ).
      ENDCASE.
  ENDCASE.
method:
generate_doc_content_table
Add header and technical settings
  CLEAR ls_dd02v.
  ls_dd02v-tabname    = lv_tabname.
  ls_dd02v-ddtext     = lv_ddtext.
  ls_dd02v-ddlanguage = sy-langu.
  ls_dd02v-tabclass   = 'TRANSP'.
  ls_dd02v-contflag   = 'A'.
  ls_dd02v-exclass    = '1'.
  CLEAR ls_dd09v.
  ls_dd09v-tabkat     = '9'.
  ls_dd09v-tabart     = 'APPL1'.
  ls_dd09v-pufferung  = space.
  ls_dd09v-bufallow   = space.

Similar Messages

  • NEW TO SAP BPC - Advice on Data Management Packages

    Hi,
    I am an experienced Microsoft BI User, but am new to SAP BPC.
    I am working on a project that has required me to create custom SSIS packages for my client. To date my packages transform / cleanse and format the source into a clean CSV file, that requires no further intervention from the user, other than to use the standard SAP BPC Import Routine, with a simple Transformation file.
    In order to fully automate the process, I would like my Custom package to automatically invoke the Standard import package without any user based intervention.
    Can anyone advise on this?
    I have considered writing further logic in my custom package that would completely bypass SAP BPC Data Manager, and insert the information direclty into the Fact Tables, taking into consideration any members that don't exist in the Dimensions. However, I would prefer not to go down this route unless absolutely necessary.
    Can anyone point me in the right direction, so that I can call a clear routine from within my custom package, that would invoke a SAP BPC package /task to clear certain data from the fact table, and then call another Package / task that would update the Fact table based on a fully prepared csv file.
    Many thanks

    You could modify your custom package to perform all the steps thru BPC import and have the user initiate the Package from the BPC Data Manager.  You would just need to add a MODIFYSCRIPT variable (see the standard IMPORT package as an example) and add the BPC tasks required to Convert/Load that data your package already prepares.
    I have had prior success having a custom package initiated from within the BPC Data Manager extract data from an external data source (ie: Oracle), use user provided runtime input to customize data extraction parameters, manipulate the extracted data, and import it into BPC.
    Unfortunately I've never attempted to initiate a BPC task without the package being initiated from within BPC.  But I would surmise that if you provide the proper values for the individual BPC Tasks (ie: Convert and Load) required properties (ie: AppSet, App, User,...), I cannot think why it would not work.

  • Automate  Data Manager - for particular infocube in BW

    Experts,
    How to run process chain /CPMB/LOAD_INFOPROVIDER in the RSPC and hard code it to certain Infocube in BW.
    OR
    is there a process type which loads data from BW cube to BPC cube using data manager and NOT switching the cubes?
    I see that we can use program UJD_TEST_PACKAGE to automate ,but my DM is not running.
    I gave the answer prompts below ,can u please let me know if it is correct or the right syntax and method ?
    also does the userid need to be SYSTEM userid ?
    %InforProvide%     ZCUBENAME     
    %TRANSFORMATION%     \ROOT\WEBFOLDERS\APPSET\APPLICATION\DATAMANAGER\TRANSFORMATIONFILES\Load BW data.xls     
    %CLEARDATA%     0     
    %RUNLOGIC%     0     
    %CHECKLCK%     0
    EHP 1 for SAP NetWeaver 7.0
    CPMBPC 7.5 LEVEL 8
    Thanks
    Thanks

    Hi,
    Create a package link .While defining the package link you can make cube name as set prompt.
    Sorry...my understanding is wrong!
    Hope it helps...
    regards,
    Raju
    Edited by: VaraPrasadraju Potturi on Nov 11, 2011 9:06 AM

  • Data Manager Package Launch from BPF Error

    Hi experts,
    In some client PCs, after installing BPC for Excel, Data Manager shows Icon aspect (instead of package list aspects like the rest of PCs).
    Our main problem is on BPF "Run Package" Link: BPC returns a "user non-authorised" error, and User need to run package from DM manually.
    Any idea?
    Regards

    Hey Pablo
    Can you replicate the error on the same machine, using a user that doesnt experience this error. (basically, you want to establish if it is client or machine issue or a user task security issue ?)
    The user which is executing the BPF, is that user in the reviewer or owner property in your entity dimension?
    What task profile does the user have?
    Kind Regards
    Daniel

  • How to set a variable value on the BPC Data Manager

    Hello BPC Experts,
    I'm creating a BPC10 NW version demo environment for our prospect customer.
    I made a data manager to import  BW data into BPC model from BW cube.
    I need to import just one month data into BPC from the BW cube that has more than one month data.
    When I run the data package manually, I can select a member of the time dimension prompt and I can import specific month data I want.
    But, in a case where the program (data manager) runs by JOB monthly,
    I can't select a member of the time dimension prompt manually.
    So I want to know how to set a  variable value to the time dimension prompt from a system date etc. automatically.
    Are there any way to set a variable value to the time dimension prompt on the data manager automatically from a system date?
    Or, do you have any other solution to import just one month data into BPC from the BW cube that has more than one month data  by the data manager running on JOB ?
    (without selecting a member of the time dimension prompt of the data package manually)
    Thanks in advance,
    Keisuke

    Hi Gersh
    Sorry for my late reply and thanks for your helpful information.
    I tried the second way of your information and I could configure it.  
    And I 'll try first way of your information.
    Regards,
    Keisuke

  • Data Manager not available in the BPC 7.0 Action Pane

    Hi,
    I have just installed BPC 7.0 and everything is working fine, except I don't have access to the Data Manager.
    According to the BPC guide, this is how to start Data Manager:
    1. Click the Business Planning and Consolidation icon on your desktop.
    2. From the Business Planning and Consolidation launch page, select Business Planning and Consolidation for Excel.
    3. From the Getting Started - BPC for Excel action pane, select Manage Data.
    I don't have "Manage Data" as an option in the Action Pane. The options I have under Available Task Categories are: "Reporting & Analysis", "Journals" and "Open System Reports".
    I also do not have a menu called eData.
    Any ideas on what I can do?
    Thanks,
    Sam

    Please check your task profile....
    Make sure you  have all task profile related to data manager....do let us know if youstill face this problem

  • Receiving error in BPC Data Manager while running Export package.

    We are in a multi server environment and receiving below error message while running Export package.
    Have anyone seen below error message in BPC 5.1
    An error occurred while executing a package.
    Package Error Events:
    ErrorCode = -1073668060
    Source = Dump Data
    SubComponent=
    Description = The task "Dump Data" cannot run on this edition of Integration Services. It requires a higher level edition.
    IDOfInterfaceWithError= {8BDFE889-E9D8-4D23-9739-DA807BCDC2AC}
    Thanks
    Sridhar

    Below are our BPC versions:
    BPC on Server Manager: 5.0.486
    Data Manager from eData: 5.0.484
    BPC from eTool: 5.0.486
    Below is the total error message as per your suggestion to run Export package. (even with service account which we used to install the software we are getting same error message.)
    TOTAL STEPS  2
    1. Dump Data:     Failed  in 0 sec.
    [Selection]
    FILE=\ApShell_SK\FINANCE\DataManager\DataFiles\SKTEST.TXT
    TRANSFORMATION=\ApShell_SK\FINANCE\DataManager\TransformationFiles\System Files\Export.xls
    MEASURENAME=PERIODIC
    (Member Selection)
    Category: ACTUAL
    Time: 2006.JAN
    Entity:
    Account:
    DataSrc:
    IntCo:
    RptCurrency: 
    [Messages]
    An error occurred while executing a package.
    Package Error Events:
    ErrorCode = -1073668060
    Source = Dump Data
    SubComponent=
    Description = The task "Dump Data" cannot run on this edition of Integration Services. It requires a higher level edition.
    IDOfInterfaceWithError= {8BDFE889-E9D8-4D23-9739-DA807BCDC2AC}

  • SSIS Environmental Variables not working in BPC 7.5(MS) Data Manager

    Hi,
    We have an SSIS 2008 package that is retrieving variable values from Environmental Variables.  The package runs successfully when executed from DTExec, but fails when executing from a BPC 7.5(MS) Data Manager package.  Looking through logs we've been able to pinpoint the issue.  The issue is that the SSIS package is unable to retrieve variable values from Environmental Variables when running from Data Manager packages.  We tried using XML Configuration files to store variable values, but this did not work either when running the SSIS package from Data Manager.  Has anyone seen this before?  If so, what was the solution to resolving the issue?
    Thanks,
    Glenn Van Der Werff

    Hi Glenn,
    Can you set package variables in Data Manager script as a workaround?
    For example, here is how we set connection string:
    GLOBAL(DRILL_CN_STRING,Data Source=%SQLSERVER%;Initial Catalog=%DRILL_DB%;Provider=SQLOLEDB.1;Integrated Security=SSPI;Application Name=SSIS-BPC_Incremental_Oracle;Auto Translate=False;)
    DRILL_CN_STRING is a variable in our package and %<Parameter Name>% are parameters for that connection string.
    Regarding Env Variables and XML... there could be security related and/or Package ProtectionLevel issue when BPC system account.
    Hope that helps,
    Akim

  • BPC 7.5 NW -- Data Manager Import Fails When Loading 40,000 Records?

    Hi Experts,
    Can't believe I'm posting this because the Data Manager component has always been one of the best parts of BPC.  But, since we got SP04 applied last week, every IMPORT process that I've run that has more than 40,000 records fails out.
    The result logs show that the CONVERT task completes just fine, but it doesn't really show the LOAD task.  ...Not exactly sure what's going on here.  So far I've also taken the following two steps to try for resolution:
    (1.)  Re-added the IMPORT package in Organize Package List from the Library to have a "fresh" version.  Didn't help.
    (2.)  In the "Modify Package" screens, there is a PACKAGESIZE parameter that is 40,0000 by default...  I've been able to locate that in BI using transaction RSA1 and have changed it to 10,000,000.  Saved it.  Tried it.  Didn't help either
    Has anyone seen this kind of behavior before?
    Thanks,
    Garrett

    Update -- This problem may now be resolved.
    I have been able to conduct test IMPORTs of 48,000, then 96,000 and then 1.7 million records.  All were fine.
    It turns out that that difference is that the text files were sorted by amount in the ones that failed.  They were sorted by GLAccount in column A for the ones that succeeded.
    Edit:  Yep, all files loaded normally when re-sorted by GLACCOUNT, etc. on the left-hand side.  Apparently, when you're doing a lot of records that might confuse the system or something
    Edited by: Garrett Tedeman on Nov 18, 2010 11:41 AM

  • BPC NW 10.0 - Data Manager Prompt changing from SELECTINPUT to SELECT cleared values

    Dear BPC Experts,
    We recently went from SP13 patch 4 to SP19 patch 1.  When we made changes in the PROMPT values in the Data Manager Organize>Package>Modify Script>PROMPT, we experienced different behavior switching from SELECTINPUT to SELECT in our development system than we did in our production environment.  In development, when we changed the value from SELECTINPUT to SELECT, the values entered for Variable name such as %SELECTION% in Property1 and "Select the members to CLEAR" in Property2, and %DIMS% remained.  However, when we changed from SELECTINPUT to SELECT in production system, the values for Variable Names and Properties were cleared out.  Does anyone know why in our developmet system values were kept but not in our production system during this type of activity?  I would like to understand the two different behaviors and what controlled it.  We prefer not to have the values for Properties clear.
    Thank you in advance for your assistance.
    Kind regards,
    Lisa

    Hi Vadim,
    Excellent point, I should have included images as that likely would have shown this odd behavior.
    When I made the changes in our development system to a package to switch from SELECTINPUT to SELECT the values outlined in the image below were retained for Varialbe Name, Property 2, and Property 3 after we applied the SP19 patch 1.
    When I made the same change in our system to a package in our production system after we applied the SP19 patch 1, the values for Varialbe Name, Property 2, and Property 3 were cleared per the image below.  The odd thing is that initially it looked like the values stayed.  It was only after you saved and went back in did you see that the values were gone.
    Any help in understanding this behavior change would be greatly appreciated.
    Thank you,
    Lisa

  • Email BPC data manager Package log to a team for BPC10 NW

    Hi iI found documentation on how to send Data manager package by email. Contained 2 transports but the documentation is for 7.0 NW do you know if they have a documentation for BPC 10 NW ?

    Hi Frederic,
    Please check the below documnet.
    How to Email BPC Data Manager- Formula Log or Package Log
    Thanks,
    Dinesh.v

  • Data Manager Package Error in SAP BPC 10

    Hi All,
    I am getting below error message while running the Data manager package /CPMB/LOAD_INFOPROVIDER in SAP BPC 10. Screenshot is attached for your reference. Please help in solving this issue.
    Thanks & Regards,
    Ramesh.

    Hi Vadim,
    Please find the Advanced DM Script of Copy Package.
    PROMPT(RADIOBUTTON,%TARGETMODE%,"Handling of records",0,{"Copy records with match key","Copy by replacing data in same data region of Entity, Category, Time and Audit ID"},{"0","2"})
    PROMPT(RADIOBUTTON,%CHECKLCK%,"Select whether to check work status settings when importing data.",1,{"Yes, check for work status settings before importing","No, do not check work status settings"},{"1","0"})
    PROMPT(COPYMOVEINPUT,%SELECTION%,%TOSELECTION%,"Select the members to COPY and where to",%DIMS%,0)
    INFO(%TEMPNO1%,%INCREASENO%)
    INFO(%ACTNO%,%INCREASENO%)
    TASK(/CPMB/CM_CONVERT,OUTPUTNO,%TEMPNO1%)
    TASK(/CPMB/CM_CONVERT,ACT_FILE_NO,%ACTNO%)
    TASK(/CPMB/CM_CONVERT,SAPPSET,%APPSET%)
    TASK(/CPMB/CM_CONVERT,SAPP,%APP%)
    TASK(/CPMB/CM_CONVERT,SELECTION,%SELECTION%)
    TASK(/CPMB/CM_CONVERT,TOSELECTION,%TOSELECTION%)
    TASK(/CPMB/CM_CONVERT,KEYDATE,%SELECTION_KEYDATE%)
    TASK(/CPMB/CLEAR_SOURCE_CUBE,CHECKLCK,%CHECKLCK%)
    TASK(/CPMB/CLEAR_SOURCE_CUBE,SELECTION,%TOSELECTION%)
    TASK(/CPMB/CLEAR_SOURCE_CUBE,KEYDATE,%SELECTION_KEYDATE%)
    TASK(/CPMB/CLEAR_SOURCE_CUBE,DUMPLOADMODE,3)
    TASK(/CPMB/APPEND_LOAD,PREPROCESSMODE,0)
    TASK(/CPMB/APPEND_LOAD,TARGETMODE,%TARGETMODE%)
    TASK(/CPMB/APPEND_LOAD,INPUTNO,%TEMPNO1%)
    TASK(/CPMB/APPEND_LOAD,ACT_FILE_NO,%ACTNO%)
    TASK(/CPMB/APPEND_LOAD,RUNLOGIC,%RUNLOGIC%)
    TASK(/CPMB/APPEND_LOAD,CHECKLCK,%CHECKLCK%)
    TASK(/CPMB/APPEND_LOAD,KEYDATE,%SELECTION_KEYDATE%)
    Thanks & Regards,
    Ramesh.

  • BPC NW - Cannot run Data Manager

    Hello,
    I have recently installed the NW version of BPC in my computer, but looks the installation does not come to the right end, as I can not run all the components.
    When I access the Data Manager menu, the corresponding toolbar is not installed and I have encountered the following failure scenarios when trying to access the standard menu:
    1. I get a blank message when clicking on Data Manage option, whichs leads into the Data Manager Menu.
    2. when clicking on the Upload data file option, it allows to select the source of the data, but I do not get any response for the destination of the file
    3. When accessing the Run a data management package, I get a visual basic error:
    "Run-time error 91; Object Variable or WIth Block variable not set"
    4. in other options of the standard menu, I also get several error messages which do not allow to work with this menu, so data cannot be loaded into any application.
    I recently installed (and uninstalled) the SQL version of BPC and was working OK; however, with the NW version it does not seem to be working properly.
    I have unistalled and installed several times following the recommendations (as detailed below), but still have not succeeded.
    Client Machine:
    1. Uninstalled BPC for Office and BPC Administration.
    2. Deleted C:\Documents and Settings\username\My Documents\OutlookSoft folder
    3. Deleted C:\Program Files\BPC folder
    4. Removed the OUTLOOKSOFT entry from the registry. Start Menu \ Run \ cmd \ regedit. Delete the HKEY_LOCAL_MACHINE\SOFTWARE\OUTLOOKSOFT folder.
    5. Reboot PC.
    We have also checked for note 1098742, but once installed and re-installed BPC NW it stills displays the same error message.
    I have also tried note 1108598, but looks to be relevant for MS version only, and all the components are already available in my computer.
    Has anyone encountered a similar problem?
    Thanks in advance.
    Kind regards
    Begonia

    Hi
    We having the same issue of "RUN-TIME ERROR - Invalid Key" and still cannot find solution. And the other visual basic runtime error encountered along with the above mentioned is:
    Automation error: The callee (Server application) not available and disappeared, all connections are invalid.
    Do post any solution discovered.
    Thanks,
    Oscar

  • Data manager option to Append  or Add NW Infocube values to BPC CUBE.

    HI ,
    Merge and Replace optios are just to replace old values with new values. but my requirement is to add new values to old values. Data is available in BW infocube and we need to add values to BPC cube . please suggest is there any option i can use in data manager.
    thanks,
    Bala.

    Hi,
    Currently, the append option is not available while loading the BW data to BPC.
    The option I see is to extract the BW data to a flat file and then upload this file in the append mode.
    Hope this helps.
    Edited by: nilanjan chatterjee on Aug 10, 2011 11:06 AM

  • BPC 7.5 NW -- Data Manager Export:  Fixed-Length Fields?

    Hi Experts,
    Client has a requirement that we export a batch of transaction data from BPC, which is generally no problem, but in this case they want to do it with Fixed-Length fields in the Export file.
    I've done a lot of BPC Data Manager Imports with Fixed-Length fields, and that function really works well.  But, has anyone tried to use the Export package with this option?  It doesn't seem to be working in my case yet.
    Any tips?
    Thanks so much, as always,
    Garrett
    =======================
    Update -- After going back to review documentation, it looks like the the *PAD() function is actually intended for export not really importing, which makes sense.  ...The SAP online help library says that it's meant for import, but I now believe that is a typo.
    Also, I've added the line "OUTPUTFORMAT = NORMAL" in my *OPTIONS section.  Anyone else manage to get export working on BPC 7.5 NW
    Edited by: Garrett Tedeman on Mar 3, 2011 1:37 PM

    Update -- This problem may now be resolved.
    I have been able to conduct test IMPORTs of 48,000, then 96,000 and then 1.7 million records.  All were fine.
    It turns out that that difference is that the text files were sorted by amount in the ones that failed.  They were sorted by GLAccount in column A for the ones that succeeded.
    Edit:  Yep, all files loaded normally when re-sorted by GLACCOUNT, etc. on the left-hand side.  Apparently, when you're doing a lot of records that might confuse the system or something
    Edited by: Garrett Tedeman on Nov 18, 2010 11:41 AM

Maybe you are looking for