Load of big files in BPC with import package

HI,
I need to import many files (.txt) with 1,5 million of data lines in BPC with import package.
But BPC is limited to 500 000 lines for each import.
Have you got a solution ?
Thanks,
Morgann

Morgann,
You have two options.
1. use import into FACT table -> Cons : System will be offline. Pros : faster performance. No limit
2. if you should use import package, split file and put it into one folder and create a custom package that will handle those data file one by one. Cons : Need to make a custom package Pros : No system offline.
I hope it will help you.
Thanks.
James Lim

Similar Messages

Error loading data from BW to BPC with standard package

Hi experts,
A big part of our solution is pulling actuals from BW into BPC. To do so we use the standard SAP package "Load InfoProvider Selections" which calls the process chain /CPMB/LOAD_INFOPROV_UI.
We have migrated our environment to BPC 10 and tried to run this process and are now getting the following error:
“ Task name CONVERT:
No 1 Round:
An exception with the type CX_ST_MATCH_ELEMENT occurred, but
was neither handled locally, nor declared in a RAISING clause
System expected element 'Selections' ”
We have tested and this is happening with all data loading packages. It appears as though it is expecting a "selection" parameter, but selections have definitely been made. Has anyone encountered a similar issue or have any idea how to resolve it?
Best,
Chris

Hi Vadim,
Yep, my script is:
(INFOPROVIDERSELECTION,%InforProvide%,"%SELECTION%",Please input the infoprovider and set selection,,)
(TRANSFORMATION,%TRANSFORMATION%,"Transformation file:",,,Import.xls)
(RADIOBUTTON,%CLEARDATA%,"Select the method for importing the data from the source file to the destination database",0,{"Merge data values (Imports all records, leaving all remaining records in the destination intact)","Replace && clear datavalues (Clears the data values for any existing records that mirror each entity/category/time combination defined in the source, then imports the source records)"},{"0","1"})
(RADIOBUTTON,%RUNLOGIC%,"Select whether to run default logic for stored values after importing",1,{"Yes","No"},{"1","0"})
(RADIOBUTTON,%CHECKLCK%,"Select whether to check work status settings when importing data.",1,{"Yes, check for work status settings before importing","No, do not check work status settings"},{"1","0"})
(%TEMPNO1%,%INCREASENO%)
(%ACTNO%,%INCREASENO%)
(/CPMB/INFOPROVIDER_CONVERT,OUTPUTNO,%TEMPNO1%)
(/CPMB/INFOPROVIDER_CONVERT,ACT_FILE_NO,%ACTNO%)
(/CPMB/INFOPROVIDER_CONVERT,TRANSFORMATIONFILEPATH,%TRANSFORMATION%)
(/CPMB/INFOPROVIDER_CONVERT,SUSER,%USER%)
(/CPMB/INFOPROVIDER_CONVERT,SAPPSET,%APPSET%)
(/CPMB/INFOPROVIDER_CONVERT,SAPP,%APP%)
(/CPMB/INFOPROVIDER_CONVERT,FILE,%InforProvide%)
(/CPMB/INFOPROVIDER_CONVERT,CLEARDATA,%CLEARDATA%)
(/CPMB/INFOPROVIDER_CONVERT,INFOPROV_SELECTION,%SELECTION%)
(/CPMB/CLEAR_DATA,INPUTNO,%TEMPNO1%)
(/CPMB/CLEAR_DATA,CHECKLCK,%CHECKLCK%)
(/CPMB/APPEND_LOAD,INPUTNO,%TEMPNO1%)
(/CPMB/APPEND_LOAD,ACT_FILE_NO,%ACTNO%)
(/CPMB/APPEND_LOAD,RUNLOGIC,%RUNLOGIC%)
(/CPMB/APPEND_LOAD,CHECKLCK,%CHECKLCK%)
(/CPMB/APPEND_LOAD,CLEARDATA,%CLEARDATA%)
Thanks,
Chris

Adobe Photoshop CS3 collapse each time it load a big file

I was loading a big file of photos from iMac iPhoto to Adobe Photoshop CS3 and it keep collapsing, yet each time I reopen photoshop it load the photos again and collapse again. is there a way to stop this cycle?

I don't think that too many users here actually use iPhoto (even the Mac users)
However, Google is your friend. A quick search came up with some other non-Adobe forum entries:
.... but the golden rule of iPhoto is NEVER EVER MESS WITH THE IPHOTO LIBRARY FROM OUTSIDE IPHOTO.In other words, anything you might want to do with the pictures in iPhoto can be done from *within the program,* and that is the only safe way to work with it. Don't go messing around inside the "package" that is the iPhoto Library unless you are REALLY keen to lose data, because that is exactly what will happen.
.....everything you want to do to a photo in iPhoto can be handled from *within the program.* This INCLUDES using a third-party editor, and saves a lot of time and disk space if you do this way:
1. In iPhoto's preferences, specify a third-party editor (let's say Photoshop) to be used for editing photos.
2. Now, when you right-click (or control-click) a photo in iPhoto, you have two options: Edit in Full Screen (ie iPhoto's own editor) or Edit with External Editor. Choose the latter.
3. Photoshop will open, then the photo you selected will automatically open in PS. Do your editing, and when you save (not save as), PS "hands" the modified photo back to iPhoto, which treats it exactly the same as if you'd done that stuff in iPhoto's own editor and updates the thumbnail to reflect your changes. Best of all, your unmodified original remains untouched so you can always go back to it if necessary.

I was loading a big file of photos from iPhoto to Adobe Photoshop CS3 and it keep collapsing, yet each time I reopen photoshop it load the photos again and cal laps again. is there a way to stop this cycle?

I was loading a big file of photos from iPhoto to Adobe Photoshop CS3 and more then midway it keep collapsing, yet each time I re-open photoshop to load a small amount of photos, it load the previous photos again, and again it collapse. is there a way to stop this cycle and start a new?

http://helpx.adobe.com/photoshop.html

How to READ/SAVE Transformantation / Conversion File in BPC with ABAP

hi Experts
I would like to READ/SAVE Transformantation / Conversion File in BPC with ABAP
When I interface Transaction File From Other Cube,
I want to run Interface test from ABAP using Transformantation / Conversion File before run DM.
and, l want to Manage files with ABAP Program ,if need to modify Transformantation / Conversion File
Thank you.

Hi Young,
In addition to the above suggestions, would like to inform you that, if your requirement can be met by running those files in BPC Excel itself, what is the point in running ABAP program for the same?
It would be much more easier for you to run those files in BPC Excel itself and that is how BPC is designed.
Hope this clarifies further.
Rgds,
Poonam

Parallel loading of flat files into BPC 7.0 NW - Help required

Hi All
Can I load multiple flat files in parallel into BPC using IMPORT process chain.
If yes , How ?
Regards
AK

Please import SAP Note [1507226|https://service.sap.com/sap/support/notes/1507226] titled "FileService should support running DM package simultaneously" which is contained in BPC 7.0 NW SP10 and BPC 7.5 NW SP05.
Best regards,
[Jeffrey Holdeman|http://wiki.sdn.sap.com/wiki/display/profile/Jeffrey+Holdeman]
SAP Labs, LLC
BusinessObjects Division
Americas Applications Regional Implementation Group (RIG)

How to load data from file contains rows with different number of columns

hi all,
a data file contains assets data ordered like this(location_id
serial_number , quantity
serial_number , quantity
single column rows represents location, and two columns rows represents asset details for that location
123
12345 ,1
32145 ,1
124
12348 ,12
41239 ,22
54189 ,2
254
22419 ,1
I want to use sql loader to load these data after merging locations with thieir assets,like this order(location_id,serial number,quantity)
123 ,12345 ,1
123 ,25413 ,1
123 ,32145 ,1
124 ,12348 ,12
124 ,41239 ,22
124 ,54189 ,2
254 ,22419 ,1
Can one help me in that?
thank you,

Create external table and code sql query to do it.
:p

How to load hierarchy from file into InfoObject with compounding Attr & LN

Hi,
I have created an InfoObject called YCOSTC0 which has a compounding attribute 0CO_AREA. and Text is Lanugage dependent, hence the key is YCOSTC0, 0CO_AREA and LANGUAGE, now when i load hierarchy from flat file as mentioned below, it creates duplicate blank rows in master data table, becuase the flat file contains only the YCOSTC0 Info Object and this data gets loaded into 0CO_AREA column in master data table which is the first column. how can i load hierarchies from flat file into an InfoObject that has a compounding attribute and Language dependent. please provide me a sample file structure with data.
NodeID     InfoObject     Node Name     Link Name     Parent ID     Language     Short Text     Medium Text     Long Text
1     0HIER_NODE     CC_HIER               EN     Cost Center Heirarchy     Cost Center Heirarchy     Cost Center Heirarchy
2     YCOSTC0     C001          1     EN     CC 1     Cost Center 1     Cost Center 1
3     YCOSTC0     C002          2     EN     CC 2     Cost Center 2     Cost Center 2
4     YCOSTC0     C003          2     EN     CC 3     Cost Center 3     Cost Center 3
5     YCOSTC0     C004          3     EN     CC 4     Cost Center 4     Cost Center 4
6     YCOSTC0     C005          3     EN     CC 7     Cost Center 7     Cost Center 7
7     YCOSTC0     C006          4     EN     CC 5     Cost Center 5     Cost Center 5
8     YCOSTC0     C007          4     EN     CC 8     Cost Center 8     Cost Center 8
9     YCOSTC0     C008          4     EN     CC 10     Cost Center 10     Cost Center 10
10     YCOSTC0     C009          7     EN     CC 6     Cost Center 6     Cost Center 6
11     YCOSTC0     C010          6     EN     CC 9     Cost Center 9     Cost Center 9
Thanks
Akila R

Hi -
    Check the following link.
Hierarchy Upload from Flat files
Anesh B

Is icloud suitable for a business that would want to upload many big files and share with other people?

I work in a media porduction company and am researching cloud storage and find alot of them look good on the surface but there are plently of addional costs for how much cloud storage i want.
How much storage space can you get with Icloud?
Costs?
Can i upload from external hardrives?
Can it be assessable anywhere?
Can i share files with clients?

iCloud does not offer any of these facilities: it is for syncing personal email, caledars, contacts and photos taken on any one device to the other devices. There is no general file storage in the manner of Dropbox or the late lamented iDisk.
Probably you have already examined the available options but this page may offer some information:
http://www.wilmut.webspace.virginmedia.com/notes/missing/inicloud3.html#share

Please help with importing packages

I am trying to learn the Java Advanced Imaging (JAI) API. I have successfully installed java2SDK.
I downloaded the JAI library (jai-1_1_2-rc-lib-windows-i586.exe) and have installed it.
After installation, I added the JAI lib to the CLASSPATH.
CLASSPATH = C:\java\jai-1_1_2-rc\lib
when I try compiling a demo program from this tutorial page:
http://developer.java.sun.com/developer/onlineTraining/javaai/jai/src/FrontPage.java
I get these errors,
package javax.media.jai does not exist
import javax.media.jai.JAI;
how do I know which directory to copy the JAI lib files to so that
this import statement can find JAI
import javax.media.jai.JAI;
please help if you can
Thanks
John

Hi,
You have to give the full path of the jar file in classpath along with the jar file name
something like CLASSPATH = C:\java\jai-1_1_2-rc\lib\jai.jar ...see the jar file name and include that also

Having issues with Importing packages

Hi
Can someone help me with the behaviour i am noticing with jdk1.3.1
Say i have a directory by name test in c:\
so i have c:\test
say i have Add.java Test.java files in it.
The contents of these files are as follows
/** Add.java file */
package mypackage;
public class Add
public Add() { }
/** Test.java */
import mypackage.*;
public class Test
public Test() { }
public static void main(String[] args)
Add testAdd = new Add();
Now being in c:\test directory i perform the following steps
javac -d . Add.java
It compiles fine and it created a directory called mypackage within c:\test. thus i have
Add.class file in c:\test\mypackage directory
Then i did
javac Test.java
Now i get compiler errors saying
Test.java:8 : cannot resolve symbol
symbol : constructor Add ()
location: class Add
Add testAdd = new Add();
^
1 error
Pls help
Thanks

I'm not smart enough to answer why. My guess: the compiler always looks around for .java files that it might need to compile. Most of the time, this is a good thing because the compiler will automatically compile .java files instead of the user typing in all files. In your case, it appears that the compiler looks for a class named Add and finds the Add.java file before it looks thru the mypackage import so it tries to compile the file. The file contains mypackage.Add instead of a no package Add class so you get an error.

Problem with Importing Packages

I have a file which has several classes and an interface. The first line is package ImageSequence; . It is saved in a file called ImageSequence.java. I have another file in the same directory that has include ImageSequence.* as the third line. I get an error that the package is not found. What is wrong?

Thanks, but that still doesn't solve the problem. I have this code:
import java.awt.*;
import javax.swing.*;
import java.util.*;
import ImageSequence.*;
public class ImageSequenceTest extends JComponent {
     public static void main(String args[])
          new ImageSequenceTest();
     public ImageSequenceTest()
          Toolkit toolkit = Toolkit.getDefaultToolkit();
          Image i1 = toolkit.getImage("ImageSequenceTesti1.gif");
          Image i2 = toolkit.getImage("ImageSequenceTesti2.gif");
          Image i3 = toolkit.getImage("ImageSequenceTesti3.gif");
          Image i4 = toolkit.getImage("ImageSequenceTesti4.gif");
          Image i5 = toolkit.getImage("ImageSequenceTesti5.gif");
          Image i6 = toolkit.getImage("ImageSequenceTesti6.gif");
          Image images[] = new Image[] {i1, i2, i3, i4, i5, i6};
          ImageSequence is = new ImageSequence(images, 50);
          JFrame frame = new JFrame();
          frame.setSize(100, 100);
          frame.getContentPane().add(is);
          frame.setVisible(true);
          is.setRepeat(true);
          is.start();
}When I try to compile it, I get these error messages:C:\Program Files\Xinox Software\JCreator LE\MyProjects\ImageSequenceTest.java:22: cannot resolve symbol
symbol : constructor ImageSequence (java.awt.Image[],int)
location: class ImageSequence
          ImageSequence is = new ImageSequence(images, 50);
^
C:\Program Files\Xinox Software\JCreator LE\MyProjects\ImageSequenceTest.java:25: cannot resolve symbol
symbol : method add (ImageSequence)
location: class java.awt.Container
          frame.getContentPane().add(is);
^
C:\Program Files\Xinox Software\JCreator LE\MyProjects\ImageSequenceTest.java:27: cannot resolve symbol
symbol : method setRepeat (boolean)
location: class ImageSequence
          is.setRepeat(true);
^
C:\Program Files\Xinox Software\JCreator LE\MyProjects\ImageSequenceTest.java:28: cannot resolve symbol
symbol : method start ()
location: class ImageSequence
          is.start();
^
4 errors
When I get rid of import ImageSequence.*; and copy the code for the ImageSequence class from the package into the file, everything works.

Problem with importing packages in servlet

Hi all,
I am a newbie to java so please bear with me...
I am trying to create a java servlet but Eclipse is giving me errors such as:
'the import org.apache.struts cannot be resolved' in the following line:
import org.apache.struts.action.Action;
My environtment is:
Windows 2000
Tomcat 5
j2sdk1.4.2_04
struts 1.1
Any help would be greatly appreciated.
Thanks
John

you need to add the struts.jar to your classpath

Loading several flat files

I want to load several flat files each week with the same rules file. The files are for instance week12.txt, week13.txt etc. The files are all in the same directory, and need to be loaded each time. Is it possible to use a wildcard with ESSCMD, or MaxL to create a simple loadscript? Or does anybody know another way to load several files?

If you are using a Win OS, you could use a VBS to write a script. Call the VBS in a DOS batch file, then execute the newly created script. Note, In this example, I didn't fully build the IMPORT command. Additionally, I would add some form of error handling and logging.Const sDataPath = "c:\Files"Dim fso, oFolder, oFiles, oFile, oScriptSet fso = CreateObject("Scripting.FileSystemObject")Set oFolder = fso.GetFolder(sDataPath)Set oFiles = oFolder.FilesSet oScript = fso.CreateTextFile("c:\script.scr" ,2, False)oScript.WriteLine "LOGIN " & CHR(34) & "ASPEN" & CHR(34) & " " & CHR(34) & "ADMIN" & CHR(34) & " " & CHR(34) & "PASSWORD" & CHR(34) & ";"oScript.WriteLine "SELECT " & CHR(34) & "SAMPLE" & CHR(34) & " " & CHR(34) & "SAMPLE" & CHR(34) & ";"For Each oFile In oFiles oScript.WriteLine " IMPORT 3 " & CHR(34) & oFile.Name & CHR(34) & ";"NextoScript.WriteLine "LOGOUT;"oScript.WriteLine "EXIT;"oScript.CloseSet oFolder = NothingSet oFiles = NothingSet oScript = NothingSet fso = Nothing

Auditing a Custom Import package

We are having issues with BPC data auditing on a custom import package. We are using the convert and dump load tasks just like in the standard import package. The difference is that we have those surrounded by other SSIS tasks to perform other pieces of the import process. The specific issue is that when we look at the detailed audit data, we are not seeing all of the records from our custom import. We usually see that the import package took place, but we also usually see only a small fraction (if any) of the actual records that were posted (and which we can see in BPC) in the audit.
My first question is, does the "Data Manager Import" option under the audit settings work with custom import packages using the convert and dump load tasks, or is it exclusive to the standard import package? Secondly, if it does work with custom import packages, what might be some causes and/or resolutions to this issue?

Just an update on the two issues that we are seeing...
First, I have tested the standard Import and the Append into Fact Table packages, and both are audited correctly and completely. This is important because our import package utilizes both of these styles of import. One set of data is transactional, so it is loaded similar to the Append into Fact Table package. The other set is a merge style import, so it is very similar to the standard import. I see all records in the AuditDataFincance table in the Extra database for both of these packages. This would lead me to believe that we are seeing some interference either between these two dump load tasks in the same package or some other SSIS package. It is important to note that these dump load tasks are wrapped in foreach loops to pickup all files in a directory. Looking at the package, my guess would be that either having two dump load tasks or having said tasks wrapped in a foreach loop would probably be the culprit. My next step will be to strip the package down to test just these pieces. Does anyone know if either of these would cause an issue with auditing?
Secondly, I stated that we are not seeing the temp audit files in the STAGED or LOADED folders, which is making it more difficult to debug this issue. After testing several packages, I noticed that the standard import and clear packages audit correctly, but they never create files in the STAGED or LOADED folders. However, the Append into Fact Table package DOES create these files. What I noticed in the AuditHdrFinance table in the Extra database was that the StagingCode values for these packages were different before they were loaded. A value of 0 signifies that the package has already been loaded. Append into Fact Table had a value of 1, which appears to signify that an audit file is waiting to be loaded in the STAGED directory. The others had a value of 2, which I am guessing signifies that they are currently being staged in memory or some other location. Does anyone have any information on what the different StagingCode values signify and why different packages have different codes?

Load of big files in BPC with import package

Similar Messages

Maybe you are looking for