ODBC to Essbase Data Loading

I am looking for Comments on Pros and Cons for loading Essbase (BSO & ASO) using the SQL Interface & EIS (ODBC Connections) vs creation of a flat file. We have limited space to store flat files currently and the data is being sourced from a warehouse/mart, but the extract retention is becoming expensive for storage. Can you help by giving some Pros & Cons of not using a flat file.
Thanks

To go along with one of Glenn's cons (files load faster)
We recently moved our essbase servers to a different city.
When the servers were in the same city as the Oracle data sources, the SQL load rules ran in mintues. After moving to a different city they ran in hours. There was some kind of "Send record/Acknowlegde receipt of record" handshaking going on across the WAN.
To remedy this, we pulled the queries out of the load rules and ran them from a SQL Plus command line in a batch file. Once the files are generated, then we FTP them across the WAN.
Another case for pulling the queries out of the load rules could be just that you are running agaisnt a clock and all the sorting, etc that a query performs might be better suited to running outside of your dataload schedule, especially since you only want to load 1 load rule at a time. In my case, I could gain 1/2 to 1 hour of time if I pulled my Teradata queries out of my load rules, but we are still coming in under our alloted down-time (barely).
Robert
Edited by: RobertR3 on Apr 2, 2009 2:06 PM

Similar Messages

Hyperion11.1.2.2 Sql Server and Essbase data load error

Gentlemen,
i have issue on loading data in Essbase via sql server , while loading data it was fine and all of sudden i see that i get network error 10054
network error 10054 failed to recive data / send data
unexpected essbase error 1042013
even when i try to load manully it says Data Load Fails error Data load buffer [9999] does not exist Unexpected Essbase error 1270040
and in logs
Received client request: MaxL: Execute (from user [admin@Native Directory
*Error writing to server*
Also tried with maxll its the same issue
is .esm is loacked?
any issue with ODBC?
or any orphan link which is connected to sql and hyperion unable to process another ?
let me know your thoughts
thanks.

Can you try limiting the query to return some records? Try adding a where clause and see whether that works?
Regards
Celvin
http://www.orahyplabs.com

Essbase data load process never terminating

Hi
We are using Essbase 11.1.2.1.
We try to load a data file into a BSO Essbase application (essbase export format, so no dataload). We are using "execute in background" option.
If the file contents no unknown member : it is correctly loaded.
If the file contents an unknown member : the data load is never terminated : we have killed it after more than 15 hours, and the request is still in "terminating" so we have to kill the essbase process on the server. No error message or file.
Thanks in advance for your help
Fanny

Hi
I try to start this discussion again, because we still have the same problem, and no idea of why (no idea from the Oracle support too) and my client is waiting for an explanation :-/
So, some more details :
Context :
I have an export (essbase format) from a database.
If I import this file in a database with all the members used in the file => no problem. The dataload takes around 10 seconds.
If I import this file in a database with all the members used in the file, excepted 1 => problem. The data load never ends and I have to kill the Essbase application on the Essbase server.
I have done another test :
I have imported the file in a database with all the members used in the file (so no problem).
I have exported level-0 data in columns.
I have imported this new file in the database with all the members used in the file, using a DLR => no problem. The data load takes around 10 seconds, with a dataload.err generated.
So, John, you are right, the client shoud really use a column format export. But I need to explain to him why he cannot (not should not) use an export format.
If using an export format is possible : I have to identify my problem and make the right modification to solve the problem.
If it not possible : this is a bug, and it is not my responsability anymore and I can close the project!
Thanks in advance for your great ideas!
Fanny

EIS to Essbase data load process

I have two user defined queries in a metaoutline. When i perform dataload operation from EIS, the Essbase application log says that dataload updated [] cells and Data Load Elapsed Time [] seconds but the EIS dataload process is still running. It seems that Essbase is loading the data only for the first query and completing dataload while EIS is still running second query.Has anyone else experienced this problem? Essbase and EIS both are 6.5.0.

In EIS
1) You have to define the Logical OLAP Model connecting to the relational source.It defines the joins between fact table and dimension tables.
2) Based on the OLAP Model You have to create meta outline which defines the rules for loading members and data into essbase.

Error at work flow Export task in Essbase data load

Hi All,
I am trying to load the data to Hyperion Essbase. I have two small question first is :
1) can any buddy tell me what are the basic steps for specifying dimension for target essbase application. i have did the data load to HFM application previously but here with essbase it bit complex.
2) I have done with the creating import format and assign it to Location after specifying dimensions. At the work flow export task i am getting following error:
[Can not calculate Dimension member [Apr] with restricted member [Apr]
Thanks in Advance

The FDM Configuration Guide outlines the process to map the dimensions in the Essbase Adapter to the proper dimensions in the Essbase Outline. You will want to take a look at this on Oracle Technology Network under Documention.
You will want to right-click on the adapter in the workbench and choose "Configure"
You will then create your machine profile with the source machine value of the FDM app server name and the target machine value as the Essbase Server Name.
On the second tab you will specifiy the Essbase Applicaiton and Datbaase Name and logon method to use for integrating with Essbase.
Finally click on the Dimensions tab and click on each dimension in the left-pane and in the right-pane if the integration with Essbase is setup correctl you will be able to select the corresponding Essbase dimension from the Dimension drop down list and select it and it will populate the foreign name as Tony Mentioned.
You can then apply the changes when complete.
Hope this is helpful.

Essbase data load validation

Gurus,
I have this question.
I have loaded data to my Essbase cube. I have a slight difference. Around 2021 dollars.
What would be the proper way to check and validate it. How could we find out where the error had been or if something has not been tagged properly.
Aug guidance would be very helpful.
Thanks

1) Check error file
2) Check Dynamic Calc members
3) clear target slice
load data with AGG option
ER

Help using MaxL to automate Essbase Data Load

Hi,
I am trying to automate loading data into an Essbase database (for a Planning application). My current script using the Maxl Shell looks like this:
MaxL>
IMPORT DATABASE Application.Database DATA
FROM SERVER TEXT DATA_FILE *'data.csv'*
USING SERVER RULES_FILE *'csv'*
ON ERROR WRITE TO *'c:\\hyperion\\MaxL_logs\data_csv.err'*;
Bold text in the script indicates specific names or files for my instance.
Using this script works succesfully to load data into my Planning application as long as the data file data.csv is located in the database directory for the Planning applicaiton. What I want to be able to do is load the data file data.csv from a directory that I specify, as the data file cannot be placed in the database directory and instead must have it's own directory.
Does anyone know what syntax I need to use in a MaxL script in order to load a data file that is not located in the database directory? I can provide more information if need. Thank you.

Hi,
Have you tried...
IMPORT DATABASE Application.Database DATA
FROM TEXT DATA_FILE 'C:\\temp\\data.csv'
USING SERVER RULES_FILE 'csv'
ON ERROR WRITE TO 'c:\\hyperion\\MaxL_logs\data_csv.err';
or
IMPORT DATABASE Application.Database DATA
FROM LOCAL TEXT DATA_FILE 'C:\\temp\\data.csv'
USING SERVER RULES_FILE 'csv'
ON ERROR WRITE TO 'c:\\hyperion\\MaxL_logs\data_csv.err';
Cheers
John
http://john-goodwin.blogspot.com/

Essbase Data Loading

Hi,
I have 5 dimensions in the outline,but in the Data file i have data in 3 columns only.How can i load the data

Take it to the Hyperion/Essbase forum hippie.
Essbase

Essbase data load in the background...can't find error file

I just loaded a big text file (90GB) to an ASO cube. I clicked on Run in the background option. The process was over after 3-4 hours. I can see the number of input cells and nothing in active session. But I don't see an error file created...I'm sure that I should get kick-outs....When I loaded 100k records of this file I did get the error file. The difference is just I did not load the sample file in the background? Can anyone advise where I can find the error file? Thanks !

It seems the data were loaded without a problem. The session was over after 4 hours and I was able to retrieve the data.
I just wonder where to find the error file because I'm sure there'll be kick-outs.

Mail configuration in ODI essbase data load package. Unable to connect web

Hi,
We are unble to connect to internet through VMware.
I have created a package which has to send mails to the users after the dataload to essbase is done. But the VMware is not connected to internet. The host machine is connected to a LAN. Please let me know what has to be done

Another day another question from Sravan :)
I am not sure the planning forum is the place for networking issues on a vmware though is your vm machine set up in host only mode ? If so try changing it to Bridged.
Cheers
John
http://john-goodwin.blogspot.com/

ESSBASE Data Load Bitmap Mode Calc

can anyone make me understand what this signifies?
Previous
"Multiple bitmap mode calculator cache memory usage has a limit of [641] bitmaps."
Now
Multiple bitmap mode calculator cache memory usage has a limit of [595] bitmaps.
The reason I ask is I added members to one of my outline dimensions over the weekend and from then, the Calc times have doubled for the dataloads.
So, I was trying to go through the log file for any issues and found this difference.
More Info
I added some 21 "0" level members to the already existing 360 members of "SPARSE" dimension.
There are no formula's on any of the members
They are all "0" level members
They are stored members, not dynamic.
Once I made the changes, I just did all data restructure and not Calc Dim on the dimension. Is that a problem?
and
Can some make me understand why the cache size changed by changing the dimension?
Thanks in advance

Have a look here http://download.oracle.com/docs/cd/E10530_01/doc/epm.931/html_esb_dbag/frameset.htm?dstcache.htm to understand the calc cache bitmap.
Basically you add members to your sparse dimension so your bitmap size increases too, so the number of bitmaps that fit into the cache decreases.
As you added level 0 members which have no values on them just making the restructure should be ok.

Essbase Studio Performance Issue : Data load into BSO cube

Hello,
Having succesfully built my outline by member loading through Essbase Studio, I have tried to load data into my application again with Studio. However I was never able to complete the data load because it is taking forever. Each time I tried to work with Studio in streaming mode (hoping to increase the query speed), the load gets terminated due to the following error : Socket read timed out.
In the Studio properties file, I typed in, oracle.jdbc.ReadTimeout=1000000000, but the result has not changed. Even if it did work out, I am also not sure the streaming mode is gonna provide a much faster alternative to working in non-streaming mode. What I'd like to know is, which Essbase settings I can change (either in Essbase or Studio server) in order to speed up my data load. I am loading into a Block Storage database with 3 Dense, 8 Sparse and 2 attribute dimensions. I filtered some dimensions and tried to load data to see exactly how long it takes to create a certain number of blocks. With ODBC setting in Essbase Studio, it took me 2.15 hours to load data into my application where only 153 blocks were created with the block size of 24B. Assuming that in my real application the number of Blocks created are going to be at least 1000 times more than this , I need to make some changes in settings. I am transferring the data from Oracle Database, with 5 tables joined to a fact table (view) from the same data source. All the cache settings in Essbase are in default mode. Would changing cache settings, buffer size or multiple threads help to increase the performance? Or what would you suggest that I should do?
Thank you very much.

Hello user13695196 ,
(sorry I no longer remember my system number here)
Before it comes to any optimisation attemps in the essbase (also Studio) environment you should definitily make clear that your source data query performs well at the oracle db.
I would recommand:
1. to create in your db source schema a View from your sql statement (these behind your data load rule)
2. query against this view with any GUI (Sql Developer, TOAD etc.) to fetch all rows and measure the time it takes to complete. Also count the effected (returned) number of rows for your information and for future comparing of results.
If your query runs longer then you think is acceptable then
a) check DB statistiks,
b) check and/or consider creating indexes
c) if you are unsure then kindliy ask your DBA for help. Usually they can help you very fast.
(Don't be shy - a DBa is a human being like you and me :-) )
Only when your sql runs fast (enough for you; or your DBA says is the best you can achieve) at the database move your effort over to essbase.
One hint in addition:
We had often problems when using views for dataload (not only performance but rather other strange behavior) . Thats the reaons why I like more directly to set up on (persistence) tables.
Just to keep in mind: If nothing helps create a table from your view and then query your data from this table for your essbase data load. Normaly however this should be your last option.
Best Regards
(also to you Torben :-) )
Andre
Edited by: andreml on Mar 17, 2012 4:31 AM

Log Issue in HFM data load

Hi,
I'm new to Oracle data Integrator.
I have an issue in log file name. I'm loading data into Hyperion Financial Management through ODI. In the Interface, when we select the IKM SQL to HFM data, we have an option of log file enabled. I made it true and gave the log file name as 'HFM_dataload.log'. After executing the interface when I navigate in to that log folder and view the log file, that file is blank. Also a new file 'HFM_dataloadHFM6064992926974374087.log' is created and the log details are displayed in it. Since I have to automate the process of picking up the everyday log file,
* I need the log details to be displayed in the specified log name i.e. 'HFM_dataload.log
Also I was not able to perform any action (copy that newly generated log file into another or send that file in mail) on that log file, since I'm not able to predict the numbers generated along with the specified log file name.
Kindly help me to overcome this issue.
Thanks in advance.
Edited by: user13754156 on Jun 27, 2011 5:08 AM
Edited by: user13754156 on Jun 27, 2011 5:09 AM

Thanks a lot for idea.
I am wonder in HFM data loads. In ODI operator they are showing warning symbol though few records got rejected instead Error. Is it possible to make it fail if one or more records got rejected.
I have experience with Essbase data loads. if it reaches specified number of records operator will get fail.
Please guide me if i am missing something.
Regards,
PrakashV

GL Data load using ODI to Essbase

Hi, I am trying to load GL actual data to essbase application using ODI. Source file is having 10 columns and the Target is having 11 columns. We are using rules file to load data into essbase. Rules file will split 9th column as two columns and will load the data into Essbase. When we test the rules file in essbase data is getting load into application. when we use the same rule file in ODI interface data is not getting load and giving error as "Unknown member" for the member which we are spliting in 9th column. Source file: HSP_RATES ACCOUNT PERIOD YEAR SCENARIO VERSION CURRENCY ENTITY SFUND PROGRAM DATA HSP_InputValue 611101 Jul FY13 ACTUAL Final Local 0000 SBNR AC0001PS0001 25000 AC0001PS0001 is the concatenated string from GL. we will split this as two columns using rules file to load into essbase application. Please suggest what might be the reason for the error. How to do the mapping between source and target. I have mapping one column(AC0001PS0001) to two dimensions (Program, Activity) in Essbase. Please suggest. Thanks Sri

In ODI, what you have to do is to split it in the ODI itself. While you are mapping, you can use SQL functions to map it to two different columns. Similar to the way you are doing it in Rule file.
Regards
Amarnath
ORACLE | Essbase

Unable to load data to Essbase (IKM SQL to Hyperion Essbase (DATA)

I'm trying to load data to Hyperion Essbase. Unfortunately it isn't going so well. I've followed the instructions but I keep getting this "BUFFER_SIZE" error. I haven't changed the default BUFFER_SIZE (it is set at <Default>:80) and I haven't changed any other parameters in the KM.
Appreciate any thoughts...
com.hyperion.odi.common.ODIConstants has no attribute *'BUFFER_SIZE'*
org.apache.bsf.BSFException: exception from Jython:
Traceback (innermost last):
File "<string>", line 82, in ?
AttributeError: class 'com.hyperion.odi.common.ODIConstants' has no attribute 'BUFFER_SIZE'
at org.apache.bsf.engines.jython.JythonEngine.exec(JythonEngine.java:146)
at com.sunopsis.dwg.codeinterpretor.k.a(k.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.scripting(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSqlI.treatTaskTrt(SnpSessTaskSqlI.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
at com.sunopsis.dwg.cmd.e.i(e.java)
at com.sunopsis.dwg.cmd.h.y(h.java)
at com.sunopsis.dwg.cmd.e.run(e.java)
at java.lang.Thread.run(Unknown Source)
Edited by: Chris Rothermel on Apr 13, 2010 3:44 PM

Yes! That's great but I'm not out of the woods yet. I had applied the patch incorrectly before -- I'd extracted it to the wrong directory. Now I get this new error: Missing standard dimension column for data load
Any thoughts on how to get by this one?
org.apache.bsf.BSFException: exception from Jython:
Traceback (innermost last):
File "<string>", line 23, in ?
com.hyperion.odi.essbase.ODIEssbaseException: Missing standard dimension column for data load
at com.hyperion.odi.essbase.ODIEssbaseDataWriter.loadData(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.python.core.PyReflectedFunction.__call__(PyReflectedFunction.java)
at org.python.core.PyMethod.__call__(PyMethod.java)
at org.python.core.PyObject.__call__(PyObject.java)
at org.python.core.PyInstance.invoke(PyInstance.java)
at org.python.pycode._pyx1.f$0(<string>:23)
at org.python.pycode._pyx1.call_function(<string>)
at org.python.core.PyTableCode.call(PyTableCode.java)
at org.python.core.PyCode.call(PyCode.java)
at org.python.core.Py.runCode(Py.java)
at org.python.core.Py.exec(Py.java)
at org.python.util.PythonInterpreter.exec(PythonInterpreter.java)
at org.apache.bsf.engines.jython.JythonEngine.exec(JythonEngine.java:144)
at com.sunopsis.dwg.codeinterpretor.k.a(k.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.scripting(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSqlI.treatTaskTrt(SnpSessTaskSqlI.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
at com.sunopsis.dwg.cmd.e.j(e.java)
at com.sunopsis.dwg.cmd.g.z(g.java)
at com.sunopsis.dwg.cmd.e.run(e.java)
at java.lang.Thread.run(Unknown Source)
Caused by: com.hyperion.odi.essbase.ODIEssbaseException: Missing standard dimension column for data load
at com.hyperion.odi.essbase.ODIEssbaseDataWriter.validateColumns(Unknown Source)
... 32 more
com.hyperion.odi.essbase.ODIEssbaseException: com.hyperion.odi.essbase.ODIEssbaseException: Missing standard dimension column for data load
at org.apache.bsf.engines.jython.JythonEngine.exec(JythonEngine.java:146)
at com.sunopsis.dwg.codeinterpretor.k.a(k.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.scripting(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execScriptingOrders(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSqlI.treatTaskTrt(SnpSessTaskSqlI.java)
at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
at com.sunopsis.dwg.cmd.e.j(e.java)
at com.sunopsis.dwg.cmd.g.z(g.java)
at com.sunopsis.dwg.cmd.e.run(e.java)
at java.lang.Thread.run(Unknown Source)

ODBC to Essbase Data Loading

Similar Messages

Maybe you are looking for