Essbase data load validation

Gurus,
I have this question.
I have loaded data to my Essbase cube. I have a slight difference. Around 2021 dollars.
What would be the proper way to check and validate it. How could we find out where the error had been or if something has not been tagged properly.
Aug guidance would be very helpful.
Thanks

1) Check error file
2) Check Dynamic Calc members
3) clear target slice
load data with AGG option
ER

Similar Messages

Essbase data load process never terminating

Hi
We are using Essbase 11.1.2.1.
We try to load a data file into a BSO Essbase application (essbase export format, so no dataload). We are using "execute in background" option.
If the file contents no unknown member : it is correctly loaded.
If the file contents an unknown member : the data load is never terminated : we have killed it after more than 15 hours, and the request is still in "terminating" so we have to kill the essbase process on the server. No error message or file.
Thanks in advance for your help
Fanny

Hi
I try to start this discussion again, because we still have the same problem, and no idea of why (no idea from the Oracle support too) and my client is waiting for an explanation :-/
So, some more details :
Context :
I have an export (essbase format) from a database.
If I import this file in a database with all the members used in the file => no problem. The dataload takes around 10 seconds.
If I import this file in a database with all the members used in the file, excepted 1 => problem. The data load never ends and I have to kill the Essbase application on the Essbase server.
I have done another test :
I have imported the file in a database with all the members used in the file (so no problem).
I have exported level-0 data in columns.
I have imported this new file in the database with all the members used in the file, using a DLR => no problem. The data load takes around 10 seconds, with a dataload.err generated.
So, John, you are right, the client shoud really use a column format export. But I need to explain to him why he cannot (not should not) use an export format.
If using an export format is possible : I have to identify my problem and make the right modification to solve the problem.
If it not possible : this is a bug, and it is not my responsability anymore and I can close the project!
Thanks in advance for your great ideas!
Fanny

EIS to Essbase data load process

I have two user defined queries in a metaoutline. When i perform dataload operation from EIS, the Essbase application log says that dataload updated [] cells and Data Load Elapsed Time [] seconds but the EIS dataload process is still running. It seems that Essbase is loading the data only for the first query and completing dataload while EIS is still running second query.Has anyone else experienced this problem? Essbase and EIS both are 6.5.0.

In EIS
1) You have to define the Logical OLAP Model connecting to the relational source.It defines the joins between fact table and dimension tables.
2) Based on the OLAP Model You have to create meta outline which defines the rules for loading members and data into essbase.

Error at work flow Export task in Essbase data load

Hi All,
I am trying to load the data to Hyperion Essbase. I have two small question first is :
1) can any buddy tell me what are the basic steps for specifying dimension for target essbase application. i have did the data load to HFM application previously but here with essbase it bit complex.
2) I have done with the creating import format and assign it to Location after specifying dimensions. At the work flow export task i am getting following error:
[Can not calculate Dimension member [Apr] with restricted member [Apr]
Thanks in Advance

The FDM Configuration Guide outlines the process to map the dimensions in the Essbase Adapter to the proper dimensions in the Essbase Outline. You will want to take a look at this on Oracle Technology Network under Documention.
You will want to right-click on the adapter in the workbench and choose "Configure"
You will then create your machine profile with the source machine value of the FDM app server name and the target machine value as the Essbase Server Name.
On the second tab you will specifiy the Essbase Applicaiton and Datbaase Name and logon method to use for integrating with Essbase.
Finally click on the Dimensions tab and click on each dimension in the left-pane and in the right-pane if the integration with Essbase is setup correctl you will be able to select the corresponding Essbase dimension from the Dimension drop down list and select it and it will populate the foreign name as Tony Mentioned.
You can then apply the changes when complete.
Hope this is helpful.

Hyperion11.1.2.2 Sql Server and Essbase data load error

Gentlemen,
i have issue on loading data in Essbase via sql server , while loading data it was fine and all of sudden i see that i get network error 10054
network error 10054 failed to recive data / send data
unexpected essbase error 1042013
even when i try to load manully it says Data Load Fails error Data load buffer [9999] does not exist Unexpected Essbase error 1270040
and in logs
Received client request: MaxL: Execute (from user [admin@Native Directory
*Error writing to server*
Also tried with maxll its the same issue
is .esm is loacked?
any issue with ODBC?
or any orphan link which is connected to sql and hyperion unable to process another ?
let me know your thoughts
thanks.

Can you try limiting the query to return some records? Try adding a where clause and see whether that works?
Regards
Celvin
http://www.orahyplabs.com

ODBC to Essbase Data Loading

I am looking for Comments on Pros and Cons for loading Essbase (BSO & ASO) using the SQL Interface & EIS (ODBC Connections) vs creation of a flat file. We have limited space to store flat files currently and the data is being sourced from a warehouse/mart, but the extract retention is becoming expensive for storage. Can you help by giving some Pros & Cons of not using a flat file.
Thanks

To go along with one of Glenn's cons (files load faster)
We recently moved our essbase servers to a different city.
When the servers were in the same city as the Oracle data sources, the SQL load rules ran in mintues. After moving to a different city they ran in hours. There was some kind of "Send record/Acknowlegde receipt of record" handshaking going on across the WAN.
To remedy this, we pulled the queries out of the load rules and ran them from a SQL Plus command line in a batch file. Once the files are generated, then we FTP them across the WAN.
Another case for pulling the queries out of the load rules could be just that you are running agaisnt a clock and all the sorting, etc that a query performs might be better suited to running outside of your dataload schedule, especially since you only want to load 1 load rule at a time. In my case, I could gain 1/2 to 1 hour of time if I pulled my Teradata queries out of my load rules, but we are still coming in under our alloted down-time (barely).
Robert
Edited by: RobertR3 on Apr 2, 2009 2:06 PM

Help using MaxL to automate Essbase Data Load

Hi,
I am trying to automate loading data into an Essbase database (for a Planning application). My current script using the Maxl Shell looks like this:
MaxL>
IMPORT DATABASE Application.Database DATA
FROM SERVER TEXT DATA_FILE *'data.csv'*
USING SERVER RULES_FILE *'csv'*
ON ERROR WRITE TO *'c:\\hyperion\\MaxL_logs\data_csv.err'*;
Bold text in the script indicates specific names or files for my instance.
Using this script works succesfully to load data into my Planning application as long as the data file data.csv is located in the database directory for the Planning applicaiton. What I want to be able to do is load the data file data.csv from a directory that I specify, as the data file cannot be placed in the database directory and instead must have it's own directory.
Does anyone know what syntax I need to use in a MaxL script in order to load a data file that is not located in the database directory? I can provide more information if need. Thank you.

Hi,
Have you tried...
IMPORT DATABASE Application.Database DATA
FROM TEXT DATA_FILE 'C:\\temp\\data.csv'
USING SERVER RULES_FILE 'csv'
ON ERROR WRITE TO 'c:\\hyperion\\MaxL_logs\data_csv.err';
or
IMPORT DATABASE Application.Database DATA
FROM LOCAL TEXT DATA_FILE 'C:\\temp\\data.csv'
USING SERVER RULES_FILE 'csv'
ON ERROR WRITE TO 'c:\\hyperion\\MaxL_logs\data_csv.err';
Cheers
John
http://john-goodwin.blogspot.com/

Essbase Data Loading

Hi,
I have 5 dimensions in the outline,but in the Data file i have data in 3 columns only.How can i load the data

Take it to the Hyperion/Essbase forum hippie.
Essbase

Essbase data load in the background...can't find error file

I just loaded a big text file (90GB) to an ASO cube. I clicked on Run in the background option. The process was over after 3-4 hours. I can see the number of input cells and nothing in active session. But I don't see an error file created...I'm sure that I should get kick-outs....When I loaded 100k records of this file I did get the error file. The difference is just I did not load the sample file in the background? Can anyone advise where I can find the error file? Thanks !

It seems the data were loaded without a problem. The session was over after 4 hours and I was able to retrieve the data.
I just wonder where to find the error file because I'm sure there'll be kick-outs.

Mail configuration in ODI essbase data load package. Unable to connect web

Hi,
We are unble to connect to internet through VMware.
I have created a package which has to send mails to the users after the dataload to essbase is done. But the VMware is not connected to internet. The host machine is connected to a LAN. Please let me know what has to be done

Another day another question from Sravan :)
I am not sure the planning forum is the place for networking issues on a vmware though is your vm machine set up in host only mode ? If so try changing it to Bridged.
Cheers
John
http://john-goodwin.blogspot.com/

ESSBASE Data Load Bitmap Mode Calc

can anyone make me understand what this signifies?
Previous
"Multiple bitmap mode calculator cache memory usage has a limit of [641] bitmaps."
Now
Multiple bitmap mode calculator cache memory usage has a limit of [595] bitmaps.
The reason I ask is I added members to one of my outline dimensions over the weekend and from then, the Calc times have doubled for the dataloads.
So, I was trying to go through the log file for any issues and found this difference.
More Info
I added some 21 "0" level members to the already existing 360 members of "SPARSE" dimension.
There are no formula's on any of the members
They are all "0" level members
They are stored members, not dynamic.
Once I made the changes, I just did all data restructure and not Calc Dim on the dimension. Is that a problem?
and
Can some make me understand why the cache size changed by changing the dimension?
Thanks in advance

Have a look here http://download.oracle.com/docs/cd/E10530_01/doc/epm.931/html_esb_dbag/frameset.htm?dstcache.htm to understand the calc cache bitmap.
Basically you add members to your sparse dimension so your bitmap size increases too, so the number of bitmaps that fit into the cache decreases.
As you added level 0 members which have no values on them just making the restructure should be ok.

Essbase Studio Performance Issue : Data load into BSO cube

Hello,
Having succesfully built my outline by member loading through Essbase Studio, I have tried to load data into my application again with Studio. However I was never able to complete the data load because it is taking forever. Each time I tried to work with Studio in streaming mode (hoping to increase the query speed), the load gets terminated due to the following error : Socket read timed out.
In the Studio properties file, I typed in, oracle.jdbc.ReadTimeout=1000000000, but the result has not changed. Even if it did work out, I am also not sure the streaming mode is gonna provide a much faster alternative to working in non-streaming mode. What I'd like to know is, which Essbase settings I can change (either in Essbase or Studio server) in order to speed up my data load. I am loading into a Block Storage database with 3 Dense, 8 Sparse and 2 attribute dimensions. I filtered some dimensions and tried to load data to see exactly how long it takes to create a certain number of blocks. With ODBC setting in Essbase Studio, it took me 2.15 hours to load data into my application where only 153 blocks were created with the block size of 24B. Assuming that in my real application the number of Blocks created are going to be at least 1000 times more than this , I need to make some changes in settings. I am transferring the data from Oracle Database, with 5 tables joined to a fact table (view) from the same data source. All the cache settings in Essbase are in default mode. Would changing cache settings, buffer size or multiple threads help to increase the performance? Or what would you suggest that I should do?
Thank you very much.

Hello user13695196 ,
(sorry I no longer remember my system number here)
Before it comes to any optimisation attemps in the essbase (also Studio) environment you should definitily make clear that your source data query performs well at the oracle db.
I would recommand:
1. to create in your db source schema a View from your sql statement (these behind your data load rule)
2. query against this view with any GUI (Sql Developer, TOAD etc.) to fetch all rows and measure the time it takes to complete. Also count the effected (returned) number of rows for your information and for future comparing of results.
If your query runs longer then you think is acceptable then
a) check DB statistiks,
b) check and/or consider creating indexes
c) if you are unsure then kindliy ask your DBA for help. Usually they can help you very fast.
(Don't be shy - a DBa is a human being like you and me :-) )
Only when your sql runs fast (enough for you; or your DBA says is the best you can achieve) at the database move your effort over to essbase.
One hint in addition:
We had often problems when using views for dataload (not only performance but rather other strange behavior) . Thats the reaons why I like more directly to set up on (persistence) tables.
Just to keep in mind: If nothing helps create a table from your view and then query your data from this table for your essbase data load. Normaly however this should be your last option.
Best Regards
(also to you Torben :-) )
Andre
Edited by: andreml on Mar 17, 2012 4:31 AM

Log Issue in HFM data load

Hi,
I'm new to Oracle data Integrator.
I have an issue in log file name. I'm loading data into Hyperion Financial Management through ODI. In the Interface, when we select the IKM SQL to HFM data, we have an option of log file enabled. I made it true and gave the log file name as 'HFM_dataload.log'. After executing the interface when I navigate in to that log folder and view the log file, that file is blank. Also a new file 'HFM_dataloadHFM6064992926974374087.log' is created and the log details are displayed in it. Since I have to automate the process of picking up the everyday log file,
* I need the log details to be displayed in the specified log name i.e. 'HFM_dataload.log
Also I was not able to perform any action (copy that newly generated log file into another or send that file in mail) on that log file, since I'm not able to predict the numbers generated along with the specified log file name.
Kindly help me to overcome this issue.
Thanks in advance.
Edited by: user13754156 on Jun 27, 2011 5:08 AM
Edited by: user13754156 on Jun 27, 2011 5:09 AM

Thanks a lot for idea.
I am wonder in HFM data loads. In ODI operator they are showing warning symbol though few records got rejected instead Error. Is it possible to make it fail if one or more records got rejected.
I have experience with Essbase data loads. if it reaches specified number of records operator will get fail.
Please guide me if i am missing something.
Regards,
PrakashV

Data Load behaviour in Essbase

Hello all-
I am loading data from Flat File using a server Rule File. In the rule file i have properties for a feild where in it replaces a name in flat file for member name in outline so it is somwhat like this:
Replace With
Canada 00-200-SE
Belgium 00-300- SE
and so on
Now in my flat file there was a new member for example china & the replacement for it was not present in Rule File & when the data was loaded in the system it didnt rejected that record on the contrary it loaded the values for china in
the region which was above it and overwrited the values for the original one.
Is this the normal behavior of essbase , I was thinking that record should have been rejected .
I know when we do a Lock & Send via Addin & if member is not present in outline it give you warning when you lock that sheet & eventually if you dont delete that member from the template it will load data against it in the member above it.
Is there a waok around for this problem or this is what it is ?
I am on Hyperion Planning / Essbase Version 9.3.1.
Thanks

Still thinking how does these properties effects the way data is being loaded right now. Have gone through DBAG & i dont see a reason y any of these peoperties might be affecting the load^^^Here's what I think is happening: China is not getting mapped, but the replacement for Belgium is occuring and resolves to a valid member name. Essbase sees China and doesn't recognize it (you knew all of this already).
When the load occurs, Essbase says (okay, I am anthromorphizing, but you get the ida) "Eh, I have no idea what China is, but 00-300-SE is the last good Country member I have, I will load there." Essbase is picking the last valid member and loading to that. I liken it to a lock and send from Excel with nested dimensions and non-repeating members. Essbase "looks up" a row, finds the valid member, and loads there.
And yes, this is in the DBAG: http://download.oracle.com/docs/cd/E12825_01/epm.111/esb_dbag/ddlload.htm#ddlload1034271
Search for "Unknown Member Fields" -- it's all the way at the bottom of the above link.
In fact, to save you the trip, per the DBAG:
If you are performing a data load and Essbase encounters an unknown member name, Essbase rejects the entire record. If there is a prior record with a member name for the missing member field, Essbase continues to the next record. If there is no prior record, the data load stops. Regards,
Cameron Lackpour

Data load in Essbase ASO cube

Hi,
I have not been using ASO cube before and had worked only on BSO cubes. Now I have a requirement to create a rule file to load data in to an ASO Essbase cube. I have created a data load rule file as I was creating for a BSO cube which is correctly validating. However when I am doing the data load I am getting following warning:
"Aggregate storage applications ignore update to derived cells. [480] cells skipped"
I have investigated further and found that ASO cube does not allow data loading at upper levels & on members calculated through formulas. After this I have ensured that I am loading the data in to zero level members and members which are not calculated through formula. But still I am not able to do the data load & getting the same warning.
Could you please help me and let me know if there is anything else which I am missing here?
Thanks in advance...
AKW

Hi AKW,
"Aggregate storage applications ignore update to derived cells. [480] cells skipped"This is only a warning message that means only those many cells were skipped might be for some reasons like any member pointing to those cells will be missing.
If you want to copy the Data of your BSO cube to an ASO Application why dont you use an PARTIONING it will copy your whole data from BSO to ASO (If Outline is common in both then copy any member of Sparse dimension like "Scenario 1" from Source i.e. BSO, to same member like "Scenario 1" in Target i.e ASO ),
This is only an alternate wayThanks
Avneet Singh Bhatia

Essbase data load validation

Similar Messages

Maybe you are looking for