Essbase Agg Calc script Running Inconsistantly

Hi All,
We are seeing inconsistent completion times for one of our calc scripts that simply aggregates a single Entity dimension. It runs periodically throughout the day on an already aggregated database. The normal completion time is 20 minutes. We have observed that some runs can take up to 7 hours. This issue persists even if there are no users in the system. We had the SAN and the Essbase server monitored while running this calc, but no issues were found on either end. In the essbase log, it appears that Essbase is sitting idle for a period of time while the calc is running. Has anyone experienced this before?
------------------------Calc script -------------------
SET CACHE HIGH;
SET LOCKBLOCK HIGH;
SET MSG SUMMARY;
SET NOTICE LOW;
SET UPDATECALC OFF;
SET AGGMISSG ON;
SET CALCPARALLEL 4;
SET CALCTASKDIMS 4;
/* Baseline fix. */
FIX (@RELATIVE("YearTotal",0), @RELATIVE("ACCountInc",0), @RELATIVE("AccountLine",0), @RELATIVE("AccountOther",0), "FY02", "Working")
Agg("Entity") ;
ENDFIX
It became a major issue. Your inputs will really help us.
Thanks in advance

Couple of unknowns here but here's a few tips:
1. Run the script in MaxL and ensure that you log users out, kill all existing app processes. Now even if this isn't do-able in the long run, you want to test this out to see that the result is consistent. A lot of times your process is waiting for other online processes to finish.
2. Defragmentation of the BSO cube could be the cause. If you defrag the cube and the 1st time run is fast, and the 2nd time run is slow, then you have created alot of blocks that shouldn't be there. And that's your problem and you need to tune the way you agg.
3. Check essbase statistics especial average cluster ratio to be 1
Daniel Poon

Similar Messages

FDM:Issue with Launching Essbase agg calc cript after FDM load complete

Hi experts ,
I am using a upshell batch to run FDM custom VB script to process 12 months data file which is running fine. All level 0 data is sucessfully loaded into Essbase.
But now the problem is to launch Agg calc scipt in Essbase. I tried 2 options but having following issues:
1-
If i am giving Agg script name in Validation entity and runs the load Up-To-Consolidate then FDM runs that agg script after each month load (ie: 12 times) but i just want to run that agg script after complete 12 months data load from FDM to Essbase.
Is there any way i can set Calc script to run after all data is loaded in Essbase ?
2-
If i call tha Essbase batch (which call MaxL to run the calc script) in AftLoad event script then again script is running 12 times after each load. Can you please suggest if i can modify the VB code with IFcondition here ? (ie: IF period is 12 then call \\Essbase server\***\.Batch) ? If possible please provide the sample code as i am new to VB ?
Please suggest
Thanks a lot !
Vivek

I guess you are using Batch Loader from your custom script??
Then you could use BatchAction to execute your maxl batch when the batch processing finishes.
In that way you would have only one execution after your 12 period file is processed.
I would suggest having a look to "Batch-Load Single Multiload File (Up To Check) Process" section in the FDM API Guide.
If your file is Multiload file you could also use MultiLoad Action Script.
For example, for multiload action you could say something like:
If Month(objLSItem.PstrTBPer) = 12 Then
That code checks period being processed is December (in case you load from Jan to Dec)
I hope that helps

Calc Script runs slow one day and fast the next?

We are on Essbase 11.1.2.1. When we run calc scripts to load our actuals and run some allocation scripts, the difference in running time for the same exact script is very different day to day. One day three hours the next 45 minutes. Our servers are just for Essbase. We are on Windows 2008 R2. Has anyone else run into this or have any idea how we could figure out the reason for this. Thanks.

Thanks. In that case, I would try to grab the cube statistics - especially number of upper-level and input blocks, compression ratio and fragmentation (in EAS you can only see one of the two fragmentation statistics, 'Average Clustering Ratio', not 'Average Fragmentation Quotient') before each run, just to see if they're varying wildly. Also, if your calc scripts log summary information (is there a SET MSG command in them? If not you could try SET MSG SUMMARY) then Essbase will write high-level statistics on how much work was done to the application log.
You can see which cubes are loaded (and consuming memory) in the EAS treeview - if they have a check (tick) mark they are loaded. But you can also see current activity by right-clicking on the server in the EAS treeview and selecting Edit | Sessions. That will show whether there are other operations (loads, calcs, reports, restructures etc) occurring at the same time.
If none of the above give any clues and this is a virtual box (or you have SAN storage) you really will need someone who understands your infrastructure to help.
I'm assuming these are BSO cubes, by the way!

Calc scripts running very Long time

Hi All,
Recently, i am migrated the objects from Production to Test region. We have 5 applications and each of the application has a set of calc scripts.
In test region, they are running really long time. Where as in Production, they run for less time.
In TEST region each Calc script is taking 10 times more time than the Production times.
No Dimension added or no script is updated. No difference in objects between TEST and PROD.
Please suggest me, why is this difference.
Thanks
Mahesh

The obvious first question would be if the hardware is different. You would expect prod to be a more powerful server and therefore perform better.I'm seeing a lot of virtualized test servers (who knows, really, what power the box has) and real prod servers. That can make a huge difference in performance.
It makes benchmarking tough -- yes, you can see how long something will take relative to another process, but there isn't any way to know how it will perform in production until you sneak it over there and benchmark it. It can be a real PITA for Planning.
And yes, the theory is that dev and prod are similar so that the above isn't an issue, but that seems to be a more theoretical than actual kind of thing.
Regards,
Cameron Lackpour

Agg calc script

Hi
I need to write a calc script which aggregates current year actual,budget and forecast.
I have 1 dense and remaining sparse dims, please help me with sample aggregation script.
Regards.

This is not a simple question to answer without knowing more about your application but try this for starters:
FIX("FY13","Actual","Budget","Forecast")
AGG("SparseDim1","SparseDim2","SparseDim3","SparseDim4");
ENDFIX
You may want to use a substitution variable for year.
I assume dense dim is dynamic calc. You ca't aggregate Year or Scenario as they are in your fix statement, you don't want to aggregate any other non-aggregating sparse dimensions such as Version either.
You probably need something more tailored to your environment but this should be a good starting point.

Calc Scripts run a lot faster after I copy existing database

Hi,
I have user being setup as the Application Designer of the application and each time when he run scripts of the database, it takes a lot longer than myself (I'm the Supervisor). The database was built up from scratch, so it is not database copy version. Could this be user specific problem?
Today, I create another copy of the database within the same application, create a new Scenario, load data, run multiple similar scripts and the time to run all scripts were alot faster when I run from initial database. Is this a coincidence or the performance has indeed improved?
Your advice is much appreciated!
Between, Im running on Essbase 7.1.3.0
Thank you

So are you saying you are the one to run the scripts after initial DB load?
What are the index and page size before and after you run the scirpts?
It is somewhat normal for the inital dataload and agg to run faster than subsequent runs of the agg, this is because typically inital data load is level 0 only members. The agg of the database will then create blocks for upper level members, thereby increasing the DB size. So there are more index entries, as well as blocks to parse thru.
That being said, if there is considerable increase in agg time, there may be more to address (fragmentation, block size, dynamic calc on sparse members, etc).
Robert

Why the Calc Script runs 15 hours?

Every week, we empty the BSO essbase CUBE, and reload with new data from flat file and make a Calculation. It takes 15 hours to finish, that's too long a time, how to improve the running speed? What is the most possible reason for the bottleneck?

Hi,
1. One has to take a look at your outline , calculation scripts and also other DB settings to recommend any changes for improvement.
2. There are many parameters like parallel calculation, caches, cfg settings..etc which play a role in it.
3. We never know , it might be due to hardware issue sometimes.
Get essbase consultants to fix this issue .
Sandeep Reddy Enti
HCC
http://hyperionconsultancy.com/

Calc script, Business rule and business rule macro

Hi John,
Can we use calc script , BR sequence and a BR macro against different databases at a single go.
In one calc script or BR sequence or BR macro itself can i calculate 2 databases

If possible could you not start every post with my name, there are lots of others helping on this forum and they provide excellent answers
Calc Scripts run against one database.
Sequences can contain multiple business rules, in the launch variables you can set the database to run against for each rule (outside of the planning application though)
Macros are called from a business rule and are run against the database the calling rule is being run against.
Cheers
John
http://john-goodwin.blogspot.com/

OBIEE 11g write back to Essbase and run calc script feature

Hi,
I have a requirement to write back into Essbase Cube and run calc script from OBIEE dashboard.
From what i have search on google, we must deploy additional Java Script into weblogic, but that is before OBIEE 11.1.1.6.
I have 2 question:
- Does OBIEE 11.1.1.6 already supported native write-back to Essbase and running calcscript?
- Anyone has example of the custom java-script for write back and running calcscript?
And another, if there are requirement like this, is it better to install Essbase Add-in on Microsoft Excel and do the what-if analysis there, then just display the report on OBIEE dashboard? (based on user-friendliness and the complexity on maintenance)
Thanks in advance.

Hi,
Even I am trying to achieve the same thing as you have mentioned but think that it is not possible to achieve easily in obiee 11.1.1.6, though we do have a work around to perform a writeback in Essbase cube using JAPI as mentioned below.
Also we can call Hyperion reports from OBIEE using Action Links and also pass parameters to the same but dont know if it runs calculation script.
Below link could be useful for you for write back workaround.
http://oraclebizint.wordpress.com/2009/05/25/oracle-bi-ee-10-1-3-4-1-writebacks-to-essbase-using-japi-and-custom-html-part-1/
Let me know in case you have found out anything else related to same.
Thanks,

Essbase performance issue when calc scripts are run on FDM cube on same server

We have a large Essbase application which has high usage on a daily basis, which is being impacted when we run Calc scripts on an FDM forecast cube which is on the same server. The large application is on EIS 11.1.2 and the FDM cubes are being migrated to the same server and also being upgraded from EIS 7.1 on Unix to EIS 11.1.2 on NT. Every time the Calc scripts are run on the FDM cube, the performance of the Essbase application is degraded and it shuts down after some time.

Sudhir,
Do you work at a help desk or are you a consultant? you ask such a varied range of questions I think the former. If you do work at a help desk, don't you have a next level support that could help you? If you are a consultant, I suggest getting together with another consultant that actually knows more. You might also want to close some of your questions,. You have 24 open and perhaps give points to those that helped you.

Calc scripts are running slow(all of a sudden)

All of a sudden, for the past few days, we are noticing that all our calc scripts have been running very slow.
The same scripts used to run much faster earlier.
Has anybody seen this kind of scenario?
We did a RAM upgrade on the eas server, and have restarted all services.
Other than that, nothing has changed in our system.
Thanks.

It can be quite common for calcs to slow down over time, but there are some things to do to mitigate this.
1. Are you using Intelligent Calc? All things being equal (a very broad statement in essbase, since things are never equal) if there is more activity by users, it could affect how many blocks are marked dirty. This is probably not your issue, because a properly written calc wouldn't slow down much for this reason. I had to mention it though because I have seen an installation where their calc was 'Calc All' and they used intelligent calc to create the scope of the calc. (bad, very bad)
2. Do you perform DB restructures? (either explicity by Restructuring or by exporting level 0, clearing and import level 0 then agg) If this is not done on a regular basis (regular depends on the usage of the cube) then you could be experiencing fragmentation, which increases the size of the database, increasing run times.
3. Have you just added another fiscal year to the database? More data means bigger database.
RAM upgrade on the EAS server shouldn't affect calc times (unless essbase services are also running on the EAS server, then there might be something to it).
Most of these (and other) issues can be mitigated by applying proper scope to your calcs (Fix statements).
What environment are you running in? Windows or Unix?
New application?
What kind of time increases are we talking about here?
Robert

Running Calc Scripts via Workspace

Currently users are given 'admin' access to Essbase. That way when they are in Workspace they can see and run calc scripts on their apps. Is there a more proper way to give users the ability to run a calc on their apps without giving them 'admin' access?

We have the calc scripts that run for data loads and other automated processes. Some of these calc's which are just AGG's and Calc Dim's I guess could be BR's too, but then we would have duplicates......
Thats the sorry reason :)

Essbase calc script performance issues

Hi,
I have essbase 9.3 running on Sun solaris 4 CPU, 16 GB server. The calc script "calc all" takes ~3 hrs to complete.
This is the calc script.
/ESS_LOCALE English_UnitedStates.US-ASCII@Binary
SET UPDATECALC OFF;
SET CALCPARALLEL 4;
SET CALCTASKDIMS 2;
CALC ALL;
We don't have to calc all dim, but even if we
But even with specific dim we get the same timing. Below is the script
SET UPDATECALC OFF;
SET CALCPARALLEL 4;
SET CALCTASKDIMS 2;
FIX ("Y2009", "Actual");
CALC DIM("Data Source","Intercompany","LegalEntity","Site","Department","Entity");
ENDFIX
The ess00001.ind is 700 Mb and ess00001.pag is 2.1 GB.
In Admin services, this is what I see for caches
1) Index cache size is 1 GB for this DB
2) Index cache current value is 1gb
3) Datafile cache setting is 1.5 GB
4) Datafile cache current value is 0 (?? not sure why??)
5) Data cache setting 4.1 GB
6) Index page setting 8 kb
please help ...
Thanks
Moe

Moe,
I'm guessing you inherited this thing, else you would know why the cache settings are what they are, but here are some thoughts:
Caches:
3) Datafile cache setting is 1.5 GB
4) Datafile cache current value is 0 (?? not sure why??)You're running the database in Buffered I/O, so the data file cache is ignored.
1) Index cache size is 1 GB for this DB
2) Index cache current value is 1gb You have consumed all of the cache -- I'm a little confused, as you state your .ind file to be 700 megabytes -- generally the index cache consumption doesn't go beyond the .ind file size. When you look at your hit ratio statistics in EAS, does it show a 1 against the index cache? If yes, then you don't need to look any further as that's as good as it's going to get.
5) Data cache setting 4.1 GBUnless you're using MEMSCALINGFACTOR, I don't think Essbase is actually addressing all of the memory you've assigned. What are you showing as actually used? In any case, having a data cache almost twice as big as the .pag files is a waste as it's way too large.
Easy, off the cuff suggestions without knowing more about your db:
1) Try AGG instead of CALC DIM for sparse dimensions.
2) Try turning off (yes, turning off, you'd be surprised) parallel calc, and benchmark it. It will probably be slower, but it's nice to know.
3) Dimension order? Modified hourglass?
4) Tried defragmenting the database and benchmarking the performance?
5) What is your block size? Big? Small?
6) I think you are not calculating your Accounts/Measures dimension in your calc? If you are, and it's dense, could you make those Accounts dynamic calc -- dropping a dimension from the calc can be huge.
I'm sure there will be other suggestions -- these are the easiest.
Regards,
Cameron Lackpour

An error ocurred while running the specified calc script. Check the log...

Hi,
I get the following error when I use the "Mass Mllocate" of hyperion planning (11.1.1.3) , specifically when i try to use "Spread Type" and select "Relational Spread".
I check the log for details, i see the following messages:
[Mon Mar 5 17:34:18 2012]Local/TCM/VtaCto/admin/Info(1013162)
Received Command [Calculate] from user [admin]
[Mon Mar 5 17:34:18 2012]Local/TCM/VtaCto/admin/Info(1200481)
Formula for member [FY11] will be executed in [CELL] mode
[Mon Mar 5 17:34:18 2012]Local/TCM/VtaCto/admin/Error(1200315)
Error parsing formula for [FIX STATEMENT] (line 24): invalid object type
[Mon Mar 5 17:34:18 2012]Local/TCM/VtaCto/admin/Error(1012001)
Invalid Calc Script syntax [
FIX ("Ene","Feb","Mar","Abr","May","Jun","Jul","Ago","Sep","Oct","Nov","Dic","42300007","CC_054","CIA_063","PPTO","TRABAJO","S_241","S_251","S_252","S_253","S_254","S_255","S_259","S_260","S_227","S_228","S_229","S_230","S_231","S_232","S_233","S_234...]
[Mon Mar 5 17:34:18 2012]Local/TCM/VtaCto/admin/Error(1200421)
Error encountered on or after line [25]
[Mon Mar 5 17:34:18 2012]Local/TCM/VtaCto/admin/Info(1020055)
Spreadsheet Extractor Elapsed Time : [0] seconds
[Mon Mar 5 17:34:18 2012]Local/TCM/VtaCto/admin/Info(1020082)
Spreadsheet Extractor Big Block Allocs -- Dyn.Calc.Cache : [0] non-Dyn.Calc.Cache : [0]
But i can not identify which calculation is referenced and that I understand is what is failing.
Could guide me about that would have to check to find what is generating the error.
Thanks in advance!!!

Hi,
One problem is that I can not identify the script because it was not created by me, as I understand this calc is implicit in planning, only runs when you select the option "mass allocate".
The published extract was obtained from the log of the application in which the calculation is running, this was extracted from essbase directory that hosts the application.
Hector Ortega

Error while running Business Rules and Calc scripts

We are trying to run calc script in a report and we received the error saying that " An error occured while running the specified cacl script.Check the log for details", we received the similar error when working with Business rules.
This started when we tried to point JVMMODULELOCATION in essbase.cfg to null from its existing link to a java path.
This error persists even after we changed the config file to its original one.
Hyperion 9.3.1
Oracle 10g
Weblogic 9
Solaris 10 64 bit
john , please help. i will provide ytou with the exact error messages.. please tell me what this means ---> This started when we tried to point JVMMODULELOCATION in essbase.cfg to null from its existing link to a java path
what is that JVMMODULELOCATION for??
thankyou,
Rciky

Hi,
Here is details on what the JVMMODULELOCATION is :- http://download.oracle.com/docs/cd/E10530_01/doc/epm.931/html_esb_techref/techref.htm
Cheers
John
http://john-goodwin.blogspot.com/

Essbase Agg Calc script Running Inconsistantly

Similar Messages

Maybe you are looking for