Why the Calc Script runs 15 hours?

Every week, we empty the BSO essbase CUBE, and reload with new data from flat file and make a Calculation. It takes 15 hours to finish, that's too long a time, how to improve the running speed? What is the most possible reason for the bottleneck?

Hi,
1. One has to take a look at your outline , calculation scripts and also other DB settings to recommend any changes for improvement.
2. There are many parameters like parallel calculation, caches, cfg settings..etc which play a role in it.
3. We never know , it might be due to hardware issue sometimes.
Get essbase consultants to fix this issue .
Sandeep Reddy Enti
HCC
http://hyperionconsultancy.com/

Similar Messages

My Essbase db corrupting when i terminate the calc script why?

Hi All,
i got the problem with essbase db..It is corrupting the data when i terminating the any running calc script.
So that every time i m taking the back up for that...
Please let me know how to avoid this...and why it is corrupting ?...
Is anything wrong with my Essbase?
Regards,
Prabhas

If by "corrupting" you mean that essbase crashes and you can't restart the db then yes this is unusual and something is wrong with the environment. On the other hand, if you mean that the data is not the same as it was prior to starting the script then no there is nothing wrong. Essbase does not have a rollback feature that undo's the calc script processed up to the point where you killed it.
Dave

Can not run the calc scripts by mxl, if the first character is Number

I found that if you create the calc scrpt like 1abc.csc. You can not run it by mxl. I tried for times but do not know the reason for that. I found that you can use number in the name of the calc scripts(like abc1.csc, a1bc.csc), but not for the first character(like 1abc.csc).
Below is my mxl scripts:
×××××××××××××××××××××××××××××××××××
login admin identified by password on localhost;
spool on to 'C:\abc.log' ;
execute calculation sample.basic.1abc;
spool off;
logout;
×××××××××××××××××××××××××××××××××××
I write a bat file below:
×××××××××××××××××××××××××××××××××××
D:\Hyperion\AnalyticServices\bin\essmsh C:\abc.mxl
×××××××××××××××××××××××××××××××××××
I can run the scripts if I change the name "1abc" to "abc1"or "a1bc".
Of course I can run this calc in EAS, no matter the name is "1abc" or "abc1".
Anybody find the same problem with me?

I agree, if ever there was a "best practice" to developing scripts (especially when using variables) it is to enclose in single quotes. I actually use double quote, single quote.
execute calculation "'$4'"."'$5'"."'$6'";

Why does the calc script screen freezes after executing the script

Hello Everyone:
When a calc script gets executed, the calc Script in the ASS freezes even though the calc script has finished it´s execution. Does anybody knows why? How can i prevent these to happen?
Hope someone could help me, thanks in advanced
Best Regards

if you execute the calc script in foreground, console will freezes and it will not allow any thing to do.
Once script is completed, console will be freed.
You can execute the calc script in back ground so that you can continue your work and you can track the progress in the sessions.

Essbase Agg Calc script Running Inconsistantly

Hi All,
We are seeing inconsistent completion times for one of our calc scripts that simply aggregates a single Entity dimension. It runs periodically throughout the day on an already aggregated database. The normal completion time is 20 minutes. We have observed that some runs can take up to 7 hours. This issue persists even if there are no users in the system. We had the SAN and the Essbase server monitored while running this calc, but no issues were found on either end. In the essbase log, it appears that Essbase is sitting idle for a period of time while the calc is running. Has anyone experienced this before?
------------------------Calc script -------------------
SET CACHE HIGH;
SET LOCKBLOCK HIGH;
SET MSG SUMMARY;
SET NOTICE LOW;
SET UPDATECALC OFF;
SET AGGMISSG ON;
SET CALCPARALLEL 4;
SET CALCTASKDIMS 4;
/* Baseline fix. */
FIX (@RELATIVE("YearTotal",0), @RELATIVE("ACCountInc",0), @RELATIVE("AccountLine",0), @RELATIVE("AccountOther",0), "FY02", "Working")
Agg("Entity") ;
ENDFIX
It became a major issue. Your inputs will really help us.
Thanks in advance

Couple of unknowns here but here's a few tips:
1. Run the script in MaxL and ensure that you log users out, kill all existing app processes. Now even if this isn't do-able in the long run, you want to test this out to see that the result is consistent. A lot of times your process is waiting for other online processes to finish.
2. Defragmentation of the BSO cube could be the cause. If you defrag the cube and the 1st time run is fast, and the 2nd time run is slow, then you have created alot of blocks that shouldn't be there. And that's your problem and you need to tune the way you agg.
3. Check essbase statistics especial average cluster ratio to be 1
Daniel Poon

What is the procedure/code in VBA for passing the calc scripts dynamically based on the selection.

Hello Gurus,
I want to know what is the procedure/code in VBA for passing the calc scripts dynamically based on the selection.
For example:
X=EssVCalculate("Sheetname","Calc_Script name",True)
In the above code instead of the *"Calc_Script name"* I want a script which is called dynamically and the values are calculated accordingly.
Thanks in advance
Saurabh

Hi Todd,
This is the situation:
I have a calc script in Essbase which I can call to perform the calculations on the current sheet that is retrieved. I want calculation for the following formulas:
x = EssVCalculate("Sheet2", "CalcBC", False)
CalcBC is my calc script which is present in Essbase
So instead of passing the above script I want to pass the conditions dynamically in the VBA code . I don't want to mention the script name directly in EssVCalculate option
For example:
I have three drop down menus from which I would select three different( zero level )members. It would then retrieve the data for that particular values in the excel sheet and now when I click on Calculate button it should calculate the script dynamically.
I don't know how calc scripts can be executed dynamically in the VBA code itself.
Thanks in Advance
Saurabh

Calc Script runs slow one day and fast the next?

We are on Essbase 11.1.2.1. When we run calc scripts to load our actuals and run some allocation scripts, the difference in running time for the same exact script is very different day to day. One day three hours the next 45 minutes. Our servers are just for Essbase. We are on Windows 2008 R2. Has anyone else run into this or have any idea how we could figure out the reason for this. Thanks.

Thanks. In that case, I would try to grab the cube statistics - especially number of upper-level and input blocks, compression ratio and fragmentation (in EAS you can only see one of the two fragmentation statistics, 'Average Clustering Ratio', not 'Average Fragmentation Quotient') before each run, just to see if they're varying wildly. Also, if your calc scripts log summary information (is there a SET MSG command in them? If not you could try SET MSG SUMMARY) then Essbase will write high-level statistics on how much work was done to the application log.
You can see which cubes are loaded (and consuming memory) in the EAS treeview - if they have a check (tick) mark they are loaded. But you can also see current activity by right-clicking on the server in the EAS treeview and selecting Edit | Sessions. That will show whether there are other operations (loads, calcs, reports, restructures etc) occurring at the same time.
If none of the above give any clues and this is a virtual box (or you have SAN storage) you really will need someone who understands your infrastructure to help.
I'm assuming these are BSO cubes, by the way!

Calc scripts running very Long time

Hi All,
Recently, i am migrated the objects from Production to Test region. We have 5 applications and each of the application has a set of calc scripts.
In test region, they are running really long time. Where as in Production, they run for less time.
In TEST region each Calc script is taking 10 times more time than the Production times.
No Dimension added or no script is updated. No difference in objects between TEST and PROD.
Please suggest me, why is this difference.
Thanks
Mahesh

The obvious first question would be if the hardware is different. You would expect prod to be a more powerful server and therefore perform better.I'm seeing a lot of virtualized test servers (who knows, really, what power the box has) and real prod servers. That can make a huge difference in performance.
It makes benchmarking tough -- yes, you can see how long something will take relative to another process, but there isn't any way to know how it will perform in production until you sneak it over there and benchmark it. It can be a real PITA for Planning.
And yes, the theory is that dev and prod are similar so that the above isn't an issue, but that seems to be a more theoretical than actual kind of thing.
Regards,
Cameron Lackpour

Calc Scripts run a lot faster after I copy existing database

Hi,
I have user being setup as the Application Designer of the application and each time when he run scripts of the database, it takes a lot longer than myself (I'm the Supervisor). The database was built up from scratch, so it is not database copy version. Could this be user specific problem?
Today, I create another copy of the database within the same application, create a new Scenario, load data, run multiple similar scripts and the time to run all scripts were alot faster when I run from initial database. Is this a coincidence or the performance has indeed improved?
Your advice is much appreciated!
Between, Im running on Essbase 7.1.3.0
Thank you

So are you saying you are the one to run the scripts after initial DB load?
What are the index and page size before and after you run the scirpts?
It is somewhat normal for the inital dataload and agg to run faster than subsequent runs of the agg, this is because typically inital data load is level 0 only members. The agg of the database will then create blocks for upper level members, thereby increasing the DB size. So there are more index entries, as well as blocks to parse thru.
That being said, if there is considerable increase in agg time, there may be more to address (fragmentation, block size, dynamic calc on sparse members, etc).
Robert

Fixing the calc script in FDM Planning adaptor

Hi All,
I have run into a issue with the load action in the planning adaptor ES9x-G4-A. By default, when the adaptor loads data into essbase it fixes using the script
                                   '*** CALC SCRIPT ***
                                        'NOTE: CALC SCRIPT CAN BE MODIFIED For Each CUSTOMER
                                        'Clear the intersection of (Category, Period, Entity)
                                        strClear = "Fix(""" & strTCat & """,@Idescendants(""" & strCurEnt & """))" & vbcrlf
                                        strClear = strClear & "CLEARDATA """ & strTPer(0) & """;" & vbcrlf
                                        strClear = strClear & "EndFix"
The issue with this is that it doesn't fix on year, meaning that data loaded with a replace will wipe the same period across every year. Does anyone know what the year variable is to set the fix correctly? I can't find it in any of the documentation, for 9.3.1 or 9.2
Thanks.
KMacintosh

Hi,
{color:#000000}Try updating the load script to be :-
{color}{color:#ff0000}strTargYear = API.POVMgr.fPeriodKey(CStr(strPer(0))).strTargetYear
'*** CALC SCRIPT ***
'NOTE: CALC SCRIPT CAN BE MODIFIED For Each CUSTOMER
'Clear the intersection of (Category, Period, Entity)
strClear = "Fix(""" & strTargYear & """,""" & strTCat & """,@Idescendants(""" & strCurEnt & """))" & vbcrlf
strClear = strClear & "CLEARDATA """ & strTper(0) & """;" & vbcrlf
strClear = strClear & "EndFix"
Cheers
John
[http://john-goodwin.blogspot.com/]{color}

Using VB API in VBA to edit the Calc Scripts

Guys,
Does anyone of you have VBA source code/examples utilizing Essbase API for the following operation.
I want to copy Calc Script from Server to the client, edit the Script using VBA and copy back the Script to the Server. Any kind of info is appreciated.
Thanks in advance
HYPuser

I posted some real sample code a while back for a completely different function (member renames).
Renaming Existing Member Names
So while you'll have to write the calc modification code yourself (or ask Glenn his rate ;-)), this at least shows you how the initialization / login / termination of the API would work. That's probably the most confusing aspect of using the VB API for the first time anyway.
All that said, if this is from Excel and the user will already be logged in via the Excel Add-In, I believe that you can make life much easier and grab the hCtx directly without any initialization / login/ termination worries. I probably should have done that myself in the example I gave. See Tim Tow's posts in this thread:
API
EDIT: Two things I just noticed - first, the code sample I gave even has an example of polling for ProcState, so that gets you closer than I thought! Second, remembered that the line that reads...
While ProcState.State ESB_STATE_DONE
...should actually have a 'less than / greater than' symbol between ProcState.State and ESB_STATE_DONE. Can't get the forum to display them correctly, even in code tags...
Edited by: TimG on May 16, 2011 2:55 PM

Will block size effect the calc script performance?

Hi Experts,
I have a cube called RCI_LA:RCI_LA, now I have created calc scripts and working fine. But those calc scripts are taking too much time than expected (normally it should not take more than 15 min but those are taking nearly 1 hr or more some calc scripts.)
In database properties I found that block size is 155896 B i.e. 152.KB but this size should be 8 to 100 KB & Block density is 0.72%
If block size exceeds more than 100 KB will it impact the performance of Calc scripts?
I think answer to the above question is “yes”. In this case what should I need to do to improve calc scripts performance?
Could you please share your experience here with me to come out of this problem?
Thanks in advance.
Ram

I believe Sandeep was trying to say "Dynamic" rather than "Intelligent".
The ideal block size is a factor in all calcs, but the contributing reasons are many (The main three are CPU caching, Data I/O overhead, Index I/O overhead).
Generally speaking, the ideal block size is achieved when you can minimize the combination of Data I/O overhead and Index I/O overhead. For this reason a block size that is too large will incur too much Data I/O, while a block size that is too small will incur too much Index I/O. If your Index file is small, increasing your block size may help, although the commonly acceptible block size is between 8K and 64K in size, this is just a guideline.
In other words, if you test it with something right in the middle and your index file is tiny, you might want to test it with a smaller block size. If your index file is very large (i.e. 400 MB or more), you may want to increase the block size and retest.
Ways to increase/decrease it are also many. Obviously, changing the dense/sparse settings is the main way, but there are some considerations that make this a touchy process. Other ways are to use dynamic calc in the dense dimensions. I say start at the top of your smallest dense dimension and keep the number of DIMENSIONS that you use D-C on limited. Using D-C members in a dense dimension does NOT increase the index file, so it could be considered a "free" reduction in block size -- the penulty is paid on the retrieve side (there is no free ride).

Why the need to "run as administrator"?

Our of curiousity, why do I need to run Premiere Elements 8 using the "Run as administrator" in Windows 7?
It is a bit annoying to have to type in a password just to run Premiere Elements 8 since I never use the administrator account to anything.

I dont run Win7, but I do run Vista-64, and I can attest to the fact that the Windows Security framework is a dark hole that is difficult for most to navigate thru and completely understand.
One can assume that with Win7, it's still a grey area that needs an official decoder ring for even the simple tasks.
I always install PE from the Admin Login and just give the rights to any User Account on the system.
With this approach I've never run into the situation where it must be Run as an Administrator.
If I'm not mistaken, PE may even require an Install from the Admin Login (I can't verify cause it's been so long that I've done the Install, that I don't remember).
The bottom line is if a particular Windows Object, PE in this case, is Owned by a particular Group or User, depending on it's Permissions and/or Access Rights will determine who can Run, Execute, or Modify that Object.
And unless your a Security maven, this could get real ugly, real fast (and you can screw up your System in a heartbeat if you don't know what your doing in this area).
Now you see why I install and Run it under the Admin Login and call it a day...

HT2476 Java - why does Java script run and interupt Scrabble on Pogo -

I spend more time trying to get the Java script off the Scrabble game - how come it takes over and how do I get rid of it??

Java or JavaScript? <br />
http://kb.mozillazine.org/JavaScript_is_not_Java
http://kb.mozillazine.org/Java <br />
http://kb.mozillazine.org/JavaScript

Why is the purge command running every hour, and freezing my system?

I noticed over the past several days that my mac pro will freeze for several seconds (clock stops, mouse/keyboard don't work. completely frozen) every hour, to the minute.
I've tracked it down to the "purge" command, which is causing the problem. But, I can't find where it's being called. Any hints where I might look to find the cause?
I don't believe this was happening a few days ago. I have installed all software updates.
I'm running 10.7.5 on a 2x2.66Ghz 6-core mac pro.
Thanks!

Please read this whole message before doing anything.
This procedure is a diagnostic test. It won’t solve your problem. Don’t be disappointed when you find that nothing has changed after you complete it.
Third-party system modifications are a common cause of usability problems. By a “system modification,” I mean software that affects the operation of other software — potentially for the worse. The following procedure will help identify which such modifications you've installed. Don’t be alarmed by the complexity of these instructions — they’re easy to carry out and won’t change anything on your Mac.
These steps are to be taken while booted in “normal” mode, not in safe mode. If you’re now running in safe mode, reboot as usual before continuing.
Below are instructions to enter some UNIX shell commands. The commands are harmless, but they must be entered exactly as given in order to work. If you have doubts about the safety of the procedure suggested here, search this site for other discussions in which it’s been followed without any report of ill effects.
Some of the commands will line-wrap or scroll in your browser, but each one is really just a single line, all of which must be selected. You can accomplish this easily by triple-clicking anywhere in the line. The whole line will highlight, and you can then copy it. The headings “Step 1” and so on are not part of the commands.
Note: If you have more than one user account, Step 2 must be taken as an administrator. Ordinarily that would be the user created automatically when you booted the system for the first time. The other steps should be taken as the user who has the problem, if different. Most personal Macs have only one user, and in that case this paragraph doesn’t apply.
Launch the Terminal application in any of the following ways:
☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
☞ Open LaunchPad. Click Utilities, then Terminal in the icon grid.
When you launch Terminal, a text window will open with a line already in it, ending either in a dollar sign (“$”) or a percent sign (“%”). If you get the percent sign, enter “sh” and press return. You should then get a new line ending in a dollar sign.
Step 1
Triple-click the line of text below to select it:
kextstat -kl | awk '!/com\.apple/{printf "%s %s\n", $6, $7}'
Copy the selected text to the Clipboard by pressing the key combination command-C. Then click anywhere in the Terminal window and paste (command-V). Post the lines of output (if any) that appear below what you just entered. You can do that by copying and pasting as well. Omit the final line ending in “$”. No typing is involved in this step.
Step 2
Repeat with this line:
sudo launchctl list | sed 1d | awk '!/0x|com\.(apple|openssh|vix)|edu\.mit|org\.(amavis|apache|cups|isc|ntp|postfix|x)/{print $3}'
This time you'll be prompted for your login password, which you do have to type. It won't be displayed when you type it. Type it carefully and then press return. You may get a one-time warning to be careful. Heed that warning, but don't post it. If you see a message that your username "is not in the sudoers file," then you're not logged in as an administrator.
Note: If you don’t have a login password, you’ll need to set one before taking this step. If that’s not possible, skip to the next step.
Step 3
launchctl list | sed 1d | awk '!/0x|com\.apple|edu\.mit|org\.(x|openbsd)/{print $3}'
Step 4
ls -1A /e*/mach* {,/}L*/{Ad,Compon,Ex,Fram,In,Keyb,La,Mail/Bu,P*P,Priv,Qu,Scripti,Servi,Spo,Sta}* L*/Fonts 2> /dev/null
Important: If you formerly synchronized with a MobileMe account, your me.com email address may appear in the output of the above command. If so, anonymize it before posting.
Step 5
osascript -e 'tell application "System Events" to get name of every login item' 2> /dev/null
Remember, steps 1-5 are all copy-and-paste — no typing, except your password. Also remember to post the output.
You can then quit Terminal.

Why the Calc Script runs 15 hours?

Similar Messages

Maybe you are looking for