Which is optimal one among AGG and CALC DIM??

Hi Frndz,
I knew the difference between AGG n CALC DIM but i'm not sure which is the optimal one.Is there any specific situation to use them when should we go for them.
Thanks

Hi John,
I am responding to this post after such a long period. But i found that this is perfectly relevant to the situation i am facing.
Actually we have been using the CALC DIM function for aggregation. Recently we replaced this by AGG as i read that AGG is more optimal when you are aggregating sparse dimensions with less that 6 levels. All the dimensions we are aggregating have less than 6 levels. But after using the AGG command my database size increased exponentially from 53G to 90G. This was the only change i did in the process. Then i cleared all data and imported level 0 and did the aggregation using CALC DIM again. Now the database size is back to normal.
I am not able to understand why this happened in my case. Even the rules were taking more time to run as compared to Calc Dim.
If you can please through some light on this.
Regards
Vikas

Similar Messages

  • AGG and CALC DIM Essbase script recently started to grow our pag files

    We have a Essbase script that does nothing but AGG and CALC DIM that ran fine for months in that it did not grow our Workforce cube. Starting in late Jan it started to grow its pag files. Workforce cube used to be 7 GB in Dec 2010, then it grew to 10GB today. I tested running it and it grew our pag files by 170MB 2nd time and then by 70MB the 3rd time I ran it. Has anyone seen this?

    Thanks a million Cameron.
    1) I do dense restructures every night - apparently that does not remove all defragmentation.
    last questions:
    2) I exported level zero, cleared all data, then imported level zero data. That should clear up all defragmentation, wouldn't it?
    3) After importing level zero data, I ran a simple Calc Dim calc script on Accounts dim only on this Workforce BSO cube that is only 400MB. It took over 30 mins. On my second and third run of same calc script, it took 9 mins. My BSO cube grew a few MB. Can I assume that blocks have been build by first run and that all subsequent runs will stay around 9 mins since blocks have now been build?
    Here is the calc script
    SET CACHE HIGH;
    SET UPDATECALC OFF;
    SET CLEARUPDATESTATUS OFF;
    SET LOCKBLOCK HIGH;
    SET AGGMISSG ON;
    SET CALCPARALLEL 3;
    FIX (febscenario,Working)
    FIX(@RELATIVE(TTC,0),@RELATIVE(TCI,0),@LEVMBRS("Project",0),@RELATIVE("Total Employees",0))
    FIX(FY11, FY12 "Jan":"Dec")
    FIX("HSP_InputValue","Local","USD")
    CALC DIM ("Account");
    CALC TWOPASS;
    ENDFIX
    ENDFIX /* &YearNext */
    ENDFIX
    ENDFIX
    4) When I calc only FY11, it takes 3 seconds to calc on the first to 4th run of the above calc. However, when I calc FY12, it takes over 30 mins on first calc and 9 mins subsequently. Why is that? Should I use SET CALCONMISSINGBLK in my calc script?
    5) I am running calc as Essbase admin user. The level zero text file I loaded is only 460MB. After calc, the BSO cube's pag files are only 420MB. We are thinking of calc'ing older scenarios for historical purposes but am not sure if that will degrade the calc performance. My experience has been that - increasing the size of the BSO cube by calc'ing will degrade future calc times. Is that your experience?
    Edited by: Essbase Fan on Feb 25, 2011 9:15 AM
    Edited by: Essbase Fan on Feb 25, 2011 9:17 AM

  • What is wrong with this? AGG on sparse and Calc Dim on Dense?

    I have this....
    FIX(@IDESC(Sparse parent member))
    CALC DIM(Dense,Dense,Dense);
    Agg(Sparse,Sparse);
    ENDFIX
    No formulas in outline ....just followed simple perf impro technique.....as they say...agg faster on sparse.Syntatically is abstly right but result is not right......?
    Whats the catch? do i need to attend some basic classes???:-P
    Edited by: 961729 on Sep 26, 2012 10:27 PM

    Thanks Cameroon and Tim for your reply!
    Perhaps i should have listed more details...my bad!. Anyway my idea was to know if two of below fixes produce same result...?
    Fix(Sparse)
    Calc dim(Dense,Dense,Dense,Sparse,Sparse);
    Endfix
    Fix(Sparse)
    Calc dim(Dense,Dense,Dense);
    Agg(Sparse.Sparse);
    Endfix
    Coming to my earlier mentioned fix....well that is the conclusive fix of my allocation script..I have two children of version dim. One is used for allocation and other to put adjustment. So in that fix iam just aggregating all dim for version dim (allocation +adjustment).                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               

  • Essbase Defrag and Calc Issue

    I have a calcscript will runs against a BSO cube with 11 dimensions and it runs for 15 mins. The script does some calculations and rollups (AGG and CALC DIMS etc). I can see the blocks go from 15k blocks to 500k blocks at the end.
    And then when I re-run the script, it runs for over 2 hours and of course it's due to the block explosions and all. And so, I do a defrag and clear upper blocks by doing a:
    CLEARBLOCK UPPER;
    CLEARBLOCK EMPTY;
    After this the number of blocks goes way down to 25k blocks.
    And still the calc continues to run over 2 hours. So my question is why this behavior? Is there anything I can do besides reloading the cube from scratch? I know if I do a complete clear it obviously runs the same timing again. But I want to be able to not have to do that. Is there a step I am missing?

    Here are some tips:
    - please review "intelligent calculation" - this feature helps when only a few blocks are changed to limit the recalculation to affected blocks
    - your index cache may be to low - index has grown with number of blocks beyond your index cache size -> more disk IO than your setup can handle
    - overall design needs tuning (block size / density / dynamic calculations / ...) -> contact a consultant
    - what is the business case for 10 min calc time limit? Will users wait for calculation to finish?
    Sascha.

  • Calc Dim vs IDESCENDANTS performance

    I try to aggregate (LegalEntity, LegalEntityICP, EntityICP)
    script1:
    FIX(&vYear,&vScenario, &vVersion, ......)
    ___CALC DIM(LegalEntity, LegalEntityICP, EntityICP);
    ENDFIX
    Execute time: 1201sec
    I execute the same slice in script2:
    FIX(&vYear,&vScenario, &vVersion, ......)
    __ FIX(@IDESCENDANTS(LegalEntity)
    ______@IDESCENDANTS(LegalEntityICP))
    __________ @IDESCENDANTS("EntityICP",-1);
    __ ENDFIX
    __ FIX(@IDESCENDANTS(LegalEntity)
    ______ @IDESCENDANTS(EntityICP))
    __________ @IDESCENDANTS("LegalEntityICP",-1);
    __ ENDFIX
    __ FIX(@IDESCENDANTS(LegalEntityICP)
    ______@IDESCENDANTS(EntityICP))
    __________ @IDESCENDANTS("LegalEntity",-1);
    __ ENDFIX
    ENDFIX
    Execute time: 623sec
    Why CALC DIM work so long? When I use AGG execute time is more then 1800sec!!!!
    I try to play with dim order, I move LegalEntity, LegalEntityICP, EntityICP on top (under dense dim) but result still the same.
    But when I try to reduce agg slice it`s work stable.
    FIX(&vYear,&vScenario, &vVersion, ......, @IDESCENDANTS(LegalEntityICP))
    __ CALC DIM(LegalEntity, EntityICP);
    ENDFIX
    Execute time: 117sec
    FIX(&vYear,&vScenario, &vVersion, ......, @IDESCENDANTS(LegalEntityICP))
    __ AGG(LegalEntity, EntityICP);
    ENDFIX
    Execute time: 117sec
    FIX(&vYear,&vScenario, &vVersion, ......, @IDESCENDANTS(LegalEntityICP))
    __ FIX(@IDESCENDANTS(LegalEntity))
    ______ @IDESCENDANTS("EntityICP",-1);
    __ ENDFIX
    __ FIX(@IDESCENDANTS(EntityICP))
    ______ @IDESCENDANTS("LegalEntity",-1);
    __ ENDFIX
    ENDFIX
    Execute time: 116sec

    Wow, you are covering a bunch of different issues.
    Here's the issue -- the number of blocks the code touches. The more it has to address, the slower it goes. There's no way round that.
    There are a few things you can do:
    1) Introduce parallel calcs (I am assuming a calc script, not a user-run Business Rule). See the [Tech Ref|http://download.oracle.com/docs/cd/E12825_01/epm.111/esb_techref/set_calcparallel.htm] for more information. The DBAG also has information on this -- you should understand the theory behind it before you go full speed on it.
    2) Adjust your data and index cache (this one is only going to help a little). See the DBAG for more information on this. Do not dedicate your life to this one -- there are some quick hits that can help; going beyond will be an exercise of increasing effort for decreasing results.
    3) Make sure you FIX on level zero of all of your other dimensions.
    4) Think about what's in your block. Accounts and Time don't have to be the only ones. Do you know how densely populated your other dimensions are? Search this board for techniques to figure that out. The denser the dimension, the more likely it is to be in the block. Blocks size becomes a lot more plastic if you're on 64 bit Essbase.
    5) Btw, you have the right idea when it comes to limiting the scope of the calc to get better times. I use that approach for different purposes in Planning Business Rules as shown in my blog.
    Okay, enough of the general comments, I'll try your questions in order:
    FIX(&vYear,&vScenario, &vVersion, ......)
    ___CALC DIM(LegalEntity, LegalEntityICP, EntityICP);
    ENDFIX
    Execute time: 1201sec^^^You're doing a full calculation of all dimensions. I'm a little surprised AGG is slower than CALC DIM as the times are usually reversed, but I wonder if you did a restructure between runs -- my guess is not so the AGG was maybe running on a fragmented db?
    FIX(&vYear,&vScenario, &vVersion, ......)
    __ FIX(@IDESCENDANTS(LegalEntity)
    ______@IDESCENDANTS(LegalEntityICP))
    __________ @IDESCENDANTS("EntityICP",-1);
    __ ENDFIX
    __ FIX(@IDESCENDANTS(LegalEntity)
    ______ @IDESCENDANTS(EntityICP))
    __________ @IDESCENDANTS("LegalEntityICP",-1);
    __ ENDFIX
    __ FIX(@IDESCENDANTS(LegalEntityICP)
    ______@IDESCENDANTS(EntityICP))
    __________ @IDESCENDANTS("LegalEntity",-1);
    __ ENDFIX
    ENDFIX
    Execute time: 623secSo it's faster, but of course you're not calculating level 0. Why? How do you even have any values at level 1? From the above AGG and CALC DIM tests I would guess. In any case, you're doing three passes through the database and these calcs are not going to work for you in the real world.
    FIX(&vYear,&vScenario, &vVersion, ......, @IDESCENDANTS(LegalEntityICP))
    __ CALC DIM(LegalEntity, EntityICP);
    ENDFIX
    Execute time: 117sec
    FIX(&vYear,&vScenario, &vVersion, ......, @IDESCENDANTS(LegalEntityICP))
    __ AGG(LegalEntity, EntityICP);
    ENDFIX
    Execute time: 117secI'm not sure why you repeated yourself, but you know your code is not calculating LegalEntityICP.
    FIX(&vYear,&vScenario, &vVersion, ......, @IDESCENDANTS(LegalEntityICP))
    __ FIX(@IDESCENDANTS(LegalEntity))
    ______ @IDESCENDANTS("EntityICP",-1);
    __ ENDFIX
    __ FIX(@IDESCENDANTS(EntityICP))
    ______ @IDESCENDANTS("LegalEntity",-1);
    __ ENDFIX
    ENDFIX
    Execute time: 116secSo now you're taking a different tack, and still not calculating LegalEntityICP, which has to be calculated sooner or later.
    You've proved that the fewer blocks your code addresses, the faster it runs.
    However, since you need to calculate this data sooner or later, I'd go with one of the general recommendations (and I am sure others will chime in, too) and start working with those approaches.
    Good luck!
    Regards,
    Cameron Lackpour

  • CALC DIM or AGG - Can we aggregate from higher levels?

    Hello everyone,
    We have a custom dimension called LOCATION, under which we have Continents ASIA and EUROPE. Under ASIA and EUROPE we again have countries (India & England) under which there are states. Now data may be entered at a Continent level or Country level. If we do a normal AGG or CALC DIM operation, the higher level data will get overwritten since aggregation is done on a bottom up basis from zero level members.
    Can we aggregate from a higher level (say Country or Continent) in the dimension up to the Location level (i.e. override the default zero level up aggregation) ?
    PS: Creating a dummy member would not be an elegant solution, since I have presented the problem in a much simplified way, and there are many level of hierarchies - and a dummy will be required under each hierarchy level.
    Any suggestion would be of great help.
    Thanks..
    Sayantan

    I know you are against creating dummy members but if you don't there is no way to know for sure you are aggregating correctly. Most people want to see the dummy members just so they know why the parent doesn't equal the sum of all the children.
    We have a million+ member customer dim. Quite a few of them are loaded at the parent level. Our parent child hierarchy (not dim) gets built from the fact table+dim. So if the etl finds a record in the fact table that has children in the dim table it creates the dummy member to load the data to. This has worked well for us. Good luck.
    Edited by: user7332747 on Apr 23, 2009 1:34 PM

  • CALC DIM Issue

    I have a Essbase (v11.1.1.3) calc script that I can't see to get to do what I want.
    Here is my script:
    SET UPDATECALC OFF;
    SET UPTOLOCAL OFF;
    SET AGGMISSG ON;
    SET FRMLBOTTOMUP OFF;
    SET CALCPARALLEL 3;
    SET CALCTASKDIMS 2;
    FIX ("Customer1","May Scenario","Working","FY11","May-MTD",@DESCENDANTS ("Total Product Revenue"))
    CALC DIM ("Regions","Projects","Product Lines","Countries","Companies","Currencies");
    ENDFIX
    I have data in at level 0. Total Product Revenue is in my Accounts dim and the sub-accounts (level 0 members) under it are not rolling up even though all the consolidation operators are set to +. The reason I am doing the @DESCENDANTS("Total Product Revenue") is that with this calc script I just want to aggregate Total Product Revenue and the accounts under it, not the other members in the accounts dimension.
    If I have missed anything please let me know.
    Thanks,
    Ken

    One other note. The order you do things can also depend on what is dense and what is sparse. For example if your accounts dimensions is dense, you would want to fix on level zero members of the other dimensions and do the agg if it first. then do the fix on the members of the dimensions including accounts and calc dim the other dimensions. It is more efficient because you are only doing the calculation on the bottom level of the dense dimension then calculating the sparse dimensions

  • I run a Windows 8.1 -  Photoshop CS5 under Parallels on an iMac one year old and both having the latest OS. I use a NIK plugin "VIVEZA" which run fine for years without a problem. Latelt and without a reason, the NIK plugin has gone corrupt, (can not use

    @I run a Windows 8.1 -  Photoshop CS5 under Parallels on an iMac one year old and both having the latest OS. I use a NIK plugin "VIVEZA" which run fine for years without a problem. Latelt and without a reason, the NIK plugin has gone corrupt, (can not use it more the 2 corrections after a get a black background message that there is not enough memory) and the system stops running and a must restart is required. How do I fix this terrible problem?
    If it requires a Photoshop CS5 re-install, (I belief that it may fix the problem) and re-install the two third party plugins (NIK Viveza) and (Onone Perfect Resize) how and where do I get to the proper Adobe upload page to do that.
    I have tried to fix this problem by changing the memory allocations, I have spend many hours on it and are very disgusted with it but it needs to be fixed. The current memory settings are;
    Ram available = 1588 MB
    Range = 873 -1143 MB
    Recommended Photoshop usage range =  857  however I have tried every setting to max and in between. Nothing works. Current setting = 1588 (max)
    The Photoshop I use is registered, I have product # and order # .

    Contact NIK for updated/upgraded versions of their plug-ins.  They have been having a lot of issues with their plug-ins.

  • Want to cancel my Photoshop one-year plan and change to a full student annual plan, but when I click on cancel plan it only tells me to view my billing info which doesn't help at all!

    I'm trying to cancel my Photoshop one-year plan and change to a full student annual plan, but when I click on cancel plan it only tells me to view my billing info which doesn't help at all!

    Cancel http://helpx.adobe.com/x-productkb/policy-pricing/return-cancel-or-change-order.html
    -or by telephone http://helpx.adobe.com/x-productkb/global/phone-support-orders.html
    Upgrade single to all Cloud http://forums.adobe.com/thread/1235382 may help

  • My iphone is synced and backed up with another computer which is now broken... and i have synced it with a new one but when i want to do anything itunes says all data will be erased and replaced with the current itunes library?what do i do?

    my iphone is synced and backed up with another computer which is now broken...i have synced it with my new computer  but it hasnt transfered anything over to itunes and when i try to add anything to my iphone it says all data will be erased and replaced with the current itunes? i dont want to lose all my apps and music.... i dont know how to go around this problem? i want to back it all up and sync it properly to my new computer so that is now my main computer , so i can add ring tones and music etc with out it erasing everything ive got. any answers would be great and muchly appreciated. thanks, im not sure what operating system my iphone has either.....

    It has always been very basic to always maintain a backup copy of your computer for just such an occasion.
    Use your backup copy of your computer to put everything on the new one.
    It sounds like you have failed to do this, which is not good at all.
    You will have to transfer your itunes purchases from your iphone.  Authorize your computer for your itunes account 
    About iTunes Store authorization and deauthorization
    Open itunes, plug in iphone, do NOT sync, click File>Transfer Purchases
    When you do sync you will lose your pics ( photo library - synced from your old computer), your itunes content ( music, apps, videos,etc) , your contacts and your calendars.  So do NOT sync yet.  This is why a backup copy is so important.
    Enter one unique contact and calendar entry on your computer.
    When you first sync, you should get the option to merger the data.  Choose it.
    If you want your pics, then you will need to e-mail them to yourself before you sync.  They will not be of the original quality as they are reduced when synced to iphone.
    When all is as goos as it can be, then backup your computer, and always maintain the backup.

  • Which is better as UI technology among Flex and Oracle ADF for oracle SOA suit

    We have one application which is using oracle’s Service oriented Architecture (SoA) suite. Currently, there is a debate on the technology for UI in the new architecture that will be rich, easy to maintain, scalable and integrates well with SOA suite. We have two options one is Flex and other is Oracle ADF. UI part contains number of graphs, tabular and charts data. So it would be great if any one suggest which technolgy will be better for UI point of view. Thanks in advance.

    Hi,
    I looked at the demo
    http://download.oracle.com/otn_hosted_doc/jdeveloper/11gdemos/ADF112/ADF112.html
    It's interesting.
    However, I would point out two things:
    1- Before Oracle, Sun failed with UI technologies: there was AWT then Swing then Java FX. None of them was a star. The only place where Sun really won the UI war is the Bluray Disc format.
    2- About half of the RIA in the financial/banking industry are developed with Flex, the other half is developed with Silverlight / WPF. HTML 5 is being taken up by some, but you still end up with the usual problem of having to pick up an AJAX framework, and get tied to a vendor anyway in the end. Never heard about any project developed with Oracle ADF yet.

  • Which is better as UI technology among Flex and Oracle ADF for oracle SOA s

    We have one application which is using oracle’s Service oriented Architecture (SoA) suite. Currently, there is a debate on the technology for UI in the new architecture that will be rich, easy to maintain, scalable and integrates well with SOA suite.
    We have two options one is Flex and other is Oracle ADF.
    UI part contains number of graphs, tabular and charts data. So it would be great if any one suggest which technolgy will be better for UI point of view.
    Thanks in advance.

    Hi,
    I looked at the demo
    http://download.oracle.com/otn_hosted_doc/jdeveloper/11gdemos/ADF112/ADF112.html
    It's interesting.
    However, I would point out two things:
    1- Before Oracle, Sun failed with UI technologies: there was AWT then Swing then Java FX. None of them was a star. The only place where Sun really won the UI war is the Bluray Disc format.
    2- About half of the RIA in the financial/banking industry are developed with Flex, the other half is developed with Silverlight / WPF. HTML 5 is being taken up by some, but you still end up with the usual problem of having to pick up an AJAX framework, and get tied to a vendor anyway in the end. Never heard about any project developed with Oracle ADF yet.

  • I have 4 sets of slides for 4 product lines. I want thave a slide that lists the 4 products, click on which one I wnat and have it go to that set of slides. Is this possible?

    I have 4 sets of slides for 4 product lines. I want thave a slide that lists the 4 products, click on which one I wnat and have it go to that set of slides. Is this possible?

    Yes, use hyperlinks.

  • How to speed-up CALC Dim and/or AGG Dim

    Hello Everyone,
    I am new to Essbase and apologize for such a generic query. I came across a calculation script that takes more than 10 hours to execute. The crux of the script is CALC Dim (DIM) where DIM is a dense dimension with 11 levels (and a lot of calculated members). Can anyone guide me about the approach to be adopted to optimize the script. I was fiddling around with CALCCACHEHIGH parameter in essbase.cfg file and the SET CACHE HIGH declaration in the script. Will that help?
    Some details of the original script are outlined below. The basic optimization parameters are in place (like the dense dimensions are at the end of the FIX list etc)
    Thanks.
    Sayantan
    Script details:
    SET AGGMISSG ON;
    SET CREATENONMISSINGBLK ON;
    SET UPDATECALC OFF;
    SET FRMLBOTTOMUP ON ;
    SET CACHE ALL;
    SET CALCPARALLEL 5;
    SET CALCTASKDIMS 2;
    SET LOCKBLOCK HIGH;
    FIX (&pln_scenario,"BU Budget",&plan1_yr,@RELATIVE("Product",0), @RELATIVE("YearTotal",0),... etc
    CALC DIM ("Account");

    Hi,
    Thanks for your suggestions. I will definitely try to implement them and post the results. Meanwhile, here's another script which should not take too long to run. However, this script runs for hours. Any suggestions would be great (this does not have the cache options implemented yet). I have added some more details about the dimensions involved.
    Outline of the script:
    /*Script Begins*/
    SET UPDATECALC OFF;
    SET CACHE ALL;
    SET CALCPARALLEL 5;
    SET CALCTASKDIMS 2;
    SET NOTICE LOW;
    SET MSG SUMMARY;
    FIX (@ATTRIBUTE("Existing"),@Relative("DC",0),@RELATIVE("PCPB",0),&pln_scenario,"BU Budget",&plan1_yr,@RELATIVE("YearTotal",0))
    FIX(@RELATIVE ("RM",0))
    SET CREATENONMISSINGBLK ON;
    "RMQ" = "DC wise Sales Volume"->"UBOM" * "RMQ per Unit SKU"->"All DC"->"YearAgg";
    ENDFIX;
    ENDFIX;
    /*Script Ends*/
    Dimension details: Evaluation Order which has been thought through.
    Dimension Members Density
    Account 352 Dense
    Period 35 Dense
    Version 3 Sparse
    Scenario 8 Sparse
    DC 7 Sparse
    Year 9 Sparse
    Entity 20 Sparse
    Product 416 Sparse
    BOM 938 Sparse

  • If i have two option to select between XI or BW which one in better and why

    if i have two option to select between XI or BW which one in better and why
    both in terms of money and in terms of my career growth.......

    Sheetika,
    XI if you  are good in JAVA.The rest is same for both XI and BW.
    K.Kiran.

Maybe you are looking for

  • Cast multiset help needed

    I have the following sql SELECT * FROM (SELECT updatedby, updateddate, ROWNUM, ent_id FROM (SELECT hstbe.updatedby, hstbe.updateddate, TO_CHAR (hstbe.entry_id ) ent_id FROM hst_rb_booking_entry hstbe --WHERE hstbe.entry_id = entryid UNION SELECT hstl

  • Can't import photos from camera

    I was downloading some photos from my Digital Rebel XSi with no problems. Then I switched cards and all of a sudden, it wouldn't load the photos. I could still view the photos on the camera, so they were definitely there. It was as if Aperture just d

  • Conversion of sap spool to pdf page in landscape mode.

    Hi All, I have a requirement where I need to print the output from a spool request in SAP to a pdf page . The page has to be in landscape format.  Is it possible to create a pdf page which is always in landscape format? I am using FM convert abapspoo

  • Logical Dictionary

    Hi, When we are creating a model using Adaptive RFC model, we have to enter different details like..Model Name, Model Package,Default Logical System  Name for  model Instance and RFC MetaData and Logical Dictionary.... What is the importance of Logic

  • Can I append a Ticker on a Canvas?

    Hi, I am very new to J2ME. Just want to know whether it is possible to append a Ticker onto a Canvas as done in a Form. Please help me by giving any suggestions on some method to do this.