Trouble with Formula Engine vs Storage Engine (xEvent Trace Analysis)

xEvents Trace Query Analysis (Formula Engine vs Storage Engine)
Got a poorly performing query (relatively speaking) and looking for ways to improve the performance. My first step was to run an xEvents trace to figure out if the bottleneck is in the Formula Engine (FE) or Storage Engine (SE). So I kicked off a trace capturing
the following events:
QueryEnd - single event providing the total duration of the query
QuerySubcube - 1 event per storage engine request
Next, I cleared the cache and executed the query. Once the query completed (~28sec later) I stopped the trace and ran a XML-shredding query like the one below:
I copied the results to an excel workbook and sum'd the duration column for all "QuerySubcube" events and the total duration was ~42sec (or 42113ms). This number represents (typically) the total duration spent in the storage engine. You can subtract
it from the duration of the single "QueryEnd" event and back into the amount of time spent in the formula engine. 
However, the duration for the single "QueryEnd" event was ~24sec (or 24128ms)...
Total Query Duration (24sec) - StorageEngineDuration (42sec) = FormulaEngineDuration (-18sec)
FWIW, this is a beast of a query (~1500 lines)
Has anyone seen this before?
BI Developer and lover of data (Blog |
Twitter)

Hi Richard - that definitely sounds right and now it makes more sense seeing as the query is hitting several different measure groups. Thanks for getting me back on the right path ;-)
/gumption-trap
BI Developer and lover of data (Blog |
Twitter)

Similar Messages

  • Having Trouble With Formula

    i am doing an assignment and im having a lot of trouble with it.
    here is what it is asking for
    read a value representing a number of seconds, then print the equivalent amount of time as a combination of hours, minutes, and seconds. (For example, 9999 seconds is equivalent to 2 hours, 46 minutes, and 39 seconds).
    and so far i have this
    package Convert;
    import java.util.Scanner;
    public class nSeconds {
    public static void main(String[] args)
    long Seconds = 0;
    long Hours = 0;
    long Minutes = 0;
    Scanner scan = new Scanner(System.in);
    System.out.println("Please enter the hours: ");
    Hours = scan.nextInt();
    System.out.println("Please enter the minutes: ");
    Minutes = scan.nextInt();
    System.out.println("Please enter the seconds: ");
    Seconds = scan.nextInt();
    Seconds = (Hours*3600) + (Minutes*60) + (Seconds + 0);
    System.out.println("The total number of seconds is: " + Seconds);
    please help me with the formula
    thanks

    sorry that was the wrong app.
    this is the code i need help with
    package Convert;
    import java.util.Scanner;
    public class reverseSeconds {
         public static void main(String[] args)
              long Hours = 0;
    long Minutes = 0;
    long Second = 0;
              Scanner scan = new Scanner (System.in);
              System.out.println ("Please enter in the seconds:");
         Second = scan.nextInt();
         Hours = (Second / 3600);
         Minutes = (Second / 60) + Minutes;
         Second = Second / 60;
         System.out.println ("Hours:" + Hours);
         System.out.println ("Minutes:" + Minutes);
         System.out.println ("Seconds:" + Second);
         System.out.println(Hours + " Hours :" + Minutes + " Minutes:" + Second + " Seconds");
    }

  • I'm using internet explorer(yuk!!) and am having trouble with getting back my search engine "google" and all i get is "blank page", can u help?

    First of all, forgive me cuz I'm probably NOT the sharpest "chip in a laptop" but I use Internet Explorer as my ISP(I've heard that GOOGLE CHROME is soo much better??) and Google as my search engine. For some reason(I know, probably USER idiot!!) even though I have set in my "internet connections" tab, www.google.com chosen, the minute I click a new tab to look for something else, that dreaded "about blank" or maybe "blank page" comes up.....wtheck???? Can u help me pleeez......thank u ..

    It is possible that your security software (firewall, anti-virus) blocks or restricts Firefox or the plugin-container process without informing you, possibly after detecting changes (update) to the Firefox program.
    Remove all rules for Firefox and the plugin-container from the permissions list in the firewall and let your firewall ask again for permission to get full unrestricted access to internet for Firefox and the plugin-container process and the updater process.
    See:
    *https://support.mozilla.org/kb/Server+not+found
    *https://support.mozilla.org/kb/Firewalls
    *https://support.mozilla.org/kb/fix-problems-connecting-websites-after-updating
    See also:
    *http://kb.mozillazine.org/Error_loading_websites

  • Trouble with my iPad's storage space.

    I have a 16 GB iPad 2, and my settings say I only have 2 GB available, but my apps and services don't come CLOSE to filling up all that occupied space.

    I would try a reset by holding the home and power keys down until the Apple logo appears.
    Barry

  • Can't get the INNODB storage engine to start with Leopard MySQL server...

    As shipped by apple. In the /etc/my.cnf file it says to just uncomment the stuff related to innodb and all will be well. I did that, restarted the Mysql server and when I take a look at the available storage engines using phpmyadmin, innodb is turned off...
    The following SQL runs:
    CREATE TABLE `Puzzles` (
    `id` int(10) unsigned NOT NULL auto_increment,
    `initialState` char(81) NOT NULL default '',
    `solution` char(81) NOT NULL default '',
    `levelOfDifficulty` int(11) NOT NULL default '5',
    `numberOfClues` smallint(5) unsigned NOT NULL default '0',
    PRIMARY KEY (`id`),
    UNIQUE KEY `initialState` (`initialState`),
    KEY `levelOfDifficulty` (`levelOfDifficulty`),
    KEY `numberOfClues` (`numberOfClues`)
    ) ENGINE=InnoDB DEFAULT CHARSET=latin1 AUTO_INCREMENT=780 ;
    But when I look at the table, it's a MyIsam table.
    Heres the innodb part of the /etc/my.cnf file:
    # Uncomment the following if you are using InnoDB tables
    innodbdata_homedir = /var/mysql/
    innodbdata_filepath = ibdata1:2000M;ibdata2:10M:autoextend
    innodblog_group_homedir = /var/mysql/
    innodblog_archdir = /var/mysql/
    # You can set ..buffer_poolsize up to 50 - 80 %
    # of RAM but beware of setting memory usage too high
    innodbbuffer_poolsize = 384M
    innodbadditional_mem_poolsize = 20M
    # Set ..log_filesize to 25 % of buffer pool size
    innodblog_filesize = 100M
    innodblog_buffersize = 8M
    innodbflush_log_at_trxcommit = 1
    innodblock_waittimeout = 50
    No errors in the logs visible through Server Admin. Did Apple put the MySQL configuration files somewhere non-standard and leave the /etc/my.cnf file around to fool us?
    Any pointers will be helpful or should I just build the fink package and give up on the shipped Leopard package (so far I'm not too impressed with Leopard).
    Best,
    Dick Munroe

    The problem turned out to be the sizes of the INNODB log and data files. Apparently, the initial startup of MySQL causes these files to be built. The numbers that you uncomment in the my.cnf file aren't related in any way to these sizes and the innodb storage engine won't start unless they match. Stop the server, delete the files, and restart the server and you're off and running. The logs on Leopard Server have NO indication that this has occurred. I found the problem by installing the Mac OS kit from mysql.com and looking in those logs. Interesting question is why that information is missing from the log for Leopard Server when the information is clearly available (as show by running the mysql server).
    Best,
    Dick Munroe

  • Trouble with the GL Engine in Yosemite

    I am having trouble with the GL engine in Photoshop CC2014. Every so often the photo will disappear from the window or brake into tiles after opening a raw file. When I turn the GL engine off in preferences it will stop doing it. Of course, then it just drags and delays my work. I read this is a problem with Yosemite and the drivers for the GL engine.
    I have a 27 in. late 2012 iMac. 2.9 GHz Intel Core i5. 16 GB of RAM and NVIDIA GeForce GTX 660M 512 MB. I am using the CC2014 latest version of Photoshop.
    Will this problem be solved in the next update?
    Thanks for any help!

    Victoria has written a useful blog at Lightroom Queen. It may help:
    http://www.lightroomqueen.com/ready-move-aperture-iphoto/

  • Errors in the OLAP storage engine: The attribute key cannot be found when processing: Table: performance_fact

    Hi
    We are using SSAS 2008 r2 and have a cube on our data warehouse, this has been running fine for quite a while now.
    However it failed yesterday with the error message:
    Errors in the OLAP storage engine: The attribute key cannot be found when processing: Table: 
    'Performance_Fact', Column: 'accountexternalId', Value: '9474'. The attribute is 'External Id'."
    Errors in the OLAP storage engine: The process operation ended because the number of errors encountered during processing reached the defined limit of allowable errors for the operation." 
    An error occurred while processing the '2011' partition of the 'Fact' measure group for the 'DB' cube from the DB database.
    Please can someone help me to resolve the error, I don't understand what it means.
    Thanks

    Hello,
    The error means that you have a key in the fact data which don't exist in the related dimension. Ensure that the dimension is also processed so that it contains all used keys.
    Olaf Helper
    [ Blog] [ Xing] [ MVP]

  • Errors in the OLAP storage engine: The attribute key cannot be found when processing

    this is the absolute worst error message in all of computing.  I despise it.  Here is my situation.
    SSAS 2008 R2.
    I have one dimension.  I have not even built my cube yet.  only a dimension.  I am trying to process it.  I can process it when I only have a single attribute, they key.  it is a composite key.  When I add a new attribute (integer),
    I get the error message.  There are no null values.  There are no blanks as its an integer. 
    The attribute key cannot be found where?  I'm processing the dimension you idiot.  there is not even a cube yet in order for any key to be found or not.

    Hi Baracus,
    According to your description, you get the error "Errors in the OLAP storage engine: The attribute key cannot be found when processing" when processing your cube, right?
    Generally, the detail error message should like
    Table: 'dbo_FactSales', Column: 'ProductID', Value: '1111'. The attribute is 'Product ID'
    The above error explains that the fact table named "FactSales" contains column ProductID with value "1111" but the same  ProductID  is not present in your dimension table. There is a primary key - foreign key relationship exist
    between the ProductID column of dimension table and fact table named "FactSales" and cube is unable to find ProductID with value 1111 in the dimension table.
    At this time, what we need to do is to check either your dimension and fact table contains the value mentioned in the error message (  Value: '1111' in the above example). Here are some links about troubleshoot this issue, please see:
    http://www.businessintelligence-solutions.com/ssas-typical-error-attribute-key-processing/
    http://www.youtube.com/watch?v=5O7IAjvtAF4
    If this is not what you want, please provide us more information about you issue, so that we can make further analysis.
    Regards,
    Charlie Liao
    If you have any feedback on our support, please click
    here.
    Charlie Liao
    TechNet Community Support

  • Errors in the OLAP storage engine

    Job is scheduled to process a cube. The job failed with the below errors:
    Description: Errors in the OLAP storage engine: An error occurred while the dimension, with the ID of 'Dim ID', Name of 'Dim ID' was being processed.  
    End Error  Error: 2015-01-02 02:17:52.73     
    Code: 0xC11F000D     
    Source: Process Dimensions Analysis Services Execute DDL Task     
    Description: Errors in the OLAP storage engine: An error occurred while the 'HID' attribute of the 'Dim ID' dimension from the database was being processed.  
    End Error  Error: 2015-01-02 02:17:52.75     
    Code: 0xC1060000     
    Source: Process Dimensions Analysis Services Execute DDL Task     
    Description: OLE DB error: OLE DB or ODBC error: Operation canceled; HY008.  
    End Error  Error: 2015-01-02 02:17:52.76     
    Code: 0xC11F000C     
    Source: Process Dimensions Analysis Services Execute DDL Task     
    Description: Errors in the OLAP storage engine: An error occurred while the dimension, with the ID of 'Dim Nme', Name of 'Dim Nme' was being processed.  
    End Error  Error: 2015-01-02 02:17:52.76     
    Code: 0xC11F000D     
    Source: Process Dimensions Analysis Services Execute DDL Task    
    Description: Errors in the OLAP storage engine: An error occurred while the 'NME' attribute of the 'Dim Nme' dimension from the database was being processed.  
    End Error  Error: 2015-01-02 02:17:52.78     
    Code: 0xC1060000     
    Source: Process Dimensions Analysis Services Execute DDL Task     
    Description: OLE DB error: OLE DB or ODBC error: Operation canceled; HY008.  
    End Error  Error: 2015-01-02 02:17:52.78     
    Code: 0xC11F000C     
    Source: Process Dimensions Analysis Services Execute DDL Task     
    Description: Errors in the OLAP storage engine: An error occurred while the dimension, with the ID of 'Dim Ky', Name of 'Dim Ky' was being processed.  
    End Error  Error: 2015-01-02 02:17:52.79     
    Code: 0xC11F000D     
    Source: Process Dimensions Analysis Services Execute DDL Task     Description: Errors in the OLAP storage engine: An error occurred while the 'KY' attribute of the 'Dim Ky' dimension from the database was being processed.  
    End Error  Error: 2015-01-02 02:17:52.81     
    Code: 0xC11F000D     
    Source: Process Dimensions Analysis Services Execute DDL Task     
    Description: Errors in the OLAP storage engine: An error occurred while the 'Id' attribute of the 'Dim Txt' dimension from the database was being processed.  
    End Error  Error: 2015-01-02 02:17:52.81     
    Code: 0xC11F000D     
    Source: Process Dimensions Analysis Services Execute DDL Task     
    Description: Errors in the OLAP storage engine: An error occurred while the 'Id' attribute of the 'VWIprve' dimension from the database was being processed.  
    End Error  DTExec: The package execution returned DTSER_FAILURE (1).  
    Started:  1:00:22 AM  
    Finished: 2:18:02 AM  
    Elapsed:  4660.47 seconds.  The package execution failed.  The step failed.
    Please help!!!!!!

    Hi,
    According to your description, you create a SSIS package to process SSAS cube, the problem is that you are experiencing the error "Errors in the OLAP storage engine: An error occurred while the dimension, with the ID of 'Dim Nme', Name of 'Dim Nme'
    was being processed“ while executing the job, right?
    Based on my research, the issue can be caused by that you haven't set a primary key in your dimension table. Here is a blog that describe this issue, please see:
    http://blogs.microsoft.co.il/barbaro/2014/03/03/errors-in-the-olap-storage-engine-processing-a-large-dimension/
    Regards
    Charlie Liao
    TechNet Community Support

  • Errors in the OLAP storage engine: A duplicate attribute key has been found when processing

    Hi dear MSDN Community,
    I am facing a problem while processing a cube with a customer hierarchy as follows:
    Global Account --> Main Customer --> Master Customer --> Customer
    The data comes from a flatted parent child table, that is, I create an extra column for every level of the hierarchy in the customer view. If a level is empty, then the value is filled with the previous value. Then I can use the property:
    HideMemberIf = OnlyChildWithParentName for the intermediate levels (Main and Master Customer)
    HideMemberIf = ParentName For the leafs (Customer)
    HideMemberIf = never for the root (Global Account)
    Consider this example:
    Then, for the root level I am using as the key the fields in yellow in order to avoid duplicates. However, I am getting the error message "Errors in the OLAP storage engine: A duplicate attribute key has been found when processing" while processing.
    I analyzed the query that SSAS issues to the server (select distinct ....) and I think it should work but it is still failing.
    I had similar problems with the intermediate levels but I was able to solve it using a similar procedure.
    Any help will be appreciated.
    Kind Regards.

    When are you having this error? While processing the dimension or during cube processing?
    http://blog.oraylis.de/2013/08/a-duplicate-attribute-key-has-been-found-during-processing-revisited/
    Please Mark This As Answer if it solved your issue
    Please Vote This As Helpful if it helps to solve your issue
    Visakh
    My Wiki User Page
    My MSDN Page
    My Personal Blog
    My Facebook Page

  • Errors in OLAP storage engine when processing application

    Hi
    After changing a logic in the application, we processed the application but it did not complete successfully due to the following error:
    Error message:: CreateOLAPCubeForApplication:CreateCube:Errors in the OLAP storage engine: The attribute key cannot be found when processing: Table: 'dbo_tblFactQuality', Column: 'QACCOUNT', Value: '%ACCOUNTS%'. The attribute is 'QAccount_ID1'.
    When trying other applications they showed errors with reference to the measure group, e.g.:
    Error message:: Errors in the metadata manager. No dimension relationships exist within the 'Ownership' measure group.
    Thanks for your help.
    Melanie

    Hi,
    This kind of error will come when you have some invalid member defined in your fact table. you can use the following SQL query to check it.
    select * from tblfact"yourapplication" where "dimension" not in (select id from mbr"dimension" where calc = 'N')
    The same query needs to be run in wbtable and fac2 table.
    These selection should return 0 records.
    If it is returning something then you have to delete these records (replace "select * "with delete).
    You can run this for all the applications and all the dimensions. However, I believe, you can check in your Quality application and the QACCOUNT dimension.
    You can see for which dimension, there is an invalid member. This member might be getting created through one of your script logics.
    Hope this helps.

  • EJB + Mysql Storage engine choice

    I'm developing an EJB 3 application using EclipseLink with MySQL and need to choose a suitable storage engine for MySQL
    I am considering MyISAM and InnoDB. As far as I can tell the main difference is the transactional features of InnoDB.
    My understanding is that with EJB the transactions are managed by the EJB container.
    Is there any advantage in choosing InnoDB over MyISAM when working with EJB?

    yes Howard, i had a look at it.but is it going to be the same for any workflow which has more process variables?for the workflow i am doing,we need more process variables.to tell u exactly i have 10 form variables,2 document,3 int, and others totally below 20.
    Now that i had understood the cause of error,i want 2 rectif it without changing anything in the database as we are not given rights for writing into database.is there any way of doing it?if yes plz suggest me.
    thank you,
    Raghava kumar V.S.S.

  • I use Safari in my imac with Google as my search engine. Recently, Bing took over. Extensions shows Google as default search engine, but Bing is what is working. How do I get rid of Bing, go back to Google?

    I use Safari in my imac with Google as my search engine. Recently, Bing took over. Extensions still shows Google as default search engine. Search starts as Google but switches to Bing. How do I get rid of Bing, go back to Google?

    Hey ravenbird1,
    Thanks for the question. After reviewing your post, it sounds like you want to use a specific search engine.
    Safari 7 (Mavericks): Search the web
    http://support.apple.com/kb/PH17150
    To set the default search engine, choose Safari > Preferences, then click General.
    If you are having problems with extensions you can uninstall and reinstall the extension.
    Safari 7 (Mavericks): Install and update Safari extensions
    http://support.apple.com/kb/PH17200
    Select the extension, then click Uninstall.
    Thanks for using Apple Support Communities.
    Have a nice day,
    Mario

  • Errors in OLAP storage engine

    I am running BPC MS 7.5 and tried to do a full optimization and got the error below.
    Unfortunately it did not appear to put the data back to its original state and I had to restore to a back up!
    Can anyone tell me how to resolve this error - I am not a techie more an application man so in "English" would help me.
    ==============[System Error Tracing]==============
    [System  Name] : OLAPServerHandler
    [Message Type] : ErrorMessage
    [Job Name]     : Olap9Manager : CubeProcess
    [DateTime]     : 6/22/2011 11:45:32 AM
    [UserId]       :
    [Exception]
        DetailMsg  : {Microsoft.AnalysisServices.OperationException: Errors in the OLAP storage engine: The attribute key cannot be found when processing: Table: 'dbo_tblFactConsolidation', Column: 'ACCOUNT', Value: 'CTLICBFR010'. The attribute is 'Account_ID1'.
    Errors in the OLAP storage engine: The process operation ended because the number of errors encountered during processing reached the defined limit of allowable errors for the operation.
    Errors in the OLAP storage engine: An error occurred while processing the 'Consolidation' partition of the 'Consolidation' measure group for the 'Consolidation' cube from the EBIQUITYTRAIN database.
    Errors in the OLAP storage engine: The process operation ended because the number of errors encountered during processing reached the defined limit of allowable errors for the operation.
    Internal error: The operation terminated unsuccessfully.
    Server: The operation has been cancelled.
    Thanks

    Hi,
    Usually, this kind of error message comes from invalid records in your fact tables.
    Check out SAP Note 1098683.
    Hope this will help you.
    Kind Regards,
    Patrick

  • I have a Lucid 2 LG.  I have been having trouble with insuffient storage.  I have a 8G phone and have spent hours with Tier 2 tech trying to move info from the internal storage to the SD card with no luck,  When I go to storage in the settings it states t

    I have a Lucid 2 LG.  I have been having trouble with insuffient storage.  I have a 8G phone and have spent hours with Tier 2 tech trying to move info from the internal storage to the SD card with no luck,  When I go to storage in the settings it states that over 4 gigs is for Misc?  System data takes up over 4 gigs.  No one can tell me what system data consist of.  So My question is does anyone know what system data is?  I am assuming I have a 8 gigphone but can only use 4 gigs???

    System data is the OS or operating system.  That is where the recovery stays separated from the rest of the storage so that it doesn't get corrupted.  It is not accessible and non-movable.

Maybe you are looking for

  • ICloud Won't Download Songs

    I recently downloaded the new iTunes, and since then my iCloud won't let me download any music off of it. The message, "You can download past purchases on this computer with just one Apple ID every 90 days. You cannot associate this computer with a d

  • Performance of mapping containing a function call

    Hi, I have: SOURCE TABLE ------------------------------------------------- JOIN --------------- TARGET TABLE CONSTANT ----------------------- FUNCTION --------------------^ The source table has an ID column and the function returns a P_ID which is se

  • Migrating datasource 0comp_code_attr

    Hi Experts, I am trying to migrate datasources from 3.5 to 7.0 by the following approach 1. Create transformation based on update rule (infosource 7.0 is also created). 2. Create transformation based on transfer rule. 3. migrate the datasource with e

  • Color off when printing

    I have been having issues with getting the color to print correctly with our Brother HL-4070CDW ever since we updated to Leopard. I have spent time on the phone with mac and brother and no one seems to be able to help. When I print our logo from eith

  • Certificate of Origin

    Hi Experts,   Please suggest me the names of SAP Standard Certificate of Origin forms... Thanks in Advance... Shital..