Processing Tabular Model

1 We are developing a Tabular Model. In this model there are likely to be about 15 dimension tables and 2 main fact tables.
2 One of the fact tables is very large approximately 70 million rows and will increase to 150 million rows in about 2-3 years time.
3 So on the cube we have created partitions and are using the incremental processing. What we have done is to create a partition definition table header and lines. At the header level we will store the name of the measure group on which we wish to
create partitions, and in the lines table we will create the definition of each partition. Using an sp we will mark of those rows of the partition lines which we wish to reprocess. Such partitions will be dropped and recreated. So far this is working well.
4 I want to generalize this solution so that I works across different projects without any changes.
Now I have two questions :
Question 1 :
If I make changes in the tabular project and deploy the same, I believe all partitions will get deleted and all the data will need to be pulled in again. This will happen even if I add a calculated measure. Is there any method to overcome this ?
Question 2 :
What is the mechanism of only processing certain measure tables incrementally and all other tables fully ? In my above example only one table has partitions. So if I want to process only the current partition of that table, and all other tables how do I
achieve this ?
Sanjay Shah
Prosys InfoTech, Pune, India

1) if you only add a measure or a calculated column, you do not need to read data from data source. If you have problem with deployment within VS, consider using Deployment Wizard.
2) A complete description of process strategies is included in a chapter of our book (http://www.sqlbi.com/books/microsoft-sql-server-2012-analysis-services-the-bism-tabular-model).
In general, you can control which partition/tables you want to process and in which way, using XMLA scripts, PowerShell and other tools. The easiest way to create an XMLA script is using the Generate Script feature in SSMS when you use the process wizard.
Marco Russo http://ssasworkshop.com http://www.sqlbi.com http://sqlblog.com/blogs/marco_russo

Similar Messages

Tabular Model Partition

Hi everyone
Please help me,
I am new to the tabular model
My table data size big having millions of records , i need to apply the Partition on my tables month wise or Year wise.
I have search many blogs but i could not able to find the right solution,
please help anyone i need step by step process.
please anyone share the documentation or link.
its very helpful.
Regards
Sreeni

Hi Sreeni,
Partitions divide a table into logical parts, and each partition can then be processed (Refreshed) independent of other partitions. In this case, you should group by your partitions at month level, so we can directy process the "Jan-2014" partition to load
data for business requirement.
Besides, we can process the parition via SSIS package. Here are some articles for your reference, please see:
Using Integration Services with tabular models:
http://blogs.msdn.com/b/cathyk/archive/2011/09/08/using-integration-services-with-tabular-models.aspx
SSIS Methods to Process SSAS Tabular Partitions:
http://jessekraut.wordpress.com/2013/09/24/ssis-methods-to-process-ssas-tabular-partitions/
Process Tabular Model using SSIS:
http://www.bifeeds.com/2013/04/process-tabular-model-using-ssis.html
Regards,
Elvis Long
TechNet Community Support

Tabular model process-took 4 HOURS instead of normal 10 minutes

There must be some sort of log I can view or review to get a better look inside the process?
When I refreshed my development project (which is using the same server for workspace) it takes less than 10 or 15 minutes.
Then I deployed it to my server and after 35 minutes I closed out of SSDT BI as it appeared to have frozen.
I then deployed again with no processing.
After that I processed manually through SSMS by using Process (but scripted out) for a process full.
After 12 or so minutes most everything appeared to have processed and the last feedback was on:
CREATE MEASURE 'PROFIT_WORKSHEET'[Less Cost Over Profit -Indirect Costs]=CALCULAT ..."
I could see that the SSAS server was still working via CPU activity, but no futher messages were reported to SSMS. Then after 3 hours and 45 minutes later it claimed to have completed and displayed:
"Execution Complete" (it had lots of white space above it, around 20 or so blank empty lines which was odd)
The tabular model seems to be functional, and it is less than 350 MB in size (almost the exact same size of my development workspace model) so I am at a loss as to why the delay like this?
Any suggestions, thoughts?
It returned 40 million rows, but I have other models that return more and process in 3 or 4 minutes so it is very odd (and it isn't 400 million, just 40 million)
Thanks!
appeared

Hi OneWithQuestions,
According to your description, you create a SQL Server Tabular Model project which takes 10 minutes to process in SQL Server Data Tools, the problem is that it takes 4 hours to process this database in SQL Server Management Studio. So you need the detail
log that inside the process, right?
In your scenario, you can enable SQL Server profiler to monitor the queries fired by the process, once you find some queries took a very long time to run, consider creating the smaller cube partition or optimizing the query by adding index or partition to
improve process time.
http://www.mssqlgirl.com/process-full-on-tabular-model-database-via-ssms.html
Regards,
Charlie Liao
If you have any feedback on our support, please click
here.
Charlie Liao
TechNet Community Support

Error after process a Tabular model

Hi,
When I process a Tabular model, sometimes I have the next error
"Error moving file '\\?\G:\filename.80.det.xml_TEMP_3804' to file '\\?\G:\filename.80.det.xml': ." I see in a XEvents trace that process finished ok and then throw the error.
Does somebody know the reason?
Regards,

Hi Numer04,
It's hard to give you the exact reason that cause this issue. However, you can troubleshoot this issue by using the Windows Event logs and msmdsrv.log.
You can access Windows Event logs via "Administrative Tools" --> "Event Viewer". SSAS error messages will appear in the application log.
The msmdsrv.log file for the SSAS instance that can be found in \log folder of the instance. (C:\Program Files\Microsoft SQL Server\MSAS10.MSSQLSERVER\OLAP\Log)
Here is a blog about data collection for troubleshooting Analysis Services issues, please see:
Data collection for troubleshooting Analysis Services issues
Regards,
Charlie Liao
TechNet Community Support

Tabular model: First deployment to server takes 120 min to process, subsequent ProcessFull 15 min?

I have noticed this several times now and I do not understand it.
I have a model with ~45 million rows in the largest table and the first time I deploy to the server and then execute a ProcessFull (via script) it takes over two hours to complete.
*Note when I deploy from BIDS I have it set as Processing Option: Do Not Process. So it doesn't process until I explicitly call it.
However, the next day (or could be later same day) I kick off the same ProcessFull and it finishes in 15 minutes.
So it appears the FIRST time it is deployed (as in the model did not exist historically, prior to deployment there was no tabular database called "MyTestModel" on the server) it takes an extremely long time.
Subsequent ProcessFulls are very quick.
Why is that? Has anyone else encountered that?
When I watch the progress of the process full script I see it finishes retrieving all the data in a relatively decent amount of time, for example the 45 million row table:
Finished processing the 'BigTableWith45MillionRows' table.
So I know it has completed all its data retrieval operations.
Then it moves onto:
Processing of the 'Model' cube has started.
Processing of the 'ACCOUNT' measure group has started.
and many more various measure groups
later I get:
Finished processing the 'ACCOUNT' measure group.
Finished processing the 'Model' cube.
It moves onto to it's "CALCULATE;" statements at that point with "CREATE MEMBER CURRENTCUBE.Measures".... and so forth.
It would be most helpful if I could see which ones it had started but not yet stopped (it appears to "Started processing the 'random' hierarcy" or calculated column, or whatever and then a few lines later it will say "Finished" but other
than looking through them all by hand and matching up every Started with Finished trying to find one with OUT a "Finished" I have no way of knowing which are still processing.
It would be helpful to know "item X takes 2 hours to finish processing"
It tends to take the longest amount of time in the processing hierarchy and calculated column phase.

The default events in profiler are fine. You will likely focus on Progress Report End. How are you running ProcessFull? An XMLA script or from right-clicking on the database or from right clicking on a table and selecting all tables?
http://artisconsulting.com/Blogs/GregGalloway
Right click on database, go to process, select process full and then script (single database not each table).
<
Processxmlns="http://schemas.microsoft.com/analysisservices/2003/engine">
<
Type>ProcessFull</Type>
<
Object>
<
DatabaseID>MyDatabaseName</DatabaseID>
</
Object>
</
Process>
I finished a full process yesterday and captured the info.
The biggest for CPUTime (I noticed duration would be long but no CPU time, it seemed like it would flag things as having started but due to dependencies they just sat and waited?)
was my larger hierarchy: Progress Report End, for CPU time of 11925840ms or 3.3 hours. Duration was 11927999ms.
After that was my 45 million row table at CPU time 715296 and duration of 860773 or 14 minutes.
It is interesting because a normal ProcessFull is ~15 minutes, so it seems that the hierarchy rebuild is what is "killing me" on these.
A variety of Object Created events had high durations but NULL CPU time, seems like those were dependant on earlier events maybe??
Regardless, my big hierarchy was the longest at the 3.3 hours.
It has 173,000 unique rows in the hierarchy (again like Account primary, secondary, though 6 or so levels deep, 1.2.3.4.5.6 etc...)

Processing of a deployed Tabular model inside SSDT

Hi,
operating inside SSDT, does it exist a manner to process a tabular model (or a table/partition) already deployed on the SSAS instance?
I know that it is possible to process only the workspace data.
Thanks

Hi Pscorca,
According to your description, you want to process data for a tabular model which had already been deployed on the SQL Server Analysis Services instance. When authoring your model project, process actions must be initiated manually in SQL Server Data Tools
(SSDT). After a model has been deployed, process operations can be performed by using SQL Server Management Studio or scheduled by using a script. So we cannot process data for a tabular model which had already been deployed on the SQL Server Analysis Services
instance.
If you have any concern about this behavior, you can submit a feedback at
http://connect.microsoft.com/SQLServer/Feedback and hope it is resolved in the next release of service pack or product.
Thank you for your understanding.
Regards,
Charlie Liao
TechNet Community Support

Error about using a concatenated calculated column in a SSAS Tabular model

Hi,
in a my tabular model I've added in a dimension table a calculated column concatenating a code and a description. The code is used to create a relation between a fact table and this dimension table.
When I try to use the tabular model inside Excel and select the concatenated column as a filter I've this error message:
I've tried to recalculate some times the tabular database after the deployment of the model changes and I've tried to run a full process of the entire database but any results.
Any suggests to me in order to solve this issue, please?
Thanks

Hi, I've solved. The concatenate formula was with "+" operator and not "&".
But during the column creation I've any errors also if the model in SSDT was empty.
Bye

Error while importing data in SSAS Tabular Model

I am new to the concept Tabular Model in SSAS 2014.
I am trying to create one tabular model based on Adventureworks DW 2014.
I am getting below error while importing tables to create model.
"OLE DB or ODBC error: Login failed for user 'ASIAPAC\CSCINDAE732028$'.; 28000.
A connection could not be made to the data source with the DataSourceID of '98c2d415-1e84-469c-a170-2bcacd779c1a', Name of 'Adventure Works DB from SQL'.
An error occurred while processing the partition 'Customer_65240c88-55e7-416c-a7ac-732dece8be8e' in table 'Customer_65240c88-55e7-416c-a7ac-732dece8be8e'.
The current operation was cancelled because another operation in the transaction failed."
But while creating the Datasource, it has created successfully (below img)
But while importing the facing the below error.
Note:
I have multiple instances in my system with unique names.
Is this causing any ambiguity issues in selecting right instances?

Hi Naveen，
Based on your screenshots, you fail to open a connection to the data source. Right?
In this scenario, the first screenshot you post is for creating a connection to server with the current windows authentication, not for connecting a data source. So the "Test Connection succeed" means your current windows user can connect
to server, not connect to the database your selected in the dropdown list. Then you click next, you can choose account to access the data source. Based on the information, your service account "'ASIAPAC\CSCINDAE732028$" doesn't have permission to
access the database you selected. Please grant the permission for the service account in SSMS.
If you have any question, please feel free to ask.
Best Regards,
Simon Hou
If you have any feedback on our support, please click here.

Error while doing preivew in tabular model

I added a new column to base view on which I have a tabular model. In order for me to see the new column I go to the table TAB in SQL data tools and from property window I click on the source and when I hit refresh it always error out with time a time
out issue. But if I process the table first and then do a refresh from source it works. Don't know why is that and how can I fix it.
Moyz Khan

Hi Moyz Khan,
It looks like Timeout property is applicable only in SSMS as you are getting issues to preview data in SSDT ,Updating timeout may not be the right solution !
I think DataSourceID in your second screen shot is not a Bug,When you provide Datasource SSDT automatically creates GUID I hope.
I am not able to replicate your situation at my end.but
Please check following URL
http://blogs.msdn.com/b/karang/archive/2013/07/26/tabular_2d00_error_2d00_while_2d00_using_2d00_odbc_2d00_data_2d00_source_2d00_for_2d00_importing_2d00_data.aspx
and also Robin Langell mentioned in comments in above URL saying changing provider to SQLOLEDB solved issue
Give it a try !
Prathy
Prathy K

Error in import : tabular model with Oracle

Hi there,
I seems to be getting very strange error.
I am trying to build tabular model over oracle db. I get test successfull for connection, able to validate the query, and in query designer, if i execute it shows me data too. But when i press finish, it gives me error while importing.
ERROR from import screen
OLE DB or ODBC error: ORA-01033: ORACLE initialization or shutdown in progress.
A connection could not be made to the data source with the DataSourceID of '8ffdbfd9-e21f-442d-9040-b66dc074c87d', Name of 'XXXXXXX'.
An error occurred while processing the partition 'XXX_3fc019fa-4d1a-4d39-9317-3dcde3297579' in table 'XXXXXX'.
The current operation was cancelled because another operation in the transaction failed.
I cant figure this out,Even in Execl powerpivot i am able to pull the data in.
Any idea..TIA
Rahul Kumar, MCTS, India, http://sqlserversolutions.blogspot.com/

Hi Rahul,
Based on my research, for the error “OLE DB or ODBC error: ORA-01033: ORACLE initialization or shutdown in progress.
A connection could not be made to the data source with the DataSourceID of '8ffdbfd9-e21f-442d-9040-b66dc074c87d', Name of 'XXXXXXX'.”
It seems that it related to Oracle database, here are some links about how to troubleshoot this issue, please see:
ERROR - ORA-01033 oracle initialization or shutdown in progress
ERROR - ORA-01033 oracle initialization or shutdown in progress
If the issue persists, since I am not an expert on Oracle database, you can post the question on the Oracle forum, so that you can get more help.
Regards,
Charlie Liao
If you have any feedback on our support, please click
here.
Charlie Liao
TechNet Community Support

VS2010 SSAS Tabular Model Memory Limitation

Hi,
My laptop recently crashed and am currently using a loan one that has Windows 7 x32, Visual Studio 2010 SP 1 AND SQL Server 2012 SP 1 (CU 4) installed. It only has 4GB of RAM, and when I attempt to load a very large fact table in a SSAS Tabular
Model project using Visual Studio I receive the following error:
Memory error: Allocation failure : Not enough storage is available to process this command. . If using a 32-bit version of the product, consider upgrading to the 64-bit version or increasing the amount of memory available on the machine.
The current operation was cancelled because another operation in the transaction failed.
Visual Studio 2010 is only available in 32 bit and I have already changed the VertipaqPagingPolicy from the default 0 to 2, but still the issue exists. Has anyone experienced this before?

You have a couple of options in terms of removing the where clauses:
1) Build your project in SSDT and then use the Analysis Services Deployment Wizard to create an XMLA deployment script, then edit the script to remove the WHERE clauses before executing it on your server.
2) If this is a first time deployment change your project deployment options to "Do Not Process" - deploy your project and then edit the partitions for the tables with WHERE clauses to remove them.
3) Another option is to use views in your relational database. Then you can put the WHERE clauses in the views on Dev, but exclude them in the Prod database.
http://darren.gosbell.com - please mark correct answers

Tabular model with Direct Query issue

Hi,
i am creating a tabular model - Direct Query option. I am using a kind of below query to import data,
Declare @TEST as Table (TestID int, TestName varchar(20))
Insert into @TEST
Select 1, 'TEst1' Union
Select 2, 'TEst2'
Select * from @TEST
But the Import fails with an error similar to below,
OLE DB or ODBC error. An error occurred while processing the partition 'Query_``````````' in table 'Query_````````'. The current operation was cancelled because another operation in the transaction failed.
Any idea, why it is failing ? or is it like we shouldn't use declare statement in the Query area ?
Please reply ...Thanks in advance !
--------------------------- Radhai Krish | Golden Age is no more far | --------------------------

I'm pretty sure that the query would have to be a single statement so the declare statement would be causing issues.
So just doing this as a single union query should work:
Select 1 as TestID, 'TEst1' as TestName Union
Select 2, 'TEst2'
http://darren.gosbell.com - please mark correct answers

Optimize Fact tables in SSAS Tabular Model

Hi,
I have five Fact tables in SSAS Tabular Model and each fact table share same dimensions. It creates some performance issue and also the data model looks very complex is there any simplest way to create simple data model using all fact tables. For Ex...
Please suggest me for this ...
Fact Tables:
Fact_Expense
Fact_Sale
Fact_Revenue
Fact_COA
Fact_COG
Dimensions:
Dim_Region
Dim_Entity
Dim_Product
Dim_DateTime
Dim_Project
Dim_Employee
Dim_Customer

Hi hussain,
Please consider merging the Fact tables based on granularity. Generally, if you have enough RAM there will be no performance issues. Make sure you have double the amount of RAM to cater your processing and operational needs.Try
to optimize the model design by removing unused keys and some high cardinality columns.
Please go through the document in the link:
http://msdn.microsoft.com/en-us/library/dn393915.aspx
Regards,
Venkata Koppula

How do I cancel a tabular model table from being validated?

I made the mistake of clicking validate on the edit table properties window and it has been running for about 15 minutes now. I've tried everything short of killing VS in task manager. What is this thing doing that takes so long? And why can't I stop it?
But if I change the query and it executes I get a link in the progress window to cancel...

Hi Developer,
If I understand correctly, you click "OK" button by mistake after made some changes on the table, then it had been running for about 15 minutes and still not complete, now what you want is that cancel this operation, right?
As per my understanding, if we click the "OK" button on Edit Table Properties, then Analysis Services will process this table and update it to tabular model. If this table contains large data, this operation can take long time. If we click the "Ok" button
by mistake, we can click "cancel" to cancel this operation. And there will be a message said that "The operation was cancelled by the user".
In your scenario, you said that you killed VS in task manager, what' happen when you reopen the tabular project? The operation might be cancelled since you killed VS in task manager during processing.
If I have anything misunderstood, please point it out.
Regards,
Charlie Liao
If you have any feedback on our support, please click
here.
Charlie Liao
TechNet Community Support

Tabular model performance

HI,
I have built a small database of size 31 MB on tabular mode. DB querymode is set to InMemory. With simple setup, a normal evaluate dax query is taking 1 sec to retrieve list of sales person which is a dimension table and does not include any calculation.
The other semi complex query are taking 15- 20 secs. The tabular instance setting are set to default as the db size is less and server as total of 7 GB RAM.
Is there any setting that needs to be validated to improve the performance.Because if the model is inmemory then the output should come out in microseconds.
Manohar K - SQL Server DBA Consultant

Hi Manohar,
According to your description, you are experienciing the performance issue when retrieval data from the small SQL Server Analysis Services Tabular model, right?
In tabular model, as you increase the data load, add more users, or run complex queries, you need to have a strategy for maintaining and tuning performance. Here are some links which describe strategies and specific techniques for getting the best performance
from your tabular models, including processing and partitioning strategies, DAX query tuning, and server tuning for specific workloads. Please refer to the links below.
http://msdn.microsoft.com/en-us/library/dn393915.aspx
http://sqlblog.com/blogs/marco_russo/archive/2013/08/05/performance-tuning-of-tabular-models-in-analysis-services-2012-ssas.aspx
Besides, I'd suggest you enable SQL Server profiler to monitor the query, and check which part in the query took a very long time to run. Here is a useful link for your reference.
http://sqlmag.com/database-performance-tuning/using-sql-profiler-tune-mdx-queries
Regards,
Charlie Liao
TechNet Community Support

Processing Tabular Model

Similar Messages

Maybe you are looking for