Full Optimize withtou cube processing
Hello,
I'd like to run Full Optimize from SSIS (Administrative Task), but without full processing of the cubes. The reason is performance - I'd just like to move data into FACT tables and then run full process of whole database manually. Is it possible via some attributes, like ProcessMode or ProcessOption?
Thanks.
Radim
Sure, during the whole operation the system is unavailable, goal is to shorten processing times. It's much faster to do full process on database once than process each cube in serial way. And I didn't want to reinvent the wheel (wb+fac2 -> fact) with sql script.
For example, for light optimize you can disable processing of fac2, so same option would be nice for full process also.
Best regards,
Radim
Similar Messages
-
Is the cube processed after an OLS full optimization?
Version: OutlookSoft V4.2
Sometimes, the value in fact tables are not consistent with the values retrieved via Analysis Service. At this time, processing the cube in Analysis Service may solve the problem.
An OLS full optimization sum the data in 3 fact tables to one, and empty the other two. My question is if the cube is also processed in this operation.
Thanks,
Jason
Edited by: chaoloo on Apr 7, 2010 11:51 AMHI,
This can happen when an administration process not finish properly. As you know the two of partions are MOLAP and those must be processed to see the data.
The optimization process is processing the partitions at the end.
Best regards,
Mihaela -
Server time out by full Optimize application process
Hello,
we have problem with full optimize application processing. We have got error message "Server time out" on the Processing OLAP Database.
our test environment on the VM x64bit, Server 2008
Please anybody helps me to solve this issue.
P.S. other optimize processes are workable (lite and Incremental)
Thanks
AraiHi,
Please see Note 1277009.
This might resolve your issue.
Karthik AJ -
SAP BPC 7.5 NW SP09 - full optimize never ends. Job can not be stopped
Hi experts,
we sent a full optimize process in order to compress an application but it never finished.
I noticed that through BW transaction RSPC the process chain: Full optimization stops in "Collapse box" step and become red.
so the cube were locked and can not be used. we checked through in BW TE SM50 that process is in "Running status"
I tried to stop it through BW TE SM37 but can not be done due its status.
Please any idea how to stopped it and how solved full optimization issue?
thanksTry cancelling it from SM50 (with core or without core). Never run Full Optimization for compression, run Light Optimization if you need to compress a cube.
Gersh -
Full Optimization and rearrangement of dimensions
In BPC, there are times when Full optimize u2018mayu2019 create a new cube if rearrangements of dimensions gives more optimal performance. Also, upon transport, the technical name u2018mayu2019 be different for the same reason.
My questions - how and when does BPC system realize to rearrange dimensions? Is it during every full optimize?
I hope data does not get affected, but what gets affected?
In basic terms, what is "rearrangement of dimensions"?
Also, when should we do full optimize?
When we transport, does that change the technical name?
Thanks.
AnandHi Anand -
Part two...
This process being understood, on your specific questions:
How and when does BPC system realize to rearrange dimensions? The decision to rearrange dimensions is based upon an analysis of transactional data and sizing of the underlying SID tables supporting that data
Is it during every full optimize? Not necessarily.
I hope data does not get affected, but what gets affected?
Data is retained, but if the cube is reorganized then the technical name of the cube supporting the BPC application may change during the process.
In basic terms, what is "rearrangement of dimensions"?
Rearrangement of dimensions is the process where the BW characteristics are reassigned to different BW dimensions to promote an optimal data model.
Also, when should we do full optimize?
If you suspect that your performance has degraded due to changes in your transactional data storage patterns, you may need to update your current BW data model to achieve the best performance from your application.
When we transport, does that change the technical name?
There is guarantee that the same technical name will exist in the target system, so the answer is maybe not. Please rview the folowing blog for more details on name retention after transport:
[/people/sheldon.edelstein/blog/2010/03/30/bw-objects-technical-name-changeability-for-sap-bo-planning-consolidation-version-for-netweaver|/people/sheldon.edelstein/blog/2010/03/30/bw-objects-technical-name-changeability-for-sap-bo-planning-consolidation-version-for-netweaver]
Regards,
Sheldon -
Full Optimize - Space needed in BW/Oracle
Hi.
This is kind of a SAP basis question, I think. We are doing full optimization, which eventually ends in an ABAP dump indicating that the Oracle database is running out of table space.
We have had similar problems before, and just had the Oracle DBA extend the table space.
It is obvious that Full Optimization need to do a lot of work in restructuring and recreating the application set. The question now is how much table space is needed to do a full optimize? Is it possible to estimate?
The DBA doesn't want to set AutoExtend on the database table space. Does anyone know best practice on this matter of subject?
We are running SAP BPC 7.5 SP07.
Kind regards
Mogens SmerdelI cant give a specific answer as i am not a basis expert but can help you understand the full optimize process.From a technical point of view,the cube is restructured and the dimension combinations are reviewed based on the fact table ratios.
So this process creates some temporary tables and then finally a new cube is created .
You might have to look at the current cube fact tables and no of dimensions (tables) and make an estimate of the size and structure .
Regards,
Sachin -
Hi,
I am processing cube with process full. its taking around 15 mins. I planned to improve this by adding indexes to the database. I used SQL Trace while processing & later used the result to the database tuning advisor to get recommendations. I got the
recommendations & i have included those changes to the Database & then processed the cube but there is no improvement. I even tried to get the expensive queries from the trace & run in SSMS with Query execution plan but I am not able to figure
out. Please help.
Thanks
sushHi susheel1347,
According to your description, you want to improve the cube processing. Right?
In Analysis Services, cube processing is performed in Analysis Services by executing Analysis Services-generated SQL statements against the underlying relational database. Here we have some advices on improving the cube processing:
Use integer keys if at all possible
Use query binding to optimize processing
Partition measure groups if you have a lot of data
Use ProcessData and ProcessIndex instead of ProcessFull
For more information, please refer to links below:
SQL Server Best Practices Article
Improving cube processing time
If you have any question, please feel free to ask.
Simon Hou
TechNet Community Support -
Report and data comming wrong after compress data with full optimization
In SAP BPC 5.1 version to increase the sysetm performance we did full optimization with compress data.
Theis process end with error, after login into system the report and values comming wrong,
What is the wrong,how to rectify it
Regards
prakash JThis issue is resolved,
-
Full optimize with Compress DB throws error
Hi,
We are using SAP BPC 7.0 MS version... We have an SSIS package scheduled every morning for a Full Optimize with Compress DB. For the past few days this package had been failing after running for 2 hours, with the following error message :
[Error][OSoft.Services.Application.OptimizeManage.OptimizeManageCtrl]
When we tried doing a Full optimize without compress DB or Index defragmentation from the Admin Console, it completes successfully.
But when we try doing a Full Optimize with Compress database checked, it runs for about 2 hours and throws the following error :
An error has occurred during processing
Error Message : Thread was being aborted
After the above process it leaves all the records in the fact table with source column 1.
Can anyone please share your ideas on this issue if you have faced this before and a way to fix this.
We do not have bad or invalid records in the fact table.Hi,
Please recheck if you have any calculated members or invalid dimension members.
Calculated members will create such problems.
Please check you have enough free disk space on your server which has Database and Analysis Services.
Please make sure you have enabled 3GB support in Everest Update component, if you have more than 4GB RAM in your Application server.
Please check if you have setup the Analysis Server settings with a minimum recommended value for the
Threadpool \ Query \ MaxThreads parameter.
The recommended value is higher of 10 or (number of Analysis Services Databases + twice the number of processor cores).
If you have 4 dual core processors in your Analysis Services server (8 cores) and 5 Analysis Services DB, then you must set the value as 5+(2*8)=21.
The source column will be updated as zero when the full optimization is complete. It remains as 1 since your full optimization is not completed.
Since it says thread is being aborted, I believe the Analysis Services server settings change might resolve your issue.
Karthik AJ -
Hi
Is there a time limit for full optimize when running it from BPC Admin?
I have tried to do a full optimize two times and it ends after 1 hour both times with the error messege:
"Thread was being aborted"
Do any one know what the problem can be and if there are a time limit for 1 hour how can I walk around this time limit?
Regards
FredrikHi,
this is due to the timeout settings in ASP.net file web.config.we can change this setting as below.
In order to fix this issue, you need to modify the file "web.config" in the
folder \BPC\websrvr\web of the Web Server. Please, inside this file, locate
the following line:
<httpRuntime maxRequestLength="102400" executionTimeout="3600" />
and change the executionTimeout to 36000.
This means that when a process takes longer than 3600 seconds = 1 hour to
complete, the execution meets a timeout; by increasing the
"executionTimeout" parameter to 36000 = 10 hours the error disappears.
Remember that you need to run an "IISRESET" command on the web server after
doing this change.
thnks. -
Re: Full Optimize and Lite Optimize Disabled
Hi,
We have an BPC App.
What we need now is that for a particular group of users to have no access to run Full Optimize or Lite Optimize rights to trigger it.
Please can any one advice how to disable this functionality or un authorize this for particular set of users so that they cannot execute any optimization.
Regards.Hi,
Follow below steps:
1. Create a Team and assign users those should have an access for Full and light optimization
2. Goto Manage data>Maintain data management>Manage Packages
-->Select the team which you created in step 1
-->Select add package
--> Choosee process chain as /CPMB/LIGHT_OPTIMIZE
--> Give package name and description
--> Select Taks type as User Package
-->Click Save
3. Create one more package for Full Optimization as expalined in step 2 under same team
Now users who are related to this new team can able to run both Full and light optimizations provided Execute task assigned under task profile.
By following above steps you can assign many package to team and can modify team access from Manage Team user package access if you need.
Hope it helps..
Regards,
Raju -
Hello,
Was wondering if any experts can give any insite into how to fix our full optimize from failing. We have had a custom package running for a few years which one of the last steps it does a full optimize. About a week ago it started to fail on this step and when we try to manually optimize from the front end it fails as well. We are able to optimize from the backend however. There are no additional processing running during this time, can anyone give any suggestions on what may be causing the problem? Is there some temp file that needs to be cleaned? I tried to do a modify of the application and that has not worked. We are on version 7.0.
Thanks in advance!
KevinHere are a few of the messgaes I see in that table around the time of me trying to optimize this morning. Not sure what these mean:
==============[System Error Tracing]============== [System Name] - ApplicationService [Message Type] - ErrorMessage [Job Name] - OSoft.Services.Webservice.ApplicationService.ApplicationService.Query() [DateTime] - 7-27-2011 7-29-05 AM [UserId] - [Exception] DetailMsg - {You are not authorized to perform this task. Please contact your BPC administrator.} ==============[System Error Tracing End ]==============
==============[System Error Tracing]============== [System Name] - ApplicationService [Message Type] - ErrorMessage [Job Name] - OSoft.Services.Webservice.ApplicationService.ApplicationService.Query() [DateTime] - 7-27-2011 7-29-16 AM [UserId] - [Exception] DetailMsg - {You are not authorized to perform this task. Please contact your BPC administrator.} ==============[System Error Tracing End ]==============
==============[System Error Tracing]============== [System Name] - DatabaseHandler [Message Type] - ErrorMessage [Job Name] - CommitTran [DateTime] - 7-27-2011 7-37-54 AM [UserId] - User [SqlException] Type - System.Data.SqlClient.SqlException Errors - System.Data.SqlClient.SqlErrorCollection Class - 10 LineNumber- 0 Message - {Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.} Number - -2 Procedure - ConnectionRead (recv()). Server - BPCMS7P-OMF-03 State - 0 Source - .Net SqlClient Data Provider TargetSite- Void OnError(System.Data.SqlClient.SqlException, System.Data.SqlClient.TdsParserState) HelpLink - ==============[System Error Tracing End ]==============
==============[System Error Tracing]============== [System Name] - DatabaseHandler [Message Type] - ErrorMessage [Job Name] - RollbackTran [DateTime] - 7-27-2011 7-37-55 AM [UserId] - User [Exception] DetailMsg - {This SqlTransaction has completed; it is no longer usable.} ==============[System Error Tracing End ]==============
==============[System Error Tracing]============== [System Name] - OSoftOptimizeManage [Message Type] - ErrorMessage [Job Name] - OptimizeApplication() [DateTime] - 7-27-2011 7-37-55 AM [UserId] - mscorlib [Exception] DetailMsg - {Exception has been thrown by the target of an invocation.} ==============[System Error Tracing End ]==============
==============[System Error Tracing]============== [System Name] - ApplicationService [Message Type] - ErrorMessage [Job Name] - OSoft.Services.Webservice.ApplicationService.ApplicationService.Query() [DateTime] - 7-27-2011 7-40-18 AM [UserId] - [Exception] DetailMsg - {You are not authorized to perform this task. Please contact your BPC administrator.} ==============[System Error Tracing End ]==============
==============[System Error Tracing]============== [System Name] - ApplicationService [Message Type] - ErrorMessage [Job Name] - OSoft.Services.Webservice.ApplicationService.ApplicationService.Query() [DateTime] - 7-27-2011 7-40-45 AM [UserId] - [Exception] DetailMsg - {You are not authorized to perform this task. Please contact your BPC administrator.} ==============[System Error Tracing End ]============== -
Hi I can´t do a Full Optimize on one of our cubes. The Optimize takes 3 hours then I get the following error:
Error message:Exception has been thrown by the target of an invocation.
Error message:This SqlTransaction has completed; it is no longer usable.
What can be wrong?I have found an error log in the outlookssoft log in Event Viewer that occurs everytime I start the full optimze for this application, the error log looks like this:
Event Type: Error
Event Source: OutlookSoft log
Event Category: None
Event ID: 0
Date: 10/11/2008
Time: 10:16:40 AM
User: N/A
Computer: STAMW08
Description:
==============[System Error Tracing]==============
[System Name] : OSoftCPM
[Message Type] : ErrorMessage
[Job Name] : AuditMgrService/InitAudit
[DateTime] : 10/11/2008 10:16:40 AM
[UserId] :
[SqlException]
Type : System.Data.SqlClient.SqlException
Errors : System.Data.SqlClient.SqlErrorCollection
Class : 16
LineNumber: 1
Message : {There is already an index on table 'AuditDataRapport' named 'IX_AuditDataRapportBatchID'.}
Number : 1913
Procedure :
Server : STAMW08
State : 2
Source : .Net SqlClient Data Provider
TargetSite:
HelpLink :
==============[System Error Tracing End ]============== -
Full Optimize problem - BPC 10.1 Classic on HANA
Hi,
I try to execute a Full Optimize, but it always ends with a warning and starts the Light Optimize instead.
The model has 18 dimensions and a very large dimension is in the so-called "Last dimension". I'd expect the Full Optimize to reorganise the model.
ENABLE_FIXED_CUBENAME is not active/set.
Any ideas what is causing this or how to enforce the full optimize to be performed?
Best regards,
ChristophHi Chrisoph,
Do you know the full implication after running a full optimize? changing of cube names and so on?
You can ENABLE_FIXED_CUBENAME parameter by looking at sap note 1689814
once you fixed the cube name you can only run lite optimize.
Andy -
Error message for full optimization
Dear all,
I received the following error message when i tried to run a full optimization. Does anyone know the following error message mean?
"Error message:There is already an object named 'CONSTTBLFACTBUDGET_ALLOCATION' in the database.
Could not create constraint."
And where can i see the log for optimization?
Thanks and regards,
Lip CheanHi,
Please refer to the Note 1101768.
This error can occur if there is more than one constraint with the same name located in the same SQL database.
For example, if you backup the tblFactFinance table by exporting a copy of the table as tblFactFinanceBackup within the same SQL database and then later you rename the tblFactFinance in use as tblFactFinance_Old and the restore the tblFactFinanceBackup as tblFactFinance, the additional constraint of tblFactFinance_Old will cause this issue.
To resolve, using the example above, delete the additional constraint by going to START->PROGRAMS->Microsoft SQL Server->SQL Query Analyzer ->Connect to the SQL Server at issue->Open the Object Browser->expand the SQL database at issue->User tables->dbo.tblFactFinance_old->Constraints->select the fxdbo.tblFactFinance constraint and delete it.
After the constraint is deleted then the application can be saved without this error.
Hope this helps.
Maybe you are looking for
-
Why won't my vi run outside of the LV2011 project explorer?
I've created a LV2011 project. The vi's within this project open executables to perform measurement functions. When I open the vi's from within the project explorer window the executables open with no issues. However, with the LV project closed and o
-
CLI0125E Function sequence error
Hi, I'm using Websphere 3.5.2 and in consequence Java 1.2.2. I already read bug database link: http://developer.java.sun.com/developer/bugParade/bugs/4243452.html In our code we commonly execute database queries using a connection, a prepared stateme
-
Finally opened a Shuffle 512MB won over a year ago. Loading songs works just fine on my laptop which has iTunes 6.0.5 loaded (used with my nano). I can use autofill or drag and drop no problems. On my desktop with iTunes 7.0.2, the autofill button do
-
When I try to send my pictures to a photolab, I get error messages stating that the resolution is too low. The only way I can get photos is to take my camera card to the store and print them out. I like to make black and white photos and the effects
-
TS1702 How to delete an app in the ipad
How do I delete an app ... And how do I find a users manual for my iPad? I thought it was found in Settings. I'm a new user appreciate the help