Data Warehouse issues

Hi there.
I'll try and be to the point as I can. I undertook an upgrade from SCOM 2012 SP1 to R2, this was successful. However after a few days had past, I noticed that the log file for the DW DB was growing rapidly, to the point where we hit a real issue. The drive
was a comfortable 50GB drive, but in the end had to be increased to just short of 500GB !! Long story short, I wasn't allowed to get a consultant in to help diagnose the issue, therefore, I was consulting Google, Technet articles etc.
The end decision was to DELETE the Data Warehouse DB & log file and create them again from scratch. I've done this, and used the following instructions on how to do so (http://www.3packetsofcrisps.com/2014/04/reset-scom-2012-data-warehouse-database.html).
I have data going into the DW DB, or rather did up until midnight, so had around 3.5 hrs worth.
After checking the Operations Manager event log on one of the Management Servers, I can see numerous errors, these include:2115, 4506 and occasionally 8000.
The event 4506 states: "Data was dropped due to too much outstanding data in rule "Rule Name" running for instance "instance name" with id "ID name" in management group "xxx".
After some consulting Google, I read that this might be expected because a lot of data is trying to be written to the DW DB, however, that doesn't explain why it was writing and for some reason randomly stopped.
A quick summary of our environment:
2x Management Servers running Win 2012 Std x64
1x Operations Database server running Win 2012 Std x64 & SQL Server 2012 Std x64
1x Data Warehosue DB server running Win 2012 Std x64 & SQL Server 2012 Std x64
I've checked account permissions using http://technet.microsoft.com/en-gb/library/hh457003.aspx
If you need any more information, please say, I've tried to keep the post as small as possible.
Dave.

Hi
Thanks for responding. It's been over a day so far, however, I've only just flushed the health service state & cache for the servers I'm monitoring. Would you suggest I do this for the Management Servers as well?
In regards to alerts in the SCOM console, I am getting active alerts. I've just checked and some were 49 minutes ago.
I've also taken another look at the DW DB (via Windows Explorer), and I can see the last modified date has changed to 09/09/2014 20:48. So once again, something has happened but it appears to be random..
This might need to be a separate post, but I've also got issues with my Reporting. If I go to the 'Reporting Server URL', I get the following message: "The version of the report server database is either in a format that is not valid, or it cannot
be read. The found version is ''. The expected version is '162'. (rsInvalidReportServerDatabase)"
Any ideas?
Dave

Similar Messages

Service Manager 2012 R2 - Data warehouse Issue

i have an issue with a customer with their Data warehouse Server. when ever we generate a report using Service Manager we are not seeing data in the report. example - we only see 4 incidents on reports when we generate them and these are many months
old records. within the database there are 1000+ Incidents created however when generating a report only shows us 4 incidents. i'm trying to figure out why it's only showing few records whereas it should show all the records when we generate. i have this
issue now with two customers
i can see that the Data warehouse jobs are running without issues. they are not failing. please let me know how i can get this issue fixed

Open up an SQL management studio and connect to the database that hosts the data warehouse database. Run a query against this following views.
Incident
SELECT * FROM [DWDataMart].[dbo].[IncidentDimvw]
If we look at the Incident query if this only returns 4 incidents as your report then the sync to the data warehouse is not working correctly. I would recommend runnung travis ETL job to run all the data warehouse jobs in the correct order. You can find
it here. https://gallery.technet.microsoft.com/PowerShell-Script-to-Run-a4a2081c
And if that still does not help there is another few blog posts for troubleshooting the data warehouse but lets try this first and go from there.
Cheers,
Thomas Strömberg
System Center Specialist
Blog:
Twitter: LinkedIn:
Please remember to 'Propose as answer' if you find a reply helpful

Data Warehouse issue after deploaying Server 2012 MP in SCOM 2007R2

Hi all,
I have recently installed Server 2012 MP in SCOM 2007R2. But now I get DataWarehouse warnings that the specified schema name "sdk" either does not exist or I do not have permission to use it.
It's event 31565 with source Operations Manager Health Service Modules
Can anyone help me?
Failed to perform Data Warehouse component deployment operation:Install; Component: Script, Id: '79c157e5-9aa8-7045-d0b8-19e2d713d6c7',Management Pack Version-dependent Id: '01f04523-ee6c-1f3e-08a1-a108dda43507';Target: Database, Server name: 'SQL\SCOM,10100', Database name: 'OperationsManagerDW'. Batch ordinal: 0; Exception: The specified schema name "sdk" either does not exist or you do not have permission to use it.
Best regards,
Oliver
Gruss Oliver Scholl

Hi Gruss,
Was there any resent permission change on the SQL server or the Data warehouse ?
Has your Data reader and writer account Sys admin permissions on the SQL application ?
Also is the reporting tab working and are the reports related to this and other management packs working ?
Gautam.75801

Performance issues with data warehouse loads

We have performance issues with our data warehouse load ETL process. I have run
analyze and dbms_stats and checked database environment. What other things can I do to optimize performance? I cannot use statspack since we are running Oracle 8i. Thanks
Scott

Hi,
you should analyze the db after you have loaded the tables.
Do you use sequences to generate PKs? Do you have a lot of indexex and/or triggers on the tables?
If yes:
make sure your sequence caches (alter sequence s cache 10000)
Drop all unneeded indexes while loading and disable trigger if possible.
How big is your Redo Log Buffer? When loading a large amount of data it may be an option to enlarge this buffer.
Do you have more then one DBWR Process? Writing parallel can speed up things when a checkpoint is needed.
Is it possible using a direct load? Or do you already direct load?
Dim

Error while creating data warehouse tables.

Hi,
I am getting an error while creating data warehouse tables.
I am using OBIA 7.9.5.
The contents of the generate_clt log are as below.
>>>>>>>>>>>>>>>>>>>>>>>>>>
Schema will be created from the following containers:
Oracle 11.5.10
Universal
Conflict(s) between containers:
Table Name : W_BOM_ITEM_FS
Column Name: INTEGRATION_ID.
The column properties that are different :[keyTypeCode]
Success!
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
There are two rows in the DAC repository schema for the column and the table.
The w_etl_table_col.KEY_TYPE_CD value for DW application is UNKNOWN and for the ORA_11i application it is NULL.
Could this be the cause of the issue? If yes, why could the values be different and how to resolve this?
If not, then what could be the problem?
Any responses will be appreciated.
Thanks and regards,
Manoj.

Strange. The OBIA 7.9.5 Installation and Configuration Guide says the following:
4.3.4.3 Create ODBC Database Connections
Note: You must use the Oracle Merant ODBC driver to create the ODBC connections. The Oracle Merant ODBC driver is installed by the Oracle Business Intelligence Applications installer. Therefore, you will need to create the ODBC connections after you have run the Oracle Business Intelligence Applications installer and have installed the DAC Client.
Several other users are getting the same message creating DW tables.

Service Manager data warehouse management server Installation fails

Hi there,
In Virtual Machine Windows Server 2012 R2 Standard with my user being a Local Admin and SQL Admin. I tried to do a Service Manager data warehouse management server
first installation I am facing the following image as error:
In the event viewer I get the following error:
"Microsoft System Center 2012 R2 Service Manager -- The installer has encountered an unexpected error installing this package. This may indicate a problem with this package. The error code is 25211
The arguments are: -2147024809, The parameter is incorrect."
In the Setup log, some of the errors are:
WixRemoveFoldersEx: Entering WixRemoveFoldersEx in C:\Windows\Installer\MSI35E.tmp, version 3.7.1224.0
WixRemoveFoldersEx: Error 0x80070057: Missing folder property: PSCONFIGFOLDER.A591E3B4_D228_431D_BF89_99D52C8FFB76 for row: wrf4582BC4C5CC47B1D2380408CD7A752DC.A591E3B4_D228_431D_BF89_99D52C8FFB76
CustomAction WixRemoveFoldersEx.A591E3B4_D228_431D_BF89_99D52C8FFB76 returned actual error code 1603 but will be translated to success due to continue marking
CAStartServices: CAStartServices was passed . OMCFG
CAStartServices: Checking if service already started. OMCFG
CAStartServices: Attempting to start service. OMCFG
CAStartServices: StartService failed. Error Code: 0x8007042D.
ConfigureSDKConfigService: CAStartServices failed, trying again.... Error Code: 0x8007042D. OMCFG
Action start 17:47:05: _SetHealthServiceConfig.80B659D9_F758_4E7D_B4FA_E53FC737DCC9.
GetMsiFeatureState: Failed to get feature state. Error Code: 0x80070646. MOMServer
MSI (s) (EC!4C) [17:47:05:483]: Note: 1: 2711 2: MOMGateway
SetHealthServiceConfig: Failed to get Feature State.. Error Code: 0x80070646. MOMServer
GetMsiFeatureState: Failed to get feature state. Error Code: 0x80070646. MOMGateway
I have checked the following post but it did not help me:
http://social.technet.microsoft.com/Forums/systemcenter/en-US/c42bb04d-a51e-4037-a8a3-37d714d6faac/scsm-management-server-installation-fails?forum=systemcenterservicemanager
Could you please help me with this issue?
Thanks a lot,
M

Hi,
Sorry I cannot post the full log. I have found also these errors in the log:
Calling custom action CAManaged!Microsoft.MOMv3.Setup.MOMv3ManagedCAs.RegisterSdkSCP
RegisterSdkSCP: There is no previous serviceConnectionPoint
RegisterSdkSCP: Creating New serviceConnectionPoint
RegisterSdkSCP: Adding ACL for current user: DOMAIN\InstallationAccount
RegisterSdkSCP: Adding ACL for SM Admini: DOMAIN\SCSMDWadmins
RegisterSdkSCP: Error: Access is denied.
InstallCounters: LoadPerfCounterTextStrings() failed . Error Code: 0x80070057. momv3 "D:\Program Files\Microsoft System Center 2012 R2\Service Manager\MOMConnectorCounters.ini"
InstallPerfCountersHelper: pcCounterInstaller->InstallCounters() for the default counters failed. Error Code: 0x80070057. MOMConnector
InstallPerfCountersLib: InstallHealthServicePerfCounters() failed . Error Code: 0x80070057.
InstallPerfCountersLib: Retry Count : .
InstallHSPerfCounters: Failed to install agent perf counters. Error Code: 0x80070057.
Thanks for your reply.

Failure on clean install of Service Manager 2012 R2 Data Warehouse installation - Error about "AssignSdkAccountAsSsrsPublisher"

I'm installing the Data Warehouse component on a new server (Server 2008 R2 SP1 with SQL 2012 SP1 CU6). Reporting service, analysis services and full text services are installed. I'm installing under an account that has DBO rights to the instance.
All pre-reqs pass. The installation gets to the very end of the installation and i get the following error:
An error occurred while executing a custom action:_AssignSdkAccountAsSsrsPublisher
This upgrade attempt has failed before permanent modifications were made. Upgrade has successfully rolled back to the Original state of the system. Once the correction are made, you can retry upgrade for this role.
I look in the setup logs and only see the following reference to "AssignSdkAccountAsSsrsPublisher"
MSI (s) (1C:00) [15:09:51:914]: NOTE: custom action _AssignSdkAccountAsSsrsPublisher unexpectedly closed the hInstall handle (type MSIHANDLE) provided to it. The custom action should be fixed to not close that handle.
CustomAction _AssignSdkAccountAsSsrsPublisher returned actual error code 1603 (note this may not be 100% accurate if translation happened inside sandbox)
Originally, I had some issues with services not being started during the install because some accounts didn't have "logon as a service" rights, but those have all been rectified. Not sure if something is leftover from that, or maybe CU6 wasn't
tested with SM R2 and i need to go back to an earlier CU?

That worked for me too. By manually removing all the folders from SSRS, then retrying the install, allowed it to proceed and complete successfully the second time around.
The first time installing SCSM 2012 R2, I got hit with
this error, which is why SSRS wasn't in a clean state. Make sure to launch setup.exe elevated as an admin!

Service Manager Data Warehouse Install - Analysis Server Configuration For OLAP Cubes Fail

Hello everyone,
I have an issue with my installation of the Data Warehouse for System Center Service Manager 2012 SP1.
My install environment is the following:
Windows Server 2012 – System Center Service Manager (Successfully Installed) - Virtual
Windows Server 2012 – System Center Data Warehouse (Pending) - Virtual
Windows Server 2012 – MS SQL Server 2012 – Physical, Clustered 1<sup>st</sup> of Four Servers
The SQL Server is a clustered installation with named instances, specifically for SharePoint and Service Manager. Each instance has its own IP address and dynamic ports are turned off. I’m installing using the domain administrator account and I also chose
to run the installer as administrator. The domain admin has sysadmin rights to the service manager server and instance I’m trying to install on. However, the account does not have sysadmin rights to some of the other instances.
The install is smooth up until it needs to connect to the Analysis server database. I have tried connecting to the analysis servers on other SQL servers on site and all were successful. The only difference between the older SQL servers, the SQL 2012 development
server and the SQL 2012 Production server I’m trying to install to is that the that the domain admin account doesn’t have sysadmin access on all the databases on the new production server. The SQL server is being installed and configured by a contractor so
if you all have troubleshooting suggestions, I’ll need to coordinate with the contractor.
Starting with the screen below, I began searching for help online. There seems to be no one else with this issue or it is not documented properly. I opened a ticket with MS, called the contractor and troubleshot with him, troubleshot as far as I could on
my own and I’m still at a loss as to what is preventing the installer from connecting specifically to the analysis server.
I first thought the installer was at issue or that the data warehouse sever was at issue. But all signs are pointing at the SQL server. The installer is able to connect to all the other SQL servers – including other 2012 servers (same versions) – so it can’t
be the installer. I’m pretty sure the SQL server is going to be at issue.
After looking at this error, I opened the resource monitor and clicked the dropdown to see if it was trying to connect to the correct server and it was. I then connected to the old and new test and development servers successfully. Then connected to the
SQL 2008 R2 production cluster successfully. I then compared the two servers. The only difference other than the version numbers is that the admin account doesn’t have sysadmin rights on all the SQL 2012 database servers. But the database servers are not the
problem. The analysis servers are.
I then checked the event logs and they are empty as far as this issue is concerned. Actually, there are no errors on the SQL 2012 production box and the Data Warehouse box. I then checked the log that the installer creates during every step of the installation
and this is what is created when the dropdown is clicked for the analysis server configuration screen. The log file location is:
“C:\Users\admin\AppData\Local\Temp\2\SCSMSetupWizard01.txt”
In the file is the following text.
01:03:34:Attempting connection to SQL Server 2012 management scope on SCSMSQL2012
01:03:34:Using SQL Server 2012 management scope on SCSMSQL2012
01:03:36:Collecting SQL instances on server SCSMSQL2012
01:03:36:Attempting connection to SQL Server 2012 management scope on SCSMSQL2012.johnsonbrothers.com
01:03:36:Using SQL Server 2012 management scope on SCSMSQL2012.johnsonbrothers.com
01:03:38:Found SQL Instance: SCSMSQL2012\PWGSQL2012
01:03:38:Found SQL Instance: SCSMSQL2012\SCSMSQL2012
01:03:39:Error:GetSqlInstanceList(), Exception Type: Microsoft.AnalysisServices.ConnectionException, Exception Message: A connection cannot be made. Ensure that the server is running.
01:03:39:StackTrace:   at Microsoft.AnalysisServices.XmlaClient.GetTcpClient(ConnectionInfo connectionInfo)
   at Microsoft.AnalysisServices.XmlaClient.OpenTcpConnection(ConnectionInfo connectionInfo)
   at Microsoft.AnalysisServices.XmlaClient.OpenConnection(ConnectionInfo connectionInfo, Boolean& isSessionTokenNeeded)
   at Microsoft.AnalysisServices.XmlaClient.Connect(ConnectionInfo connectionInfo, Boolean beginSession)
   at Microsoft.AnalysisServices.Server.Connect(String connectionString, String sessionId, ObjectExpansion expansionType)
   at Microsoft.SystemCenter.Essentials.SetupFramework.HelperClasses.SetupValidationHelpers.GetASVersion(StringBuilder sqlInstanceServiceName)
   at Microsoft.SystemCenter.Essentials.SetupFramework.HelperClasses.SetupValidationHelpers.GetSqlInstanceList(String sqlServerName, Int32 serviceType)
I’m now investigating the issue according to this output, and decided to ask you all if you’ve run into this issue and found a resolution.

I am running into same issue . But I don't anything in the instances section related to portipv6 . I do see in the listener section , I tried to remove it . But it comes up again . Please help
<ConfigurationSettings>
<Security>
<RequireClientAuthentication>0</RequireClientAuthentication>
<SecurityPackageList/>
</Security>
<Network>
<Listener>
<RequestSizeThreshold>4095</RequestSizeThreshold>
<MaxAllowedRequestSize>0</MaxAllowedRequestSize>
<ServerSendTimeout>60000</ServerSendTimeout>
<ServerReceiveTimeout>60000</ServerReceiveTimeout>
<IPV4Support>2</IPV4Support>
<IPV6Support>2</IPV6Support>
</Listener>
<TCP>
<MaxPendingSendCount>12</MaxPendingSendCount>
<MaxPendingReceiveCount>4</MaxPendingReceiveCount>
<MinPendingReceiveCount>2</MinPendingReceiveCount>
<MaxCompletedReceiveCount>9</MaxCompletedReceiveCount>
<ScatterReceiveMultiplier>5</ScatterReceiveMultiplier>
<MaxPendingAcceptExCount>10</MaxPendingAcceptExCount>
<MinPendingAcceptExCount>2</MinPendingAcceptExCount>
<InitialConnectTimeout>10</InitialConnectTimeout>
<SocketOptions>
<SendBufferSize>0</SendBufferSize>
<ReceiveBufferSize>0</ReceiveBufferSize>
<DisableNonblockingMode>1</DisableNonblockingMode>
<EnableNagleAlgorithm>0</EnableNagleAlgorithm>
<EnableLingerOnClose>0</EnableLingerOnClose>
<LingerTimeout>0</LingerTimeout>
</SocketOptions>
</TCP>
<Requests>
<EnableBinaryXML>0</EnableBinaryXML>
<EnableCompression>0</EnableCompression>
</Requests>
<Responses>
<EnableBinaryXML>1</EnableBinaryXML>
<EnableCompression>1</EnableCompression>
<CompressionLevel>9</CompressionLevel>
</Responses>
<ListenOnlyOnLocalConnections>0</ListenOnlyOnLocalConnections>
</Network>
<Log>
<File>msmdredir.log</File>
<FileBufferSize>0</FileBufferSize>
<MessageLogs>Console;System</MessageLogs>
<Exception>
<CreateAndSendCrashReports>0</CreateAndSendCrashReports>
<CrashReportsFolder/>
<SQLDumperFlagsOn>0x0</SQLDumperFlagsOn>
<SQLDumperFlagsOff>0x0</SQLDumperFlagsOff>
<MiniDumpFlagsOn>0x0</MiniDumpFlagsOn>
<MiniDumpFlagsOff>0x0</MiniDumpFlagsOff>
<MinidumpErrorList>0xC1000000, 0xC1000001, 0xC100000C, 0xC1000016, 0xC1360054, 0xC1360055</MinidumpErrorList>
<ExceptionHandlingMode>0</ExceptionHandlingMode>
<MaxExceptions>500</MaxExceptions>
<MaxDuplicateDumps>1</MaxDuplicateDumps>
</Exception>
</Log>
<Memory>
<HandleIA64AlignmentFaults>0</HandleIA64AlignmentFaults>
<PreAllocate>0</PreAllocate>
<VertiPaqPagingPolicy>0</VertiPaqPagingPolicy>
<PagePoolRestrictNumaNode>0</PagePoolRestrictNumaNode>
</Memory>
<Instances/>
<VertiPaq>
<DefaultSegmentRowCount>0</DefaultSegmentRowCount>
<ProcessingTimeboxSecPerMRow>-1</ProcessingTimeboxSecPerMRow>
<SEQueryRegistry>
<Size>0</Size>
<MinKCycles>0</MinKCycles>
<MinCyclesPerRow>0</MinCyclesPerRow>
<MaxArbShpSize>0</MaxArbShpSize>
</SEQueryRegistry>
</VertiPaq>
</ConfigurationSettings>

Syntax for WriterLoginName in Data Warehouse DB

Hello
I'm having a few issues with our management servers writing to the Data Warehouse DB. I've checked the 'Management Group' table and can see the WriterLoginName is set to
DOMAIN\sv-scom-dw - however, i'm just querying whether that field should read
sv-scom-dw
The account is in fact a domain account. It's listed as the 'Data Warehouse SQL Account' & 'Data Warehouse Action Account' (under Administration > Run As configuration > Accounts).
We have two entries in the database security (rights over OperationsMangerDW), one as DOMAIN\sv-scom-dw & a local SQL login called sv-scom-dw. Both accounts have the following permissions: apm_datareader, apm_datawriter, db_datareader, db_owner, OpsMgrReader,
OpsMgrWriter, public.
We're a SCOM 2012 R2 environment. All servers are 2012 R2, SQL is also 2012 standard.
Anyone faced a similar issue before? I'm seeing a lot of alerts in the Monitoring section for the Data Warehouse. One in particular:
Data Warehouse failed to discover performance standard data set. Failed to enumerate (discover) Data Warehouse objects and relationships among them. The operation will be retried.
Exception 'SqlException': Management Group with id ''5F201AB2-4B10-7FCC-C716-B2361102248D'' is not allowed to access Data Warehouse under login ''sv-scom-dw''
One or more workflows were affected by this.
Workflow name: Microsoft.SystemCenter.DataWarehouse.Discovery.StandardDataSet
Instance name: Performance data set
Instance ID: {B81C47FB-A80D-0FE5-A8DB-DC4544FC8DA6}
Management group: ******
As you can see from the alert the account referenced is 'sv-scom-dw' and not 'DOMAIN\sv-scom-dw'. Which is why I originally asked, should the field in the management table be updated?
Thanks, David.

Hi guys.
Thanks for the responses, I shall provide an event ID shortly. In response to Mai, I've followed the link you've posted and I'm now checking the 'data source and related settings', so i've gone to http://localhost/reports on the Warehouse server (which
also hosts the reporting), and i've got the following error:
The report server cannot decrypt the symmetric key that is used to access sensitive or encrypted data in a report server database. You must either restore a backup key or delete all encrypted content. (rsReportServerDisabled)
Get
Online Help
Keyset does not exist (Exception from HRESULT: 0x80090016)
Have you come across this before?

Why do we need SSIS and star schema of Data Warehouse?

If SSAS in MOLAP mode stores data, what is the application of SSIS and why do we need a Data Warehouse and the ETL process of SSIS?
I have a SQL Server OLTP database. I am using SSIS to transfer my SQL Server data from OLTP database to a Data Warehouse database that contains fact and dimension tables.
After that I want to create cubes using SSAS form Data Warehouse data.
I know that MOLAP stores data. Do I need any Data warehouse with Fact and Dimension tables?
Is not it better to avoid creating Data warehouse and create cubes directly from OLTP database?

Another thing to note is data stored in transactional system may not always be in end user consumable format for ex. we may use bit fields/flags to represent some details in OLTP as storage required ius minimum but presenting them as is would not make any
sense to user as they would not know what each bit value represents. In such cases we apply some transformations and convert data into useful information for users to understand. This is also in the warehouse so that information in warehouse can directly be
used for reporting. Also in many cases the report will merge data from multiple source systems so merging it on the fly in report would be tedious and would have hit on report server. In comparison bringing them onto common layer (warehouse) and prebuilding
aggregates would be benefitial for the report performance.
I think (not sure) we join tables in SSAS queries and calculate aggregations in it.
I think SSAS stores these values and joined tables and we do not need to evaluates those values again and this behavior is like a Data Warehouse.
Is not it?
So if I do not need historical data, Can I avoid creating Data Warehouse?
On the backend SSAS uses queries only to extract the data
B/w I was not explaining on SSAS. I was explaining on what happens inside datawarehouse which is a relational database by itself. SSAS is used to built cube (OLAP structures) on top of datawarehouse. star schema is easier for defining relationships
and buidling aggregations inside SSAS as its simple and requires minimal lookups to be performed. Also data would be held at lowest granularity level which can easily be aggregated to required levels inside OLAP cubes. Cube processing is very resource
intensive and using OLTP system would really have a huge impact on processing performance as its nnot denormalized and also doing tranformation etc on the fly adds up to complexity. Precreating a layer (data warehouse) having data in required format would
make cube processing easier and simpler as it has to just cross join tables and aggregate data based on relationships defined and level needed inside the cube.
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Only Alert Data is not being inserted in SCOM 2012 Data Warehouse database

Hi All,
Alert data is not getting inserted into SCOM Data Warehouse database since 10 days though I could see latest Performance data in DW DB. No changes were made as far I know on SCOM servers or DB's. I had this issue few months back
and got resolved by executing a qiery to create an entry for Data Warehouse Synchronisation server entry.
Now I have checked the discovered inventory and could see an entry present and it is healthy. Still, latest Alert data is not getting inserted into DW DB. Please help me out.
http://social.technet.microsoft.com/Forums/en-US/2dac4f45-4911-40dc-a220-702993188832/alert-data-is-not-present-in-scom-2012-data-warehouse-database-since-two-weeks?forum=operationsmanagergeneral
Regards, Suresh

Hi,
Generally, data warehouse store a long-term data, and by default, it would keep 400 days data, I suggest check your configuration:
How to Configure Grooming Settings for the Reporting Data Warehouse Database
http://technet.microsoft.com/en-us/library/hh212806.aspx
Alex Zhao
TechNet Community Support

How to Troubleshoot why data is not moving over into the Data Warehouse after Sql Server Agent Job Run

Hello,
Here is my problem:
Data was imported into the staging area. After resolving some errors and running the job, I got the data to move over to the next area. From there, data should be moving over into the DW. I have been troubleshooting for hours and cannot reslove this
issue. I have restarted the sql service services, I have ran a couple packages manually, and the job is running successfully.
What are some reasons why data is not getting into the data warehouse? Where should I be looking?
Your help is greatly appreciated!!

Anything is possible.
So, just to reiterate, running the job manually works, running the scheduled job does not result in errors neither data arriving to the DW, right? And it used to, correct?
If so, the 1st step would be to examine the configuration(s). But not before you inspect the package. Do you have an ability to export it to a file system and open in BIDS?
Arthur My Blog

Alert data is not present in SCOM 2012 Data Warehouse database since two weeks

Alert data is not present in SCOM 2012 Data Warehouse database since a week though I could see Performance data for the latest dates. Old Alert data is present but I think the latest Alert data is not being inserted to Data warehouse. No activity was done
on the day from where we are missing data.
I could see 31554 events on all my Management servers and this proves that Data Insertion is happening. I am not sure why only Alert data is missing (or not getting inserted) in DW database. I am trying to use SQL queries to fetch the data as I dont have reporting
currently. The same query is working for other dates, so there is no issue with this query.
I have noticed that I could see the Alert Data present in SCOM OperationsmNager Db but NOT present in OperationsManagerDW database.
In SCOM 2007, data will be inserted in both Ops DB and DW simultaneously. I believe the same methodology in 2012 too.
Please help me to fetch Alert data from DW. Any suggestion pls?
Regards, Suresh

Hi,
Generally, data warehouse store a long-term data, and by default, it would keep 400 days data, I suggest check your configuration:
How to Configure Grooming Settings for the Reporting Data Warehouse Database
http://technet.microsoft.com/en-us/library/hh212806.aspx
Alex Zhao
TechNet Community Support

Windows Client MP is using the default action account to write to the Data Warehouse

Hi,
I have recently installed SCOM 2012R2, and am in the process of migrating everthing from SCOM 2007R2.
Just after I installed the Windows Client MP (version 6.0.7250.0), I started getting this Event 11852:
OleDb Module encountered a failure 0x80004005 during execution and will post it as output data item. Unspecified error
: Cannot open database "OperationsManagerDW" requested by the login. The login failed.
Workflow name: Microsoft.Windows.Client.Win7.ComputerGroup.MemoryTrendsRAM
Instance name: Microsoft System Center Data Warehouse
Instance ID: {16781F33-F72D-033C-1DF4-65A2AFF32CA3}
Management group: 2012SCOMDEV
This is happening every 7 days and only happening on the Win7 Management pack. I checked the DW logs and found that it was using the default action acount (SCOM ACTION)to send to the DW. This account doesn't have access to the DW DB.
I assume it should be using the Data Warehouse action account. This is how the acount is setup
Can anyone tell me where I'm going wrong here? I have not had to touch the permissions for any of the other Management packs. the rest of them just work.

For this issue, you can check below link
http://blog.metasplo.it/2014/01/scom-2012-oledb-module-0x80004005.html
Please remember, if you see a post that helped you please click "Vote As Helpful" and if it answered your question, please click "Mark As Answer"Mai Ali | My blog:
Technical | Twitter:
Mai Ali

Is the OBIEE used to create a data warehouses dynamically?

Management where I work wants to use the OBIEE Administrator to source a 3NF normalized database and create a "virtual data warehouse" in the Business Modeling Mapping layer of OBI Administrator as a Star Schema model is required by OBI Business Model layer. They claim they were told by an Oracle sales rep that the Administrator tool could do this.
Is this possible? As OBI issues only SQL and not PL/SQL how can one "create" dimensions, lookup tables and fact tables dynamically? And even if it could the performance hit to recreate the virtual data warehouse each time a query is issued would be huge.
Having used Prism Warehouse Builder and DataStage in the past to create data warehouses I am aware that one needs a procedural programming language to create and maintain the star schema tables (surrogate key maintenance, controling workflows, maintaining slowly changing dimensions, intermediate lookup tables, etc.). SQL was not meant to do this heavy lifting programming. Afterall, isn't this why Oracle Warehouse Builder and previously Informatica is shipped with OBIEE suite because OBI is not an ETL tool to create dimensional models? One uses an ETL tool to create the dimensional data model for OBI to access and pass along the metadata to OBI Answers.
So is it normal practice to use the Administrator's Business Mapping/Modeling layer for creating a virtual star schema logical tables from physical tables that are 3NF? Or is the tool used to access already denormalized tables in the physical layer that were created using Informatica or OWB or other ETL tool?

I asked an "Expert" in OBIEE. Here are snippets of his response:
"Be aware though that the transformation ability is fairly limited, and
will only really work with data that is very close to a star schema, i.e.
the data can be easily transformed through a couple of denormalizations and
table joins. If your source data is very normalized and cannot easily be
transformed into a star schema, you would need to use a tools such as
Informatica, OWB or similar to extract data from your source systems, load
and then transform it into a data warehouse or data mart and report of of
that. The more that your data needs to be transformed (i.e. the closer it
is to a 3NF model) the more likely it is that you'll need to use an ETL
tool, and a data warehouse or data mart, to host your data."
And in response to my noting the lack of documentation on how to model a 3NF to Star Schema his response was:
"No, you're right, the documentation doesn't really go into "how to" turn a 3NF model into a dimensional model. If you look back to when OBIEE was a Siebel product, the documentation was really aimed at either Siebel consultants or customers who had been on the training, they didn't want customers "off the street" to try and implement OBIEE as it would hit their services revenue. That's where the blog posts we do, things like the Oracle-by-example training courses on OTN and so on come in, otherwise as you say there's little out there on the best way to transform your model - it's mostly passed on "word of mouth" or is built up from experience on working on projects."

Data Warehouse issues

Similar Messages

Maybe you are looking for