Event 2115 and 31551 generated

Question

Hi All
I know there is much information relating to the two event IDs above, mainly relating to performance issues.
Essentially, I am seeing the above Event ID for the following Workflows:
Microsoft.SystemCenter.DataWarehouse.CollectEventData
Microsoft.SystemCenter.DataWarehouse.CollectPerformanceData
Microsoft.SystemCenter.DataWarehouse.Synchronization.ManagedEntity
Microsoft.SystemCenter.DataWarehouse.Synchronization.DomainSnapshot 
There are others, but these are the main ones.  However it is the content of the message that is interesting.  E.g.
Log Name:      Operations Manager
Source:        Health Service Modules
Date:          22/01/2014 13:14:50
Event ID:      31551
Task Category: Data Warehouse
Level:         Error
Keywords:      Classic
User:          N/A
Computer:      <SERVER>
Description:
Failed to store data in the Data Warehouse. The operation will be retried.
Exception 'SqlException': Sql execution failed. Error 6602, Level 16, State 2, Procedure sp_xml_preparedocument, Line 1, Message: The error description is 'End tag 'ResolutionStateId' does not match the start tag 'nStateId'.'.
The XML parse error 0xc00ce56d occurred on line number 1, near the XML text "<Root><Item><DomainName>ResolutionState</DomainName><DomainContentXml><Root><ResolutionState><ResolutionStateId>254</ResolutionStateId><ResolutionStateGuid>497186A1-5606-4B0C-91C1-30BA37232A82</ResolutionStateGuid><ResolutionStateName>Resolved</ResolutionStateName><PredefinedInd>1</PredefinedInd><CreatedDateTime>2013-10-09T16:43:58.353</CreatedDateTime><LastModifiedDateTime>2013-10-09T16:43:58.353</LastModifiedDateTime></ResolutionState><ResolutionState><ResolutionStateId>247</ResolutionStateId><ResolutionStateGuid>F791ED45-DCB4-475F-8A36-539A9CA8E495</ResolutionStateGuid><ResolutionStateName>Awaiting
Evidence</ResolutionStateName><PredefinedInd>1</PredefinedInd><CreatedDateTime>2013-10-09T16:43:58.353</CreatedDateTime><LastModifiedDateTime>2013-10-09T16:43:58.353</LastModifiedDateTime></ResolutionState><ResolutionState><nStateId>254</ResolutionStateId><ResolutionStateGuid>497186A1-5606-4B0C-91C1-30BA37232A82</ResolutionStateGuid><ResolutionStateName>Resolved</ResolutionStateName><PredefinedInd>1</PredefinedI". 
One or more workflows were affected by this.  
Workflow name: Microsoft.SystemCenter.DataWarehouse.Synchronization.DomainSnapshot 
Instance name: eb249cfa-4f62-4bd9-a181-a6641d78ebd9 
Instance ID: {1600518F-0CD5-5385-5C79-AABC665ED81B} 
Management group: <MG>
Log Name:      Operations Manager
Source:        Health Service Modules
Date:          22/01/2014 13:14:43
Event ID:      31551
Task Category: Data Warehouse
Level:         Error
Keywords:      Classic
User:          N/A
Computer:      <SERVER>
Description:
Failed to store data in the Data Warehouse. The operation will be retried.
Exception 'SqlException': XML parsing: line 1, character 108, illegal xml character 
One or more workflows were affected by this.  
Workflow name: Microsoft.SystemCenter.DataWarehouse.CollectEventData 
Instance name: <SERVER>
Instance ID: {4629E455-0F9F-6EF9-4761-6D8BC5F0DCCA} 
Management group: <MG>
Log Name:      Operations Manager
Source:        Health Service Modules
Date:          22/01/2014 13:14:23
Event ID:      31551
Task Category: Data Warehouse
Level:         Error
Keywords:      Classic
User:          N/A
Computer:     <SERVER>
Description:
Failed to store data in the Data Warehouse. The operation will be retried.
Exception 'SqlException': OLE DB provider 'STREAM' for linked server '(null)' returned invalid data for column '[!BulkInsert].DateTime'. 
One or more workflows were affected by this.  
Workflow name: Microsoft.SystemCenter.DataWarehouse.CollectPerformanceData 
Instance name: <SERVER>
Instance ID: {4629E455-0F9F-6EF9-4761-6D8BC5F0DCCA} 
Management group: <MG>
I have looked at the relevent performance stats on the SQL Server hosting the DW Database.  I can confirm that Disk queues are consistently zero, and that idletime never drops below 98%.
It's probably worth noting that the above started happening following the DW database running out of space.  More space was allocate to the disk and the database files were expanded.  However, the above is now occurring.
Anyone have any idea what might be the cause?
Cheers
Shaun

Answer 1

For Event 2115
http://support.microsoft.com/kb/2681388/en-us
For Event 31551
We where advised from Microsoft support to run the following SQL query against the DW database:
 1. Backup the OpsMgDW DB.
2. In SQL Management Studio, issue the command below for the OpsMgr DW DB:
  DBCC CHECKIDENT ("EventChannel", RESEED, 3);
    Please save the output of above.
3. After above query completes, please issue command below to confirm the
change:
  DBCC CHECKIDENT ("EventChannel");
 After we did that and restarted the HealtService on the RMS and MS the event 31551/31552 where resolved and as a bonus the event
26319 also seems to be resolved. And just for the record the UAC is still active.
you can check below link,
http://social.technet.microsoft.com/Forums/systemcenter/en-US/fd84641c-ecdd-4892-8fb2-77ed7c85ace7/rms-wont-accept-new-consol-connections?forum=operationsmanagergeneral
Please remember, if you see a post that helped you please click "Vote As Helpful" and if it answered your question, please click "Mark As Answer"