Recovery from imported tape media fails and causes DPM management console to crash with ID: 917

Question

Hi.
I have a newly installed DPM 2012 R2 on a Windows 2012 R2 with a standalone dedicated SQL server which is causing me a bit of a headache right now.
I'm about to restore some files from an imported tape media, the tape is from our previous DPM server (DPM 2010). I have identified the media and cataloged it and i'm able to browse it to choose wich files to restore. But as soon as i try to
finish up a restore job it causes the console to crash.
My server is running just fine with backups and restores from i.e tapes that is backed up by this server - no problem there - but imported is not working.
Below is the message from console when it crashes.
Connection to the DPM service has been lost.
Review the application event log for information about a possible service shutdown. Verify that the following services are not disabled:
            DPM
            DPM Replication Agent
            SQLAgent$MSSQLSERVER
            MSSQL$MSSQLSERVER
            Virtual Disk Service
            Volume Shadow Copy
ID: 917
Any ideas?
//Dan

Answer 1

Hello,
I am having the exact same problem when trying to restore from tape on our secondary DPM server.  I checked the event viewer and found event ID 943 (even though the console crash shows ID 917).  The event viewer error is below:
Log Name:      Application
Source:        MSDPM
Date:          4/2/2015 9:02:55 AM
Event ID:      943
Task Category: None
Level:         Error
Keywords:      Classic
User:          N/A
Computer:      DPM_SERVER_NAME
Description:
The description for Event ID 943 from source MSDPM cannot be found. Either the component that raises this event is not installed on your local computer or the installation is corrupted. You can install or repair the component on the local computer.
If the event originated on another computer, the display information had to be saved with the event.
The following information was included with the event:
Unable to connect to the DPM database because the database is in an inconsistent state.
Problem Details:
<FatalServiceError><__System><ID>19</ID><Seq>98909</Seq><TimeCreated>4/2/2015 2:02:55 PM</TimeCreated><Source>DpmThreadPool.cs</Source><Line>163</Line><HasError>True</HasError></__System><ExceptionType>DBCorruptionException</ExceptionType><ExceptionMessage>DLS
error:  SP='dbo.prc_ARM_DataSource_GetServerName' Error=50001</ExceptionMessage><ExceptionDetails>Microsoft.Internal.EnterpriseStorage.Dls.DB.DBCorruptionException: DLS error:  SP='dbo.prc_ARM_DataSource_GetServerName' Error=50001
   at Microsoft.Internal.EnterpriseStorage.Dls.DB.SqlRetryCommand.ValidateReturnValue(String errorTitle)
   at Microsoft.Internal.EnterpriseStorage.Dls.PRMCatalog.DatasourceHelper.GetDatasourceServerName(SqlContext sqlCtx, Guid datasourceId)
   at Microsoft.Internal.EnterpriseStorage.Dls.PRMCatalog.PrmCatalog.GetDatasourceServerName(Guid datasourceId)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.Datasource.FillAppSpecificPropertiesForFS(ProtectionConfigType protectionConfig)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.Datasource.SetDestinationConfig(IMCatalogDB imCatalog, DatasetType dataset, RecoveryInformationType recoveryInformation, RecoveryTaskDefinitionType recoveryTaskDefinition)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.Datasource.AddRecoveryTaskDefinitionForDataset(IMCatalogDB imCatalog, JobTranslator jobTranslator, DatasetType dataset, RecoveryInformationType recoveryInformation, Boolean additionalRestore, Boolean
isSerial, Guid parentTaskDefId)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.Datasource.GenerateRecoveryTaskDefinitions(IMCatalogDB imCatalog, JobTranslator jobTranslator, RecoveryInformationType recoveryInformation, Guid parentTaskDefId)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.RecoveryTranslator.GenerateRecoveryTaskDefinitionsRecursively(IMCatalogDB imCatalog, JobTranslator jobTranslator, RecoveryInformationType recoveryInformation, Guid parentTaskDefId)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.RecoveryTranslator.GenerateRecoveryTaskDefinitions(IMCatalogDB imCatalog, RecoveryInformations recoveryInformations)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.RecoveryTranslator.StartRecovery(Guid jobDefinitionId, Guid jobId, RecoveryInformations recoveryInformations, AdhocJobsContext jobContext)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.RecoveryTranslator.StartRecovery(String recoveryXml, Guid jobDefinitionId, Guid jobId, AdhocJobsContext jobContext)
   at Microsoft.Internal.EnterpriseStorage.Dls.Engine.CIntentServices.TriggerRecovery(UInt16* bstrIMCatalogXml, _GUID jobDefinitionId, _GUID jobId, AdhocJobsContext jobContext)
   at Microsoft.Internal.EnterpriseStorage.Dls.Engine.CCoreServices.TriggerRecovery(CCoreServices* , UInt16* bstrRecoveryInformationXml, _GUID jobDefinitionId, _GUID jobId, UInt16* bstrJobContextXml, tagSAFEARRAY** exceptionResult)</ExceptionDetails></FatalServiceError>
the message resource is present but the message is not found in the string/message table
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
  <System>
    <Provider Name="MSDPM" />
    <EventID Qualifiers="0">943</EventID>
    <Level>2</Level>
    <Task>0</Task>
    <Keywords>0x80000000000000</Keywords>
    <TimeCreated SystemTime="2015-04-02T14:02:55.000000000Z" />
    <EventRecordID>17544</EventRecordID>
    <Channel>Application</Channel>
    <Computer>DPM_SERVER_NAME</Computer>
    <Security />
  </System>
  <EventData>
    <Data>Unable to connect to the DPM database because the database is in an inconsistent state.
Problem Details:
&lt;FatalServiceError&gt;&lt;__System&gt;&lt;ID&gt;19&lt;/ID&gt;&lt;Seq&gt;98909&lt;/Seq&gt;&lt;TimeCreated&gt;4/2/2015 2:02:55 PM&lt;/TimeCreated&gt;&lt;Source&gt;DpmThreadPool.cs&lt;/Source&gt;&lt;Line&gt;163&lt;/Line&gt;&lt;HasError&gt;True&lt;/HasError&gt;&lt;/__System&gt;&lt;ExceptionType&gt;DBCorruptionException&lt;/ExceptionType&gt;&lt;ExceptionMessage&gt;DLS
error:  SP='dbo.prc_ARM_DataSource_GetServerName' Error=50001&lt;/ExceptionMessage&gt;&lt;ExceptionDetails&gt;Microsoft.Internal.EnterpriseStorage.Dls.DB.DBCorruptionException: DLS error:  SP='dbo.prc_ARM_DataSource_GetServerName'
Error=50001
   at Microsoft.Internal.EnterpriseStorage.Dls.DB.SqlRetryCommand.ValidateReturnValue(String errorTitle)
   at Microsoft.Internal.EnterpriseStorage.Dls.PRMCatalog.DatasourceHelper.GetDatasourceServerName(SqlContext sqlCtx, Guid datasourceId)
   at Microsoft.Internal.EnterpriseStorage.Dls.PRMCatalog.PrmCatalog.GetDatasourceServerName(Guid datasourceId)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.Datasource.FillAppSpecificPropertiesForFS(ProtectionConfigType protectionConfig)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.Datasource.SetDestinationConfig(IMCatalogDB imCatalog, DatasetType dataset, RecoveryInformationType recoveryInformation, RecoveryTaskDefinitionType recoveryTaskDefinition)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.Datasource.AddRecoveryTaskDefinitionForDataset(IMCatalogDB imCatalog, JobTranslator jobTranslator, DatasetType dataset, RecoveryInformationType recoveryInformation, Boolean additionalRestore, Boolean
isSerial, Guid parentTaskDefId)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.Datasource.GenerateRecoveryTaskDefinitions(IMCatalogDB imCatalog, JobTranslator jobTranslator, RecoveryInformationType recoveryInformation, Guid parentTaskDefId)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.RecoveryTranslator.GenerateRecoveryTaskDefinitionsRecursively(IMCatalogDB imCatalog, JobTranslator jobTranslator, RecoveryInformationType recoveryInformation, Guid parentTaskDefId)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.RecoveryTranslator.GenerateRecoveryTaskDefinitions(IMCatalogDB imCatalog, RecoveryInformations recoveryInformations)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.RecoveryTranslator.StartRecovery(Guid jobDefinitionId, Guid jobId, RecoveryInformations recoveryInformations, AdhocJobsContext jobContext)
   at Microsoft.Internal.EnterpriseStorage.Dls.Intent.RecoveryTranslator.StartRecovery(String recoveryXml, Guid jobDefinitionId, Guid jobId, AdhocJobsContext jobContext)
   at Microsoft.Internal.EnterpriseStorage.Dls.Engine.CIntentServices.TriggerRecovery(UInt16* bstrIMCatalogXml, _GUID jobDefinitionId, _GUID jobId, AdhocJobsContext jobContext)
   at Microsoft.Internal.EnterpriseStorage.Dls.Engine.CCoreServices.TriggerRecovery(CCoreServices* , UInt16* bstrRecoveryInformationXml, _GUID jobDefinitionId, _GUID jobId, UInt16* bstrJobContextXml, tagSAFEARRAY** exceptionResult)&lt;/ExceptionDetails&gt;&lt;/FatalServiceError&gt;
</Data>
    </EventData>
</Event>
I'm guessing if you checked your event viewer, you would have the same error after the crash.  I'm hoping Microsoft has a fix for this besides restoring the database...