Event ID 4133 & 4376 MSExchangeRepl
Hi
I have an Exchange 2013 DAG with 2 Servers and created a database "DB01" with an active copy - no issues
After creating a further 9 Databases, the Application Log is full of Errors, repeating every 15 minutes:
4133 Database one datacenter health check failed.
4376 Database one datacenter available copy health check failed.
When I run Get-MailboxDatabaseCopyStatus, all Databases are Mounted and Healthy
When I run Get-MailboxDatabaseCopyStatus | fl the only differences between DB01 and the other Databases are:
DB01
ActionInitiator : Unknown
LatestFullBackupTime : 31/01/2014 23:17:05
SnapshotBackup : True
SnapshotLatestFullBackup : True
DB09
ActionInitiator : Service
LatestFullBackupTime :
SnapshotBackup :
SnapshotLatestFullBackup :
All Databases have been successfully backed up (Full and Incremental)
Why I am seeing errors for the additional Databases?
Thanks
shapi
Hi shapi,
According to your description, all databases seems to be working smoothly though the issue occurs when Health Monitoring checks. It's look like a cosmetic issue.
Please try to set the DatacenterActivationMode parameter to off by using
Set-DatabaseAvailabilityGroup
cmdlet to turn
DAC mode off and check whether the issue persists. Here is a similar thread about this issue:
http://social.technet.microsoft.com/Forums/exchange/en-US/53a90540-dcc3-4bff-8f27-772405c02b63/event4133-database-one-datacenter-health-check-failed-and-event4376-database-one-datacenter
Thanks,
Winnie Liang
TechNet Community Support
Similar Messages
-
We have two servers (Exchange 2010 on Server 2008 R2) for a client in a DAG in two separate locations. There was an issue on the passive mailbox database, which I thought had been resolved by reseeding the database.
Now, the passive server is showing the above event every 3 to 5 minutes. I have disabled (removed) McAfee from the server as suggested here:
http://social.technet.microsoft.com/Forums/exchange/en-US/3d969753-cf17-4240-909b-ce34c7e8ffac/event-id-2136-source-msexchangerepl?forum=exchangesvravailabilityandisasterrecoverylegacy
but the issue remains.
There are no corresponding errors on the active server. All backups take place on the Active server.
Could anyone help please?Hi,
Based on the description, you did backup for the active copy, however passive database copies were included and it returned this event error. Please only select active mailbox database copies in the backup job to check the result.
We know that the built-in support for Windows Server Backup is for active copies only. We can back up a passive mailbox database copy using Microsoft System Center Data Protection Manager or a third-party Exchange-aware VSS-based application.
If the issue persists, from the event error, the source of this EventID is MSExchangeRepl, it usually occurs if there is a problem with the DAG replication. I recommend you use the Get-MailboxDatabaseCopyStatus and Test-ReplicationHealth cmdlets to check
status information about your databases and all aspects of the replication and replay status.
Besides that, please increase the Diagnostic Logging level for MSExchangeRepl to Expert, and run Backup. If still fails, then check the Application log.
Best regards,
Belinda
Belinda Ma
TechNet Community Support -
What event should I use to remotely monitor a 2010 DAG failover occurence
I have a 2 Exchange 2010 servers installed on Server 2008 r2. Both have all roles, one is used as the primary server and the second is a passive back up. My question is about how to monitor when a database fails over to my passive server. It seems like there
should be an event logged, probably on the server that is taking the active copy since in theory the other one is non responsive for one reason or another. I've dug through the logs and I've found some events that seem to occur around that time, but nothing
that definitely says that a failover has occurred. Can anybody point me towards a reliable method of monitoring this?
Thank you in advance, JoelA number of event logs can fire when there is a failover, but the most commons ones are:
Alternatively, test in the lab and grab the events as you bounce servers.
Log Name: Application
Source: MSExchangeIS
Date:
Event ID: 9796
Task Category: General
Level: Warning
Keywords: Classic
User: N/A
Computer:
Description:
Database "<Database" has been subject to a lossy failover. The database may be patched if the Information Store detects it is necessary.
and
Log Name: Application
Source: MSExchangeRepl
Date:
Event ID: 2099
Task Category: Service
Level: Information
Keywords: Classic
User: N/A
Computer:
Description:
The Microsoft Exchange Replication Service requested that Hub Transport server ...
and
Event ID: 2153
Source: MSExchangeRepl
The log copier was unable to communicate with server ''. The copy of database ' is in a disconnected state. The communication error was: An error occurred while communicating with server ''. Error: Unable to read data from the transport connection: An established
connection was aborted by the software in your host machine. The copier will automatically retry after a short delay.
Event ID: 4082
Source: MSExchangeRepl
The replication network manager encountered an error while monitoring events. Error: Microsoft.Exchange.Cluster.Replay.AmClusterApiException: An Active Manager operation failed. Error: An error occurred while attempting a cluster operation. Error: Cluster API
'"OpenCluster() failed with 0x6d9. Error: There are no more endpoints available from the
Twitter!: -
We haven't reboot each node yet, so we are thinking that might correct this warning, it appears that the passive copies are working correctly.
The event ID 2137 is the following:
Log Name: Application
Source: MSExchangeRepl
Date: 4/19/2011 9:01:31 PM
Event ID: 2137
Task Category: Service
Level: Warning
Keywords: Classic
User: N/A
Computer: XXXXXXXXXXX
Description:
RPC request to the Microsoft Exchange Information Store service for log truncation failed for database XXXXXX\XXXXXXX. Error: 4294965485.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="32772">2137</EventID>
<Level>3</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2011-04-20T01:01:31.000000000Z" />
<EventRecordID>240357</EventRecordID>
<Channel>Application</Channel>
<Computer>XXXX.XXX.XXX</Computer>
<Security />
</System>
<EventData>
<Data>XXXXX\XXXXXX</Data>
<Data>4294965485</Data>
</EventData>
</Event>FWIW, we had the same exact issue and running a full backup resolved it. To clarify the exact steps a bit, disabling circular logging was the only activity performed. We did
not have to dismount any databases, activate passive copies, restart IS, reseed, modify the registry or anything of the sort. Following this, we ran a full backup using a 3rd party solution with an Exchange agent (Backup Exec), not Windows
Server Backup, so I can't vouch whether or not there's a difference there. The backup job was configured to auto-select the best copy available, which ended up targetting a passive copy, so there doesn't seem to be a dependency on backing up specifically from
an active vs a passive copy. After the full backup completed, the warnings never re-emerged. -
Exchange 2013 CU3 Databases only activate on one mailbox server
Hi, guys
I have two Exchange 2013 CU3 Mailbox servers installed, one DAG, 5 databases, each has one copy. I found that if I activated three databases on Mailboxserver1 or Mailboxserver2, then after a few hours, all databases will be activated on the mailbox
server which has three databases activated. All the databases can be activated on Mailboxserver1 or Mailboxserver2, and they work well. I disabled DAC mode for preventing Event 4133 and 4376. And it has the same problem if I enable DAC mode.
From the event log, I found the log when activate one database on another mailbox server, it is Event 3169:
Managed availability system failover initiated by Responder=OutlookMapiHttpDeepTestFailover Component=Outlook.
This caused the database activated on another server.
And I got the message from SCOM, like this:
Alert: Health Set unhealthy
Source: test-mbx - Outlook.Protocol
Path: test-mbx.contoso.local;test-mbx.contoso.local
Last modified by: System
Last modified time: 11/12/2013 5:15:46 AM Alert description: EMSMDB.DoRpc(Logon) step of OutlookRpcDeepTestProbe/DB-01 has failed against test-mbx.contoso.local proxying to test-mbx.contoso.local for [email protected].
Latency: 00:00:00.0320000
ActivityContext:
Outline: [30] EMSMDB.Connect(); [1][FAILED!] EMSMDB.DoRpc(Logon); Likely root cause: Momt
Details:
Error: Error returned in LogonCallResult. Error code = WrongServer (0x00000478)
Log: Mailbox logon verification
EMSMDB.Connect()
Task produced output:
- TaskStarted = 11/12/2013
5:15:25 AM
- TaskFinished = 11/12/2013
5:15:25 AM
- ErrorDetails =
- RespondingRpcClientAccessServerVersion
= 15.0.712.4012
Latency = 00:00:00.0303884
- ActivityContext =
EMSMDB.Connect() completed successfully.
EMSMDB.DoRpc(Logon)
Task produced output:
- TaskStarted = 11/12/2013
5:15:25 AM
- TaskFinished = 11/12/2013
5:15:25 AM
- Exception = Microsoft.Exchange.RpcClientAccess.RopExecutionException:
Error returned in LogonCallResult. Error code = WrongServer (0x00000478)
- ErrorDetails =
- Latency = 00:00:00.0018801
- ActivityContext =
EMSMDB.DoRpc(Logon) failed.
Task produced output:
- TaskStarted = 11/12/2013 5:15:25 AM
- TaskFinished = 11/12/2013 5:15:25 AM
- Exception = Microsoft.Exchange.RpcClientAccess.RopExecutionException:
Error
States of all monitors within the health set:
Note: Data may be stale. To get current data, run: Get-ServerHealth -Identity 'test-mbx' -HealthSet 'Outlook.Protocol'
State Name
TargetResource HealthSet
AlertValue ServerComponent
NotApplicable OutlookMapiHttpDeepTestMonitor
Outlook.Protocol Unhealthy None
NotApplicable OutlookRpcDeepTestMonitor
Outlook.Protocol Healthy None
NotApplicable OutlookRpcSelfTestMonitor
Outlook.Protocol Healthy None
NotApplicable OutlookMapiHttpSelfTestMonitor Outlook.Protocol
Healthy None
NotApplicable PrivateWorkingSetWarning....cclienta... microsoft.exchange.rpcclientacc... Outlook.Protocol Healthy
None
NotApplicable PrivateWorkingSetError....rpcclienta... microsoft.exchange.rpcclientacc... Outlook.Protocol Healthy
None
NotApplicable ProcessProcessorTimeWarning....ienta... microsoft.exchange.rpcclientacc... Outlook.Protocol Healthy
None
NotApplicable ProcessProcessorTimeError....clienta... microsoft.exchange.rpcclientacc... Outlook.Protocol Healthy
None
NotApplicable ExchangeCrashEventError....pcclienta... microsoft.exchange.rpcclientacc... Outlook.Protocol Healthy
None
NotApplicable LongRunningWatsonWarning....cclienta... microsoft.exchange.rpcclientacc... Outlook.Protocol Healthy
None
NotApplicable LongRunningWerMgrWarning....cclienta... microsoft.exchange.rpcclientacc... Outlook.Protocol Healthy
None
This test is a cause that mailbox databases in DAG is doing failover to another server
Log Name: Application
Source: MSExchangeRepl
Date: 12.11.2013 4:49:46
Event ID: 3169
Task Category: Service
Level: Information
Keywords: Classic
User: N/A
Computer: test-mbx-2
Description:
(Active Manager) Database DB-01 was successfully moved from test-mbx.contoso.local to test-mbx-1.contoso.local. Move comment: Managed availability system failover initiated by Responder=OutlookRpcDeepTestFailover Component=Outlook.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="16388">3169</EventID>
<Level>4</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2013-11-12T00:49:46.000000000Z" />
<EventRecordID>1606248</EventRecordID>
<Channel>Application</Channel>
<Computer>test-mbx-2.contoso.local</Computer>
<Security />
</System>
<EventData>
<Data>DB-01</Data>
<Data>test-mbx.contoso.local</Data>
<Data>test-mbx-1.contoso.local</Data>
<Data>Managed availability system failover initiated by Responder=OutlookRpcDeepTestFailover Component=Outlook.</Data>
</EventData>
</Event>
I don't know why, anyone know what's the problem?
Thank you.
Nile Jiang- Please mark the post as answer if it answers your question.
http://www.usefulshare.comHi,
After deleting all the health mailboxes and restart
the Exchange Health Manager service, the health mailboxes are recreated successfullly, but when I check the outlook.protocol health, the OutlookRpcDeepTestMonitor or the OutlookMapiHttpDeepTestMonitor is still unhealthy. How can I fix it?
[PS] C:\Windows\system32> Get-ServerHealth -Identity 'MAILBOX1' -HealthSet 'Outlook.Protocol' | ft server,state,name,ale
rtvalue -AutoSize
Server state Name AlertValue
MAILBOX1 OutlookRpcDeepTestMonitor Healthy
MAILBOX1 OutlookMapiHttpDeepTestMonitor Unhealthy
MAILBOX1 OutlookRpcSelfTestMonitor Healthy
MAILBOX1 OutlookMapiHttpSelfTestMonitor Healthy
MAILBOX1 PrivateWorkingSetWarning....cclientaccess.service Healthy
MAILBOX1 PrivateWorkingSetError....rpcclientaccess.service Healthy
MAILBOX1 ProcessProcessorTimeWarning....ientaccess.service Healthy
MAILBOX1 ProcessProcessorTimeError....clientaccess.service Healthy
MAILBOX1 ExchangeCrashEventError....pcclientaccess.service Healthy
MAILBOX1 LongRunningWatsonWarning....cclientaccess.service Healthy
MAILBOX1 LongRunningWerMgrWarning....cclientaccess.service Healthy
Nile Jiang- Please mark the post as answer if it answers your question.
http://www.usefulshare.com -
Problems with Public Folders in Exchange 2010
Last month I upgraded my servers from 2000 to 2010. The route I took for exchange was 2000 -> 2003 -> 2010. Everything went fairly smooth and I have had no real problems until this week. (I have uninstalled the older exchange servers.) I have been
trying to clean out some of the remnants that have been left over from the older servers (for whatever reason the uninstall did not remove the information on the new server). I used ASDI edit to remove some old information that was pointing to the old exchange
server (First Administration Group I think it was called).
After that I upgraded to SP1 and Rollup 1. The Public folder database no longer appears under Organization Configuration, Mailbox. I am not sure if it was there after my deletion or not, so I am unsure if the problem is caused by my deletions or the upgrade.
I followed the instructions found here, http://technet.microsoft.com/en-us/library/bb727370%28EXCHG.80,printer%29.aspx . The CN=Public folders was found in CN=Folder Hierarchies. However
msExchOwningPFTree is greyed out, so I cannot update it. I have tried to delete it and remake it, same thing.
I also get the following events which I am assuming is caused by the Public Folders database not being mounted:
Log Name: Application
Source: MSExchangeRepl
Date: 10/28/2010 11:03:51 AM
Event ID: 3154
Task Category: Service
Level: Error
Keywords: Classic
User: N/A
Computer: sachdc00001.sunshineacres.local
Description:
Active Manager failed to mount database Public Folder Database 1678798462 on server sachdc00001.sunshineacres.local. Error: An Active Manager operation failed with a transient error. Please retry the operation. Error: Database action failed with transient error.
Error: A transient error occurred during a database operation. Error: MapiExceptionADPropertyError: Unable to mount database. (hr=0x80004005, ec=2418)
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="49156">3154</EventID>
<Level>2</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2010-10-28T18:03:51.000000000Z" />
<EventRecordID>42074</EventRecordID>
<Channel>Application</Channel>
<Computer>sachdc00001.sunshineacres.local</Computer>
<Security />
</System>
<EventData>
<Data>Public Folder Database 1678798462</Data>
<Data>sachdc00001.sunshineacres.local</Data>
<Data>An Active Manager operation failed with a transient error. Please retry the operation. Error: Database action failed with transient error. Error: A transient error occurred during a database operation. Error: MapiExceptionADPropertyError:
Unable to mount database. (hr=0x80004005, ec=2418)
</Data>
</EventData>
</Event>
Log Name: Application
Source: ExchangeStoreDB
Date: 10/28/2010 11:03:51 AM
Event ID: 231
Task Category: Database recovery
Level: Error
Keywords: Classic
User: N/A
Computer: sachdc00001.sunshineacres.local
Description:
At '10/28/2010 11:03:51 AM', the copy of database 'Public Folder Database 1678798462' on this server encountered an error during the mount operation. For more information, consult the Event log on the server for "ExchangeStoreDb" or "MSExchangeRepl"
events. The mount operation will be tried again automatically.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="ExchangeStoreDB" />
<EventID Qualifiers="49156">231</EventID>
<Level>2</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2010-10-28T18:03:51.000000000Z" />
<EventRecordID>42073</EventRecordID>
<Channel>Application</Channel>
<Computer>sachdc00001.sunshineacres.local</Computer>
<Security />
</System>
<EventData>
<Data>Public Folder Database 1678798462</Data>
<Data>0855badd-62f3-421f-9175-86cf26891c8a</Data>
<Data>Store</Data>
<Data>GenericMountFailure</Data>
<Data>
</Data>
<Data>Store</Data>
<Data>There is only one copy of this mailbox database (Public Folder Database 1678798462). Automatic recovery is not available.</Data>
<Data>10/28/2010 11:03:51 AM</Data>
</EventData>
</Event>
Log Name: Application
Source: MSExchangeIS
Date: 10/28/2010 11:03:51 AM
Event ID: 9519
Task Category: General
Level: Error
Keywords: Classic
User: N/A
Computer: sachdc00001.sunshineacres.local
Description:
While starting database 0855badd-62f3-421f-9175-86cf26891c8a, the following error occurred: 0x972.
Look up of DB Info failed.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeIS" />
<EventID Qualifiers="49158">9519</EventID>
<Level>2</Level>
<Task>6</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2010-10-28T18:03:51.000000000Z" />
<EventRecordID>42072</EventRecordID>
<Channel>Application</Channel>
<Computer>sachdc00001.sunshineacres.local</Computer>
<Security />
</System>
<EventData>
<Data>0x972</Data>
<Data>0855badd-62f3-421f-9175-86cf26891c8a</Data>
<Data>Look up of DB Info failed</Data>
<Binary>5B444941475F4354585D00002E000000FF8C170000000000000220000000496340107209000068284010720900003DE900104000060E3DD1401072090000</Binary>
</EventData>
</Event>
Also, the CN=InformationSore is empty. Is this normal?
Now I am assuming I deleted something that I shouldn't have.Tried that, I get the following when I go to the Public Folder Management Console:
Cannot complete the operation because there isn't an available public folder database on server
And even if I did that how does that help me retrieve my missing information? -
Failed attempt to move log and database paths
Hi. Can anyone offer any advice on what might have caused an attempt to move Exchange 2010 (SP3) mailbox database and log folder paths to fail? I can't diagnose it, and would appreciate any advice.
We have two databases in a two-node DAG, one mounted on each node. I removed the passive copy of each database before the move attempts. The first moved ok. The second failed. Here's a summary of what happened:
Task 1:
DAG-NODE-A ----------------------------DAG-NODE-B
MAILBOX-DB-01 MAILBOX-DB-01
MOUNTED HEALTHY (passive)
- Dismount database
- Remove passive copy.
- Move logfolder path from R: to L:
and move EDB path from S: to M:
- Succeeded.
- Mount datbase.
- Re-add passive copy
All ok.
Task 2:
DAG-NODE-A ----------------------------DAG-NODE-B
MAILBOX-DB-02 MAILBOX-DB-02
HEALTHY (passive) MOUNTED
- Dismount database
- Remove passive copy.
- Move logfolder path from R: to L:
and move EDB path from S: to M:
- Failed. Paths not moved.
- Database now won't mount.
- Database eventually mounts
after approx. 30 auto retries.
- Abandon attempt to move paths.
- Re-add passive copy.
END
Here's some more detail, included event log and shell output:
So, as per the above, with Mailbox-DB-01 (active copy on DAG-NODE-A), Exchange moved the paths without a hitch and I was then able to mount the database and re-add the passive copy. I then tried to move the paths for Mailbox-DB-02 (active copy on DAG-NODE-B),
but after a few minutes Exchange aborted the move, outputting errors to the Shell, the application log and the MSExchange Management log. A second attempt failed because Exchange found that "The .edb file path is not available. There is already a file
named M:\Mailbox-DB-02\Mailbox-DB-02.edb" - Exchange had created an EDB file in the target location, but the source EDB file was still in the source location and the path was unchanged. Rather than re-trying the move again, I decided to try to mount the
database, to check it was ok, but it wouldn’t mount.
I left it alone for an hour or so to have a think about what to do, came back to it and found Exchange had mounted the database (without moving the paths) after around 30 automatic retries. I was then able to re-add the passive copy.
I’m not keen to re-try the move without knowing why it failed, why the database then wouldn’t mount, and why it subsequently recovered. Any advice would be appreciated. Many thanks.
Output included
- a WinRM error in the Shell’;
- an App Log error event from my attempt to mount the database after the move failure, saying an attempt to open the EDB file for read / write access failed with system error 32 because the file was being used by another process;
- events recording failure to configure and start the database, and noting a serious error which caused it to terminate its functional activity;
- Event ID 3154 from MSExchangeRepl, saying an Active Manager operation failed / database action failed / MapiExceptionCallFailed;
- Event ID 10056 from source MSExchangeIS Mailbox Store in the App Log just before Exchange successfully mounted the troublesome database, saying “Patch all ID counters for database Mailbox-DB-02.”
One other thing which may or may not be relevant – the MSExchange Service Host service stops soon after being started on DAG-NODE-B (reboots have made no difference). On DAG-NODE-A, it runs consistently.
Here’s what seems to me to be the most relevant output from the Application Log and the MSExchange Management Log on DAG-NODE-B, and from the Exchange Shell:
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 10:46:19 ESE 327 General "Information Store (3720) Mailbox-DB-02: The database engine detached a database (4, S:\Mailbox-DB-02\Database\Mailbox-DB-02.edb). (Time=6 seconds)
Internal Timing Sequence: [1] 0.000, [2] 0.000, [3] 0.000, [4] 0.000, [5] 0.000, [6] 6.188, [7] 0.156, [8] 0.016, [9] 0.015, [10] 0.016, [11] 0.031.
Revived Cache: 0"
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 10:46:19 ESE 103 General "Information Store (3720) Mailbox-DB-02: The database engine stopped the instance (4).
Dirty Shutdown: 0
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 10:46:19 MSExchangeIS Mailbox Store 9539 General The Microsoft Exchange Information Store database "Mailbox-DB-02" was stopped.
==================================================================================
DAG-NODE-B, MSExchange Management log
Information DD/MM/14 10:46:19 MSExchange CmdletLogs 1 General Cmdlet succeeded. Cmdlet Dismount-Database, parameters {Identity=Mailbox-DB-02}.
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 10:46:19 MSExchangeRepl 3161 Service Active Manager dismounted database Mailbox-DB-02 on server DAG-NODE-B.company.corp.
==================================================================================
DAG-NODE-B, MSExchange Management log
Error DD/MM/14 10:46:20 MSExchange CmdletLogs 6 General Cmdlet failed. Cmdlet Get-PublicFolderDatabase, parameters {Status=True, Identity=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx}.
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 10:46:21 MSExchange Assistants 9002 Assistants Service MSExchangeMailboxAssistants. Stopped processing database Mailbox-DB-02 (xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx).
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 10:46:21 MSExchange Assistants 9002 Assistants Service MSExchangeMailSubmission. Stopped processing database Mailbox-DB-02 (xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx).
==================================================================================
DAG-NODE-B, Application Log:
Error DD/MM/2014 10:51:08 MSExchange Search Indexer 104 General Exchange Search Indexer failed to enable the Mailbox Database Mailbox-DB-02 (GUID = xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx) after 10 tries. The last failure was: MapiExceptionMdbOffline: Unable to
get CI watermark (hr=0x80004005, ec=1142)
==================================================================================
DAG-NODE-B, MSExchange Management log
Warning DD/MM/14 11:06:44 MSExchange CmdletLogs 4 General Cmdlet stopped. Cmdlet Move-DatabasePath, parameters {Identity=Mailbox-DB-02, EdbFilePath=M:\Mailbox-DB-02\Mailbox-DB-02.edb, LogFolderPath=L:\Mailbox-DB-02\Logs}.
==================================================================================
DAG-NODE-B, Exchange Management Shell output
Processing data from remote server failed with the following error message: The WinRM client cannot complete the operation within the time specified. Check if the machine name is valid and is reachable over the network and firewall exception for Windows Remote
Management service is enabled. For more information, see the about_Remote_Troubleshooting Help topic.
+ CategoryInfo : OperationStopped: (System.Manageme...pressionSyncJob:PSInvokeExpressionSyncJob) [], PSRemotingTransportException
+ FullyQualifiedErrorId : JobFailure
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 11:23:42 MSExchangeIS Mailbox Store 1000 General Attempting to start the Information Store "Mailbox-DB-02".
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 11:23:43 ESE 102 General "Information Store (3720) Mailbox-DB-02: The database engine (14.03.0162.0000) is starting a new instance (4).
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 11:23:43 ESE 105 General "Information Store (3720) Mailbox-DB-02: The database engine started a new instance (4). (Time=0 seconds)
==================================================================================
DAG-NODE-B, Application Log:
Error DD/MM/2014 11:23:53 ESE 490 General "Information Store (3720) Mailbox-DB-02: An attempt to open the file ""S:\Mailbox-DB-02\Database\Mailbox-DB-02.edb"" for read / write access failed with system error 32 (0x00000020): ""The
process cannot access the file because it is being used by another process. "". The open file operation will fail with error -1032 (0xfffffbf8).
==================================================================================
DAG-NODE-B, Application Log:
Error DD/MM/2014 11:23:53 MSExchangeIS 9519 General "The following error occurred while starting database Mailbox-DB-02: 0xfffffbf8.
Failed to configure MDB. "
==================================================================================
DAG-NODE-B, Application Log:
Error DD/MM/2014 11:23:53 MSExchangeIS 9519 General "The following error occurred while starting database Mailbox-DB-02: 0xfffffbf8.
Start DB failed.. "
==================================================================================
DAG-NODE-B, Application Log:
Error DD/MM/2014 11:23:53 ExchangeStoreDB 215 Database recovery At 'DD/MM/2014 11:23:53' the Microsoft Exchange Information Store Database 'Mailbox-DB-02' copy on this server experienced a serious error which caused it to terminate its functional activity.
The error returned by the remount attempt was "There is only one copy of this mailbox database (Mailbox-DB-02). Automatic recovery is not available.". Consult the event log on the server for other storage and "ExchangeStoreDb" events for
more specific information about the failures.
==================================================================================
DAG-NODE-B, Application Log:
Error DD/MM/2014 11:23:53 ExchangeStoreDB 231 Database recovery At 'DD/MM/2014 11:23:53', the copy of database 'Mailbox-DB-02' on this server encountered an error during the mount operation. For more information, consult the Event log on the server for "ExchangeStoreDb"
or "MSExchangeRepl" events. The mount operation will be tried again automatically.
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 11:23:54 ESE 103 General "Information Store (3720) Mailbox-DB-02: The database engine stopped the instance (4).
Dirty Shutdown: 0
==================================================================================
DAG-NODE-B, Application Log:
Error DD/MM/2014 11:23:54 ExchangeStoreDB 231 Database recovery At 'DD/MM/2014 11:23:54', the copy of database 'Mailbox-DB-02' on this server encountered an error during the mount operation. For more information, consult the Event log on the server for "ExchangeStoreDb"
or "MSExchangeRepl" events. The mount operation will be tried again automatically.
==================================================================================
DAG-NODE-B, Application Log:
Error DD/MM/2014 11:23:54 MSExchangeRepl 3154 Service Active Manager failed to mount database Mailbox-DB-02 on server DAG-NODE-B.company.corp. Error: An Active Manager operation failed. Error The database action failed. Error: Operation failed with message:
MapiExceptionCallFailed: Unable to mount database. (hr=0x80004005, ec=-1032)
==================================================================================
NOTE:repeat events similar to some of the above continue until Exchange eventually manages to mount the database:
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:15:56 MSExchangeIS Mailbox Store 1000 General Attempting to start the Information Store "Mailbox-DB-02".
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:15:56 ESE 102 General "Information Store (3720) Mailbox-DB-02: The database engine (14.03.0162.0000) is starting a new instance (4).
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:15:56 ESE 105 General "Information Store (3720) Mailbox-DB-02: The database engine started a new instance (4). (Time=0 seconds)
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:15:57 ESE 326 General "Information Store (3720) Mailbox-DB-02: The database engine attached a database (5, S:\Mailbox-DB-02\Database\Mailbox-DB-02.edb). (Time=0 seconds)
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:15:57 MSExchangeIS Mailbox Store 10056 General Patch all ID counters for database Mailbox-DB-02.
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:15:57 MSExchangeIS Mailbox Store 1133 General Allocating message database resources for database "Mailbox-DB-02".
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:15:58 MSExchangeIS Mailbox Store 9523 General "The Microsoft Exchange Database ""Mailbox-DB-02"" has been started.
Database File: S:\Mailbox-DB-02\Database\Mailbox-DB-02.edb
Transaction Logfiles: R:\Mailbox-DB-02\Logs\
Base Name (logfile prefix): E03
System Path: R:\Mailbox-DB-02\Logs\
(Start Duration=00:00:01.844) "
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:15:58 MSExchangeRepl 3156 Service Active Manager successfully mounted database Mailbox-DB-02 on server DAG-NODE-B.company.corp.
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:16:06 MSExchange Assistants 9001 Assistants Service MSExchangeMailSubmission. Started to process mailbox database Mailbox-DB-02 (xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx).
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:16:09 MSExchange Assistants 9001 Assistants Service MSExchangeMailboxAssistants. Started to process mailbox database Mailbox-DB-02 (xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx).
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:16:12 MSExchange Assistants 9017 Assistants Service MSExchangeMailboxAssistants. Managed Folder Mailbox Assistant for database Mailbox-DB-02 (xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx) is entering a work cycle. There are 125 mailboxes on
this database.
==================================================================================
DAG-NODE-B, Application Log:
Information DD/MM/2014 12:16:30 MSExchange Search Indexer 108 General Exchange Search Indexer has enabled indexing for the Mailbox Database Mailbox-DB-02 (GUID = xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx).
==================================================================================
If you used the steps outlined in this TechNet article - http://technet.microsoft.com/en-us/library/dd979782.aspx - then you should have been OK. I will say that I read one
article that said to work one database at a time, then when you are sure it is operational to go back and do the next, etc.
(I also assume by your shorthand at the beginning of this document that you performed the tasks on the active node when you did this work. If so, that's the best way to do it, so if it failed, it wasn't because you used the wrong steps or did them
on the wrong system.) -
Hi
We have a Windows 2012 server with Exchange 2013, all is working fine except now i am getting issues with the backup.
'Exchange - The application will not be available for recovery from this backup. the consistency check failed for the component Microsoft Exchange Server'
I have checked the database all is fine, i have created a new db and move all mailbox;s over and then removed the old db, i have enabled circular logging and then disabled it, it seems no matter what i do i cannot get a full backup!
i did have to restore the server once and the backups still worked for about 4 days after that and then stopped, i have also tried to remove and re add the backup role!
i am stumped, any advice would be great!Hi
Ok, i created a test db and tried to back it up right away, it failed, i did not add any mailbox's to it either. i got quite a few events in the windows logs, as well as the same event above i got the following:
Log Name: Application
Source: MSExchangeRepl
Date: 21/01/2013 10:16:30
Event ID: 2038
Task Category: Exchange VSS Writer
Level: Warning
Keywords: Classic
User: N/A
Computer: NERDS-DC01.nerds.local
Description:
Microsoft Exchange VSS Writer backup failed. No log files were truncated. Instance 75754d0d-8dfe-4909-8beb-5a4f824254a9. Database 4843b37c-7b3c-42b2-8b57-1393615c2c15.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="32772">2038</EventID>
<Level>3</Level>
<Task>2</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2013-01-21T10:16:30.000000000Z" />
<EventRecordID>261645</EventRecordID>
<Channel>Application</Channel>
<Computer>NERDS-DC01.nerds.local</Computer>
<Security />
</System>
<EventData>
<Data>75754d0d-8dfe-4909-8beb-5a4f824254a9</Data>
<Data>4843b37c-7b3c-42b2-8b57-1393615c2c15</Data>
</EventData>
</Event>
AND
Log Name: Application
Source: MSExchangeRepl
Date: 21/01/2013 10:16:30
Event ID: 2038
Task Category: Exchange VSS Writer
Level: Warning
Keywords: Classic
User: N/A
Computer: NERDS-DC01.nerds.local
Description:
Microsoft Exchange VSS Writer backup failed. No log files were truncated. Instance 75754d0d-8dfe-4909-8beb-5a4f824254a9. Database db5826f3-1029-4219-ad80-441a0e94537a.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="32772">2038</EventID>
<Level>3</Level>
<Task>2</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2013-01-21T10:16:30.000000000Z" />
<EventRecordID>261646</EventRecordID>
<Channel>Application</Channel>
<Computer>NERDS-DC01.nerds.local</Computer>
<Security />
</System>
<EventData>
<Data>75754d0d-8dfe-4909-8beb-5a4f824254a9</Data>
<Data>db5826f3-1029-4219-ad80-441a0e94537a</Data>
</EventData>
</Event>
and
Log Name: Application
Source: MSExchangeRepl
Date: 21/01/2013 10:16:30
Event ID: 2034
Task Category: Exchange VSS Writer
Level: Error
Keywords: Classic
User: N/A
Computer: NERDS-DC01.nerds.local
Description:
The Microsoft Exchange Replication service VSS Writer (Instance 75754d0d-8dfe-4909-8beb-5a4f824254a9) failed with error FFFFFFFC when processing the backup completion event.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="49156">2034</EventID>
<Level>2</Level>
<Task>2</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2013-01-21T10:16:30.000000000Z" />
<EventRecordID>261649</EventRecordID>
<Channel>Application</Channel>
<Computer>NERDS-DC01.nerds.local</Computer>
<Security />
</System>
<EventData>
<Data>75754d0d-8dfe-4909-8beb-5a4f824254a9</Data>
<Data>FFFFFFFC</Data>
</EventData>
</Event>
and
Log Name: Application
Source: SPP
Date: 21/01/2013 10:16:30
Event ID: 16389
Task Category: None
Level: Error
Keywords: Classic
User: N/A
Computer: NERDS-DC01.nerds.local
Description:
Writer Microsoft Exchange Writer experienced retryable error during shadow copy creation. Retrying... More info: .
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="SPP" />
<EventID Qualifiers="0">16389</EventID>
<Level>2</Level>
<Task>0</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2013-01-21T10:16:30.000000000Z" />
<EventRecordID>261650</EventRecordID>
<Channel>Application</Channel>
<Computer>NERDS-DC01.nerds.local</Computer>
<Security />
</System>
<EventData>
<Data>Microsoft Exchange Writer</Data>
<Data>
</Data>
<Data>The writer experienced a transient error. If the backup process is retried, the error may not reoccur. (0x800423F3)</Data>
<Data>
</Data>
<Binary>00000000A5120000981200000000000042BEB7C511CAC619E59C92030000000000000000</Binary>
</EventData>
</Event> -
Exchange server 2010 SP3 CPU consumption keep growing
Hi,
I'm using an Exchange server 2010 SP3 14.3.123.4 version.
We are currently experiencing CPU consumption growth on this server.
It appears that the msexchangerepl process could be a good candidate for this CPU overconsumption.
Any clue for this issue.Hi,
In your posting, the MSExchangeRepl.exe process keeps increasing on the server. The Microsoft Exchange Replication service provides replication functionality for mailbox databases on Mailbox servers in a database availability group. Please check whether
there is any back up program in your Exchange server. Also confirm if there is any Anti-virus program installed in your Exchange server.
In Event Viewer, please check the event log for the MSExchangeRepl source and collect any further information for troubleshooting.
Regards,
Winnie Liang
TechNet Community Support -
SCDPM 2012 R2 Backup with Exchange 2013 SP1 CU6 DAG
Hi,
Correct me if I'm wrong.
DAG setup as follow,
1. Server1\MBX01 (Active)
2. Server2\MBX01 (Passive)
DPM
1. Select Full for Active
2. Select Copy for Passive
We always select active copy so that logs can be purge. On the other hand, if we select backup passive copy and purge logs. My guess is logs will be replicated from Active copy.
How about when active copy change passive copy? Do I need to change the backup option?
Please advice. Thanks.
Kelvin TeangHi,
It sounds like an exchange problem - this was the application event log entry on the passive node after taking an incremental backup from DPM. After the below event was posted, I checked both active and passive node and the logs were successfully truncated.
It took a few minutes before the logs were deleted.
Log Name: Application
Source: MSExchangeRepl
Date: 12/9/2014 3:40:46 PM
Event ID: 2046
Task Category: Exchange VSS Writer
Level: Information
Keywords: Classic
User: N/A
Computer: MJLC-E14-2.mjacquet.com
Description:
The Microsoft Exchange Replication service VSS Writer instance 5cc17efd-1acc-41c3-b68a-f667027032b6 has successfully completed the backup of database 'N1-MB2'.
Database log truncation has been requested for this database. Log truncation will occur on the active copy after the next log generation is created. Log truncation will occur automatically on the passive copies after that log file is copied.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="16388">2046</EventID>
<Level>4</Level>
<Task>2</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2014-12-09T23:40:46.000Z" />
<EventRecordID>399855</EventRecordID>
<Channel>Application</Channel>
<Computer>MJLC-E14-2.mjacquet.com</Computer>
<Security />
</System>
<EventData>
<Data>5cc17efd-1acc-41c3-b68a-f667027032b6</Data>
<Data>N1-MB2</Data>
</EventData>
</Event>
Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread. Regards, Mike J. [MSFT]
This posting is provided "AS IS" with no warranties, and confers no rights. -
Exchange 2010 SP3 rollup4
4 Server DAG all servers running Windows 2008 R2 (VMs on VMware esxi5.1) 4 databases (2 mailbox, 2 online archives)
Last week 2 databases backup stopped truncating the logs, Mailbox 1 and Online Archive 1. (Mailbox 2 and Online Archive 2 seem to be OK and are backing up OK)
On investigation there are a number of errors in the application log:
Log Name:
Application
Source:
MSExchangeRepl
Date:
05/06/2014 21:50:48
Event ID:
2156
Task Category: Service
Level:
Error
Keywords:
Classic
User:
N/A
Computer:
Exchangeserver1
Description:
The log copier for database 'Online Archive 1' could not send a log file to server 'EXCHANGESERVER2' because An I/O error occurred while attempting to access file 'L:\Exchange Logs\Online
Archive 1\E05.log' on source server EXCHANGESERVER1. Error: File not found (-1811)
Event Xml:
<Data>An I/O error occurred while attempting to access file 'L:\Exchange Logs\Online Archive 1\E05.log' on source server EXCHANGESERVER1. Error: File not found (-1811)</Data>
Log Name:
Application
Source:
MSExchange Search Indexer
Date:
05/06/2014 21:50:48
Event ID:
118
Task Category: General
Level:
Warning
Keywords:
Classic
User:
N/A
Computer:
Exchangeserver1
Description:
Exchange Search Indexer has temporarily disabled indexing of the mailbox database Online Archive 1 (GUID = ee385d93-918f-470e-b57b-a87d7e23ed20) due to an error (Microsoft.Mapi.MapiExceptionMdbOffline:
MapiExceptionMdbOffline: Unable to read events. (hr=0x80004005, ec=1142)
Diagnostic context:
Lid: 33865
Lid: 1494 ---- Remote Context Beg ----
Lid: 44215
Lid: 60049 StoreEc: 0x8004010F
Lid: 49469
Lid: 65341 StoreEc: 0x8004010F
Lid: 56125
Lid: 47933 StoreEc: 0x8004010F
Lid: 32829
Lid: 49213 StoreEc: 0x8004010F
Lid: 48573
Lid: 64957 StoreEc: 0x8004010F
Lid: 20057 StoreEc: 0x476
Lid: 1750 ---- Remote Context End ----
Lid: 28777 StoreEc: 0x476
Lid: 20098
Lid: 20585 StoreEc: 0x476
at Microsoft.Mapi.MapiExceptionHelper.ThrowIfError(String message, Int32 hresult, SafeExInterfaceHandle iUnknown, Exception innerException)
at Microsoft.Mapi.MapiEventManager.ReadEvents(Int64 startCounter, Int32 eventCountWanted, Int32 eventCountToCheck, Restriction filter, ReadEventsFlags flags, Boolean includeSid, Int64& endCounter)
at Microsoft.Exchange.Search.RetriableOperations.ReadEvents(ThreadLocalCrawlData unused1, MapiEventManager eventManager, Int64 watermark, Int32 eventCount, Int64& endCounter)
at Microsoft.Exchange.Search.RetriableOperations.DoRetriableMapiOperation[SourceType,ReturnType,Parameter1Type,Parameter2Type,Parameter3Type](ThreadLocalCrawlData crawlData, SourceType source, Parameter1Type parameter1, Parameter2Type parameter2, Parameter3Type&
parameter3, MapiOperationDelegate`5 operationDelegate)
at Microsoft.Exchange.Search.NotificationWatcher.GetMapiEvents(Int32 maxEvents, NotificationQueue notificationQueue, Int64& endCount)
at Microsoft.Exchange.Search.NotificationWatcher.NotificationWatcherThread()), and Operations Manager would never alert it.
Log Name:
Application
Source:
MSExchangeRepl
Date:
05/06/2014 21:50:52
Event ID:
4082
Task Category: Service
Level:
Error
Keywords:
Classic
User:
N/A
Computer:
Exchangeserver1
Description:
The replication network manager encountered an error while monitoring events. Error: Microsoft.Exchange.Cluster.Replay.AmClusterApiException: An Active Manager operation failed. Error
An error occurred while attempting a cluster operation. Error: Cluster API '"OpenCluster(Exchangeserver1) failed with 0x6d9. Error: There are no more endpoints available from the endpoint mapper"' failed.. ---> System.ComponentModel.Win32Exception:
There are no more endpoints available from the endpoint mapper
--- End of inner exception stack trace ---
at Microsoft.Exchange.Cluster.Replay.NetworkManager.DriveMapRefresh()
at Microsoft.Exchange.Cluster.Replay.NetworkManager.TryDriveMapRefresh()
Event Xml:
Log Name:
Application
Source:
ESE
Date:
05/06/2014 21:51:15
Event ID:
489
Task Category: General
Level:
Error
Keywords:
Classic
User:
N/A
Computer:
Exchangeserver1
Description:
msexchangerepl (2448) An attempt to open the file "O:\Mailbox Databases\Online Archive 1\Online Archive 1.edb" for read only access failed with system error 32 (0x00000020):
"The process cannot access the file because it is being used by another process. ".
The open file operation will fail with error -1032 (0xfffffbf8).
For more information, click http://www.microsoft.com/contentredirect.asp.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="ESE" />
<EventID Qualifiers="0">489</EventID>
<Level>2</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2014-06-05T20:51:15.000000000Z" />
<EventRecordID>7392312</EventRecordID>
<Channel>Application</Channel>
<Computer>Exchangeserver1</Computer>
<Security />
</System>
<EventData>
<Data>msexchangerepl</Data>
<Data>2448</Data>
<Data>
</Data>
<Data>O:\Mailbox Databases\Online Archive 1\Online Archive 1.edb</Data>
<Data>-1032 (0xfffffbf8)</Data>
<Data>32 (0x00000020)</Data>
<Data>The process cannot access the file because it is being used by another process. </Data>
</EventData>
</Event>
Log Name:
Application
Source:
MSExchangeRepl
Date:
05/06/2014 21:51:15
Event ID:
4107
Task Category: Service
Level:
Error
Keywords:
Classic
User:
N/A
Computer:
Exchangeserver1
Description:
The Microsoft Exchange Replication service detected that database 'Online Archive 1' may be mounted on two servers. The copy on server 'EXCHANGESERVER1' will now be dismounted. Please
review the event logs for more information.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="49156">4107</EventID>
<Level>2</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2014-06-05T20:51:15.000000000Z" />
<EventRecordID>7392314</EventRecordID>
<Channel>Application</Channel>
<Computer>Exchangeserver1</Computer>
<Security />
</System>
<EventData>
<Data>Online Archive 1</Data>
<Data>EXCHANGESERVER1</Data>
</EventData>
</Event>
Log Name:
Application
Source:
MSExchangeRepl
Date:
05/06/2014 21:51:15
Event ID:
2070
Task Category: Service
Level:
Error
Keywords:
Classic
User:
N/A
Computer:
Exchangeserver1
Description:
The Microsoft Exchange Replication service encountered an error while inspecting the logs and database for Online Archive 1\EXCHANGESERVER1 on startup. Error: File check failed : File
'O:\Mailbox Databases\Online Archive 1\Online Archive 1.edb' could not be opened.
The file is locked or in use.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="49156">2070</EventID>
<Level>2</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2014-06-05T20:51:15.000000000Z" />
<EventRecordID>7392315</EventRecordID>
<Channel>Application</Channel>
<Computer>Exchangeserver1</Computer>
<Security />
</System>
<EventData>
<Data>Online Archive 1\EXCHANGESERVER1</Data>
<Data>File check failed : File 'O:\Mailbox Databases\Online Archive 1\Online Archive 1.edb' could not be opened.
The file is locked or in use.</Data>
</EventData>
</Event>
Log Name:
Application
Source:
ESE
Date:
05/06/2014 21:51:45
Event ID:
489
Task Category: General
Level:
Error
Keywords:
Classic
User:
N/A
Computer:
Exchangeserver1
Description:
msexchangerepl (2448) An attempt to open the file "O:\Mailbox Databases\Online Archive 1\Online Archive 1.edb" for read only access failed with system error 32 (0x00000020):
"The process cannot access the file because it is being used by another process. ".
The open file operation will fail with error -1032 (0xfffffbf8).
For more information, click http://www.microsoft.com/contentredirect.asp.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="ESE" />
<EventID Qualifiers="0">489</EventID>
<Level>2</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2014-06-05T20:51:45.000000000Z" />
<EventRecordID>7392316</EventRecordID>
<Channel>Application</Channel>
<Computer>Exchangeserver1</Computer>
<Security />
</System>
<EventData>
<Data>msexchangerepl</Data>
<Data>2448</Data>
<Data>
</Data>
<Data>O:\Mailbox Databases\Online Archive 1\Online Archive 1.edb</Data>
<Data>-1032 (0xfffffbf8)</Data>
<Data>32 (0x00000020)</Data>
<Data>The process cannot access the file because it is being used by another process. </Data>
</EventData>
</Event>
Log Name:
Application
Source:
MSExchange Search Indexer
Date:
05/06/2014 21:51:50
Event ID:
108
Task Category: General
Level:
Information
Keywords:
Classic
User:
N/A
Computer:
Exchangeserver1
Description:
Exchange Search Indexer has enabled indexing for the Mailbox Database Online Archive 1 (GUID = ee385d93-918f-470e-b57b-a87d7e23ed20).
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchange Search Indexer" />
<EventID Qualifiers="16388">108</EventID>
<Level>4</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2014-06-05T20:51:50.000000000Z" />
<EventRecordID>7392320</EventRecordID>
<Channel>Application</Channel>
<Computer>Exchangeserver1</Computer>
<Security />
</System>
<EventData>
<Data>Online Archive 1</Data>
<Data>ee385d93-918f-470e-b57b-a87d7e23ed20</Data>
</EventData>
</Event>
Log Name:
Application
Source:
ExchangeStoreDB
Date:
05/06/2014 21:52:00
Event ID:
124
Task Category: Database recovery
Level:
Error
Keywords:
Classic
User:
N/A
Computer:
Exchangeserver1
Description:
At '05/06/2014 21:51:15' the Exchange Information Store Database 'Online Archive 1' copy on this server encountered an error. Consult the event log on the server for other "ExchangeStoreDb"
or "msexchangeRepl" events that may identify the specific failure. The Replication Service will automatically attempt to retry.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="ExchangeStoreDB" />
<EventID Qualifiers="49156">124</EventID>
<Level>2</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2014-06-05T20:52:00.000000000Z" />
<EventRecordID>7392327</EventRecordID>
<Channel>Application</Channel>
<Computer>Exchangeserver1</Computer>
<Security />
</System>
<EventData>
<Data>Online Archive 1</Data>
<Data>ee385d93-918f-470e-b57b-a87d7e23ed20</Data>
<Data>Replay</Data>
<Data>AlertOnly</Data>
<Data>Online Archive 1</Data>
<Data>
</Data>
<Data>
</Data>
<Data>05/06/2014 21:51:15</Data>
</EventData>
</Event>
These seem to repeat until a log entry:
Log Name:
Application
Source:
MSExchangeIS
Date:
05/06/2014 22:14:38
Event ID:
9617
Task Category: Exchange VSS Writer
Level:
Error
Keywords:
Classic
User:
N/A
Computer:
Exchangeserver1
Description:
Exchange VSS Writer (instance ae29b16e-11b9-4f2d-b2eb-a544d0927d87:2) failed with error code -2147221233 when processing the backup completion event.
I thought it was a backup issue but Veeam have investigated and have said it is a VSS timeout issue (I'm not convinced)
Recently I have had to have a new logs drive and extend the size of the mail box drive but since those changes were made backup has run OK until this issues.
Any advice appreciated.Hi,
Based on my research, when Veeam takes the snapshot to then do a VSS backup it will cause the databases in the DAG to fail over and cause lots of alerts and we can modify the REM for the backup issue:
http://desktopfeedbag.com/2012/02/23/fixed-exchange-2010-sp1sp2-dag-fail-over-with-veeam/
Note: Microsoft is providing this information as a convenience to you. The sites are not controlled by Microsoft. Microsoft cannot make any representations regarding the quality, safety, or suitability of any software or information found there. Please make
sure that you completely understand the risk before retrieving any suggestions from the above link.
Thanks,
Angela Shi
TechNet Community Support -
Unexpected DAG mailbox database failover
Good evening
I am running a three node Exchange 2013 server environment in a stretched DAG configuration. I have been experiencing a problem recently whereby failover is occurring unexpectedly. Below is a brief description of the environment.
Site 1 (Head Office)
2 x Exchange 2013 CAS/MBX (dual role servers, lets call them A and B)
Both are members of the only DAG we have
They both have copies of the only mailbox database we have
Server A has activation preference 1
Server B has activation preference 2
Site 2 (Datacenter)
1 x Exchange 2013 CAS/MBX (dual role server, lets call it C)
C is a member of the same DAG as above
It hosts a copy of the same mailbox database as above
Server C has activation preference 3 (although I have configured it to never automatically activate a database copy)
Server C will only be actively used in a disaster scenario where we lose both A and B in the head office for whatever reason
So recently I have noticed that when the mailbox database is mounted and active on server A after a period of not more than an hour or two, the database is automatically moved to server B. This has happened 3 times now.
I find these informational alerts in the event viewer on server A.
Event ID 2136
Log Name: Application
Source: MSExchangeRepl
Date: 14/11/2014 16:01:03
Event ID: 2136
Task Category: Service
Level: Warning
Keywords: Classic
User: N/A
Computer: ServerA.domain.internal
Description:
Unable to communicate with the Microsoft Exchange Information Store service to coordinate log truncation for database 'Mailbox Database 1\ServerA' due to an RPC communication failure. Error: 3355381764
Extended error: Failed to open a log truncation context to source server 'ServerA.domain.internal'. Hresult: 0xc7ff1004. Error: Error returned from an ESE function call (-1305).
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="32772">2136</EventID>
<Level>3</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2014-11-14T16:01:03.000000000Z" />
<EventRecordID>4381652</EventRecordID>
<Channel>Application</Channel>
<Computer>ServerA.domain.internal</Computer>
<Security />
</System>
<EventData>
<Data>Mailbox Database 1\ServerA</Data>
<Data>3355381764</Data>
<Data>Failed to open a log truncation context to source server 'ServerB.domain.internal'. Hresult: 0xc7ff1004. Error: Error returned from an ESE function call (-1305).
</Data>
</EventData>
</Event>
Event ID 3169
Log Name: Application
Source: MSExchangeRepl
Date: 14/11/2014 16:01:04
Event ID: 3169
Task Category: Service
Level: Information
Keywords: Classic
User: N/A
Computer: ServerA.domain.internal
Description:
(Active Manager) Database Mailbox Database 1 was successfully moved from ServerA.domain.internal to ServerB.domain.internal. Move comment: Managed availability system failover initiated by Responder=RpsDeepTestPSProxyFailover Component=RPS.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="16388">3169</EventID>
<Level>4</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2014-11-14T16:01:04.000000000Z" />
<EventRecordID>4381655</EventRecordID>
<Channel>Application</Channel>
<Computer>ServerA.domain.internal</Computer>
<Security />
</System>
<EventData>
<Data>Mailbox Database 1</Data>
<Data>ServerA.domain.internal</Data>
<Data>ServerB.domain.internal</Data>
<Data>Managed availability system failover initiated by Responder=RpsDeepTestPSProxyFailover Component=RPS.</Data>
</EventData>
</Event>
Does anyone have any ideas as to why this might be happening or whether there are any additional troubleshooting steps I can take?
RegardsHi George,
Agree with Jared, running CollectOverMetrics.ps1 script is a good choice to troubleshoot the issue.
Except this method, you can also refer to the following article to troubleshoot the issue with other useful information, like mailbox database replication status information, HighAvailability channel event logs..
http://technet.microsoft.com/en-us/library/dd351258(v=exchg.150).aspx
Best regards,
Niko Cheng
TechNet Community Support -
Active Manager failed to mount database Mailbox Database?
So we had our stuff working fine with exchange 2010 rc and 08 r2 rtm... We installed antivirus on our server and now get the below message.... Everything "seems" to work though... We get two of these messages per reboot though... one with the main box database and one for the public folder one....
Again all seems to work okay, we have tried to remove AV but didnt fix.
Any suggestions?
Active Manager failed to mount database Mailbox Database 0539218550 on server main-server.hq.local. Error: An Active Manager operation failed with a transient error. Please retry the operation. Error A transient error occurred during discovery of the database availability group topology. Error: Database action failed with transient error. Error: A transient error occurred during a database operation. Error: MapiExceptionNetworkError: Unable to make admin interface connection to server. (hr=0x80040115, ec=-2147221227)
Diagnostic context:
Lid: 12696 dwParam: 0x6D9 Msg: EEInfo: Generation Time: 2009-09-04 16:40:25:54
Lid: 10648 dwParam: 0x6D9 Msg: EEInfo: Generating component: 2
Lid: 14744 dwParam: 0x6D9 Msg: EEInfo: Status: 1753
Lid: 9624 dwParam: 0x6D9 Msg: EEInfo: Detection location: 501
Lid: 13720 dwParam: 0x6D9 Msg: EEInfo: Flags: 0
Lid: 11672 dwParam: 0x6D9 Msg: EEInfo: NumberOfParameters: 4
Lid: 8856 dwParam: 0x6D9 Msg: EEInfo: prm[0]: Unicode string: ncalrpc
Lid: 8856 dwParam: 0x6D9 Msg: EEInfo: prm[1]: Unicode string:
Lid: 12952 dwParam: 0x6D9 Msg: EEInfo: prm[2]: Long val: -1988875570
Lid: 12952 dwParam: 0x6D9 Msg: EEInfo: prm[3]: Long val: 382312662
Lid: 24060 StoreEc: 0x80040115
Lid: 23746
Lid: 31938 StoreEc: 0x80040115
Lid: 19650
Lid: 27842 StoreEc: 0x80040115
Lid: 20866
Lid: 29058 StoreEc: 0x80040115.I get this as well - two exchange 2010 SP1 UR2 servers. they host all roles on each, non-dag members as of now. Every time I reboot either server I get the same thing. MSExchangeRepl 3154 Service
Log Name: Application
Source: MSExchangeRepl
Date: 1/3/2011 10:54:07 PM
Event ID: 3154
Task Category: Service
Level: Error
Keywords: Classic
User: N/A
Computer: mail.mydomain.com
Description:
Active Manager failed to mount database Exchange DB on server mail.mydomain.com. Error: An Active Manager operation failed with a transient error. Please retry the operation. Error: Database action failed with transient error. Error: A transient error
occurred during a database operation. Error: MapiExceptionNetworkError: Unable to make admin interface connection to server. (hr=0x80040115, ec=-2147221227)
Diagnostic context:
Lid: 12696 dwParam: 0x6D9 Msg: EEInfo: Generation Time: 2011-01-04 03:54:07:310
Lid: 10648 dwParam: 0x6D9 Msg: EEInfo: Generating component: 2
Lid: 14744 dwParam: 0x6D9 Msg: EEInfo: Status: 1753
Lid: 9624 dwParam: 0x6D9 Msg: EEInfo: Detection location: 501
Lid: 13720 dwParam: 0x6D9 Msg: EEInfo: Flags: 0
Lid: 11672 dwParam: 0x6D9 Msg: EEInfo: NumberOfParameters: 4
Lid: 8856 dwParam: 0x6D9 Msg: EEInfo: prm[0]: Unicode string: ncalrpc
Lid: 8856 dwParam: 0x6D9 Msg: EEInfo: prm[1]: Unicode string:
Lid: 12952 dwParam: 0x6D9 Msg: EEInfo: prm[2]: Long val: -1988875570
Lid: 12952 dwParam: 0x6D9 Msg: EEInfo: prm[3]: Long val: 382312662
Lid: 24060 StoreEc: 0x80040115
Lid: 23746
Lid: 31938 StoreEc: 0x80040115
Lid: 19650
Lid: 27842 StoreEc: 0x80040115
Lid: 20866
Lid: 29058 StoreEc: 0x80040115
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="49156">3154</EventID>
<Level>2</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2011-01-04T03:54:07.000000000Z" />
<EventRecordID>8851</EventRecordID>
<Channel>Application</Channel>
<Computer>mail.mydomain.com</Computer>
<Security />
</System>
<EventData>
<Data>Exchange DB</Data>
<Data>mail.mydomain.com</Data>
<Data>An Active Manager operation failed with a transient error. Please retry the operation. Error: Database action failed with transient error. Error: A transient error occurred during a database operation. Error: MapiExceptionNetworkError:
Unable to make admin interface connection to server. (hr=0x80040115, ec=-2147221227)
Diagnostic context:
Lid: 12696 dwParam: 0x6D9 Msg: EEInfo: Generation Time: 2011-01-04 03:54:07:310
Lid: 10648 dwParam: 0x6D9 Msg: EEInfo: Generating component: 2
Lid: 14744 dwParam: 0x6D9 Msg: EEInfo: Status: 1753
Lid: 9624 dwParam: 0x6D9 Msg: EEInfo: Detection location: 501
Lid: 13720 dwParam: 0x6D9 Msg: EEInfo: Flags: 0
Lid: 11672 dwParam: 0x6D9 Msg: EEInfo: NumberOfParameters: 4
Lid: 8856 dwParam: 0x6D9 Msg: EEInfo: prm[0]: Unicode string: ncalrpc
Lid: 8856 dwParam: 0x6D9 Msg: EEInfo: prm[1]: Unicode string:
Lid: 12952 dwParam: 0x6D9 Msg: EEInfo: prm[2]: Long val: -1988875570
Lid: 12952 dwParam: 0x6D9 Msg: EEInfo: prm[3]: Long val: 382312662
Lid: 24060 StoreEc: 0x80040115
Lid: 23746
Lid: 31938 StoreEc: 0x80040115
Lid: 19650
Lid: 27842 StoreEc: 0x80040115
Lid: 20866
Lid: 29058 StoreEc: 0x80040115</Data>
</EventData>
</Event>
Log Name: Application
Source: MSExchangeRepl
Date: 1/3/2011 10:54:06 PM
Event ID: 3154
Task Category: Service
Level: Error
Keywords: Classic
User: N/A
Computer: mail.mydomain.com
Description:
Active Manager failed to mount database Public on server mail.mydomain.com. Error: An Active Manager operation failed with a transient error. Please retry the operation. Error: Database action failed with transient error. Error: A transient error occurred
during a database operation. Error: MapiExceptionNetworkError: Unable to make admin interface connection to server. (hr=0x80040115, ec=-2147221227)
Diagnostic context:
Lid: 12696 dwParam: 0x6D9 Msg: EEInfo: Generation Time: 2011-01-04 03:54:05:732
Lid: 10648 dwParam: 0x6D9 Msg: EEInfo: Generating component: 2
Lid: 14744 dwParam: 0x6D9 Msg: EEInfo: Status: 1753
Lid: 9624 dwParam: 0x6D9 Msg: EEInfo: Detection location: 501
Lid: 13720 dwParam: 0x6D9 Msg: EEInfo: Flags: 0
Lid: 11672 dwParam: 0x6D9 Msg: EEInfo: NumberOfParameters: 4
Lid: 8856 dwParam: 0x6D9 Msg: EEInfo: prm[0]: Unicode string: ncalrpc
Lid: 8856 dwParam: 0x6D9 Msg: EEInfo: prm[1]: Unicode string:
Lid: 12952 dwParam: 0x6D9 Msg: EEInfo: prm[2]: Long val: -1988875570
Lid: 12952 dwParam: 0x6D9 Msg: EEInfo: prm[3]: Long val: 382312662
Lid: 24060 StoreEc: 0x80040115
Lid: 23746
Lid: 31938 StoreEc: 0x80040115
Lid: 19650
Lid: 27842 StoreEc: 0x80040115
Lid: 20866
Lid: 29058 StoreEc: 0x80040115
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="MSExchangeRepl" />
<EventID Qualifiers="49156">3154</EventID>
<Level>2</Level>
<Task>1</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2011-01-04T03:54:06.000000000Z" />
<EventRecordID>8850</EventRecordID>
<Channel>Application</Channel>
<Computer>Gmail.mydomain.com</Computer>
<Security />
</System>
<EventData>
<Data>Public</Data>
<Data>mail.mydomain.com</Data>
<Data>An Active Manager operation failed with a transient error. Please retry the operation. Error: Database action failed with transient error. Error: A transient error occurred during a database operation. Error: MapiExceptionNetworkError:
Unable to make admin interface connection to server. (hr=0x80040115, ec=-2147221227)
Diagnostic context:
Lid: 12696 dwParam: 0x6D9 Msg: EEInfo: Generation Time: 2011-01-04 03:54:05:732
Lid: 10648 dwParam: 0x6D9 Msg: EEInfo: Generating component: 2
Lid: 14744 dwParam: 0x6D9 Msg: EEInfo: Status: 1753
Lid: 9624 dwParam: 0x6D9 Msg: EEInfo: Detection location: 501
Lid: 13720 dwParam: 0x6D9 Msg: EEInfo: Flags: 0
Lid: 11672 dwParam: 0x6D9 Msg: EEInfo: NumberOfParameters: 4
Lid: 8856 dwParam: 0x6D9 Msg: EEInfo: prm[0]: Unicode string: ncalrpc
Lid: 8856 dwParam: 0x6D9 Msg: EEInfo: prm[1]: Unicode string:
Lid: 12952 dwParam: 0x6D9 Msg: EEInfo: prm[2]: Long val: -1988875570
Lid: 12952 dwParam: 0x6D9 Msg: EEInfo: prm[3]: Long val: 382312662
Lid: 24060 StoreEc: 0x80040115
Lid: 23746
Lid: 31938 StoreEc: 0x80040115
Lid: 19650
Lid: 27842 StoreEc: 0x80040115
Lid: 20866
Lid: 29058 StoreEc: 0x80040115</Data>
</EventData>
</Event> -
Hi.
I got two DAG nodes with CAS role installed. Sudently i get this failures on both nodes. This happens for all databases. I have tried do Seed the DB, with no luck
I run the The CheckDatabaseRedundancy.ps1 script and this seems OK.
Could somone please help me,
[PS] D:\Program Files\Microsoft\Exchange Server\V15\Scripts>.\CheckDatabaseRedundancy.ps1
DatabaseName : Users05
LastRedundancyCount : 0
CurrentRedundancyCount : 2
LastState : Unknown
CurrentState : Green
LastStateTransitionUtc : 05.07.2013 05:49:10
LastGreenTransitionUtc : 05.07.2013 05:49:10
LastRedTransitionUtc :
LastGreenReportedUtc : 05.07.2013 05:49:10
HasReportedGreenEvent : True
LastRedReportedUtc :
PreviousTotalRedDuration : 00:00:00
TotalRedDuration : 00:00:00
IsTransitioningState : True
HasErrorsInHistory : False
CurrentErrorMessages :
ErrorHistory :
IsOneDatacenter : False
CurrentRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
CurrentSearchRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
Event:4376
Database one datacenter available copy health check failed.
Database copy: Users05
Redundancy count: 2
Error:
================
Full Copy Status
================
Database Copy : Users05\casmbx02
VolumeInfoLastError :
LogPathIsOnMountedFolder : False
LogVolumeName : \\?\Volume{beecae05-53ca-444d-ab5f-dd98510b4776}\
LogVolumeMountPoint : E:\
DatabasePathIsOnMountedFolder : False
DatabaseVolumeName : \\?\Volume{b92c9520-905f-4ee4-902d-1e73c26b1717}\
DatabaseVolumeMountPoint : F:\
ExchangeVolumeMountPoint :
LastDatabaseVolumeNameTransitionTime : 01.01.1601 00:00:00
LastDatabaseVolumeName :
DiskFreeSpacePercent : 90
DiskTotalSpaceBytes : 107237863424
DiskFreeSpaceBytes : 97164902400
SeedingSource : False
ActivationPreference : 2
LogsCopiedSinceInstanceStart : 45
LogsReplayedSinceInstanceStart : 86
ExtendedErrorInfo :
ErrorEventId : 0
ErrorMessage :
ReplayQueueNotKeepingUp : False
CopyQueueNotKeepingUp : False
SnapshotLatestCopyBackup : False
SnapshotLatestDifferentialBackup : False
SnapshotLatestIncrementalBackup : False
SnapshotLatestFullBackup : True
LatestCopyBackupTime : 01.01.1601 00:00:00
LatestDifferentialBackupTime : 01.01.1601 00:00:00
LatestIncrementalBackupTime : 01.01.1601 00:00:00
LatestFullBackupTime : 04.07.2013 19:31:34
LastLogCopyNotified : 4100
CurrentReplayLogTime : 05.07.2013 05:24:26
LastReplayedLogTime : 05.07.2013 05:39:26
LastInspectedLogTime : 05.07.2013 05:39:26
LastCopiedLogTime : 05.07.2013 05:39:26
LastLogInfoFromClusterGen : 4100
LastLogInfoFromClusterTime : 05.07.2013 05:44:01
LastLogInfoFromCopierTime : 05.07.2013 05:44:00
LastLogInfoIsStale : False
LastCopyNotifiedLogTime : 05.07.2013 05:39:26
LatestAvailableLogTime : 05.07.2013 05:39:26
DumpsterEndTime : 01.01.0001 00:00:00
DumpsterStartTime : 01.01.0001 00:00:00
DumpsterRequired : False
DumpsterServers :
ActionInitiator : Service
SuspendComment :
SinglePageRestoreNumber : 0
SinglePageRestore : False
ReplayLagPercentage : 0
ReplayLagPlayDownReason : None
ReplayLagEnabled : Disabled
ReplayLagDisabledReason :
ActualReplayLagTime : 00:04:40.1554322
ConfiguredReplayLagTime : 00:00:00
NodeStatus : Up
WorkerProcessId : 8740
ReseedBlocked : False
ResumeBlocked : False
ReplaySuspended : False
LostWrite : False
Viable : True
ActivationSuspended : False
DbSeedingKBytesWrittenPerSec : 0
DbSeedingKBytesReadPerSec : 0
DbSeedingKBytesWritten : 0
DbSeedingKBytesRead : 0
DbSeedingPercent : 0
ContentIndexSeedingSource :
ContentIndexSeedingPercent :
ContentIndexMailboxesToCrawl :
ContentIndexBacklog : 0
ContentIndexRetryQueueSize : 0
ContentIndexErrorMessage :
ContentIndexStatus : Healthy
LastStatusTransitionTime : 04.07.2013 17:46:02
InstanceStartTime : 04.07.2013 17:45:59
CICurrentness : Current
CopyStatus : Healthy
ServerVersion : 1941996140
LastLogReplayed : 4100
LastLogInspected : 4100
LastLogCopied : 4100
LastLogGenerated : 4100
DataAvailabilityTime : 05.07.2013 05:39:26
DataProtectionTime : 05.07.2013 05:39:26
LastLogGeneratedTime : 05.07.2013 05:44:06
StatusRetrievedTime : 05.07.2013 05:44:06
ActiveDatabaseCopy : CASMBX01
MailboxServer : CASMBX02
DBName : Users05
DBGuid : 57da90db-bc6d-4bf3-b508-64d3bff41377
Database Copy : Users05\casmbx01
VolumeInfoLastError :
LogPathIsOnMountedFolder : False
LogVolumeName : \\?\Volume{94937623-3da4-49ab-825e-49c982ec79f1}\
LogVolumeMountPoint : E:\
DatabasePathIsOnMountedFolder : False
DatabaseVolumeName : \\?\Volume{73a9913d-1660-487b-8a8b-b53cb017728e}\
DatabaseVolumeMountPoint : F:\
ExchangeVolumeMountPoint :
LastDatabaseVolumeNameTransitionTime : 01.01.1601 00:00:00
LastDatabaseVolumeName :
DiskFreeSpacePercent : 90
DiskTotalSpaceBytes : 107237863424
DiskFreeSpaceBytes : 96646443008
SeedingSource : False
ActivationPreference : 1
LogsCopiedSinceInstanceStart : 0
LogsReplayedSinceInstanceStart : 0
ExtendedErrorInfo :
ErrorEventId : 0
ErrorMessage :
ReplayQueueNotKeepingUp : False
CopyQueueNotKeepingUp : False
SnapshotLatestCopyBackup : False
SnapshotLatestDifferentialBackup : False
SnapshotLatestIncrementalBackup : False
SnapshotLatestFullBackup : True
LatestCopyBackupTime : 01.01.1601 00:00:00
LatestDifferentialBackupTime : 01.01.1601 00:00:00
LatestIncrementalBackupTime : 01.01.1601 00:00:00
LatestFullBackupTime : 03.07.2013 19:30:53
LastLogCopyNotified : 4100
CurrentReplayLogTime : 01.01.0001 00:00:00
LastReplayedLogTime : 01.01.0001 00:00:00
LastInspectedLogTime : 01.01.0001 00:00:00
LastCopiedLogTime : 01.01.0001 00:00:00
LastLogInfoFromClusterGen : 4100
LastLogInfoFromClusterTime : 05.07.2013 05:44:01
LastLogInfoFromCopierTime : 05.07.2013 05:44:06
LastLogInfoIsStale : False
LastCopyNotifiedLogTime : 05.07.2013 05:39:26
LatestAvailableLogTime : 01.01.0001 00:00:00
DumpsterEndTime : 01.01.0001 00:00:00
DumpsterStartTime : 01.01.0001 00:00:00
DumpsterRequired : False
DumpsterServers :
ActionInitiator : Unknown
SuspendComment :
SinglePageRestoreNumber : 0
SinglePageRestore : False
ReplayLagPercentage : 0
ReplayLagPlayDownReason : None
ReplayLagEnabled : Disabled
ReplayLagDisabledReason :
ActualReplayLagTime : 00:00:00
ConfiguredReplayLagTime : 00:00:00
NodeStatus : Up
WorkerProcessId : 7624
ReseedBlocked : False
ResumeBlocked : False
ReplaySuspended : False
LostWrite : False
Viable : False
ActivationSuspended : False
DbSeedingKBytesWrittenPerSec : 0
DbSeedingKBytesReadPerSec : 0
DbSeedingKBytesWritten : 0
DbSeedingKBytesRead : 0
DbSeedingPercent : 0
ContentIndexSeedingSource :
ContentIndexSeedingPercent :
ContentIndexMailboxesToCrawl :
ContentIndexBacklog : 0
ContentIndexRetryQueueSize : 0
ContentIndexErrorMessage :
ContentIndexStatus : Healthy
LastStatusTransitionTime : 01.01.0001 00:00:00
InstanceStartTime : 04.07.2013 17:45:58
CICurrentness : Current
CopyStatus : Mounted
ServerVersion : 1941996140
LastLogReplayed : 0
LastLogInspected : 0
LastLogCopied : 0
LastLogGenerated : 4100
DataAvailabilityTime : 01.01.0001 00:00:00
DataProtectionTime : 01.01.0001 00:00:00
LastLogGeneratedTime : 01.01.0001 00:00:00
StatusRetrievedTime : 05.07.2013 05:44:06
ActiveDatabaseCopy : CASMBX01
MailboxServer : CASMBX01
DBName : Users05
DBGuid : 57da90db-bc6d-4bf3-b508-64d3bff41377
Event:4133
Database one datacenter health check failed.
Database copy: Users05
Redundancy count: 2
Error:
================
Full Copy Status
================
Database Copy : Users05\casmbx02
VolumeInfoLastError :
LogPathIsOnMountedFolder : False
LogVolumeName : \\?\Volume{beecae05-53ca-444d-ab5f-dd98510b4776}\
LogVolumeMountPoint : E:\
DatabasePathIsOnMountedFolder : False
DatabaseVolumeName : \\?\Volume{b92c9520-905f-4ee4-902d-1e73c26b1717}\
DatabaseVolumeMountPoint : F:\
ExchangeVolumeMountPoint :
LastDatabaseVolumeNameTransitionTime : 01.01.1601 00:00:00
LastDatabaseVolumeName :
DiskFreeSpacePercent : 90
DiskTotalSpaceBytes : 107237863424
DiskFreeSpaceBytes : 97164902400
SeedingSource : False
ActivationPreference : 2
LogsCopiedSinceInstanceStart : 45
LogsReplayedSinceInstanceStart : 86
ExtendedErrorInfo :
ErrorEventId : 0
ErrorMessage :
ReplayQueueNotKeepingUp : False
CopyQueueNotKeepingUp : False
SnapshotLatestCopyBackup : False
SnapshotLatestDifferentialBackup : False
SnapshotLatestIncrementalBackup : False
SnapshotLatestFullBackup : True
LatestCopyBackupTime : 01.01.1601 00:00:00
LatestDifferentialBackupTime : 01.01.1601 00:00:00
LatestIncrementalBackupTime : 01.01.1601 00:00:00
LatestFullBackupTime : 04.07.2013 19:31:34
LastLogCopyNotified : 4100
CurrentReplayLogTime : 05.07.2013 05:24:26
LastReplayedLogTime : 05.07.2013 05:39:26
LastInspectedLogTime : 05.07.2013 05:39:26
LastCopiedLogTime : 05.07.2013 05:39:26
LastLogInfoFromClusterGen : 4100
LastLogInfoFromClusterTime : 05.07.2013 05:44:01
LastLogInfoFromCopierTime : 05.07.2013 05:44:00
LastLogInfoIsStale : False
LastCopyNotifiedLogTime : 05.07.2013 05:39:26
LatestAvailableLogTime : 05.07.2013 05:39:26
DumpsterEndTime : 01.01.0001 00:00:00
DumpsterStartTime : 01.01.0001 00:00:00
DumpsterRequired : False
DumpsterServers :
ActionInitiator : Service
SuspendComment :
SinglePageRestoreNumber : 0
SinglePageRestore : False
ReplayLagPercentage : 0
ReplayLagPlayDownReason : None
ReplayLagEnabled : Disabled
ReplayLagDisabledReason :
ActualReplayLagTime : 00:04:40.1554322
ConfiguredReplayLagTime : 00:00:00
NodeStatus : Up
WorkerProcessId : 8740
ReseedBlocked : False
ResumeBlocked : False
ReplaySuspended : False
LostWrite : False
Viable : True
ActivationSuspended : False
DbSeedingKBytesWrittenPerSec : 0
DbSeedingKBytesReadPerSec : 0
DbSeedingKBytesWritten : 0
DbSeedingKBytesRead : 0
DbSeedingPercent : 0
ContentIndexSeedingSource :
ContentIndexSeedingPercent :
ContentIndexMailboxesToCrawl :
ContentIndexBacklog : 0
ContentIndexRetryQueueSize : 0
ContentIndexErrorMessage :
ContentIndexStatus : Healthy
LastStatusTransitionTime : 04.07.2013 17:46:02
InstanceStartTime : 04.07.2013 17:45:59
CICurrentness : Current
CopyStatus : Healthy
ServerVersion : 1941996140
LastLogReplayed : 4100
LastLogInspected : 4100
LastLogCopied : 4100
LastLogGenerated : 4100
DataAvailabilityTime : 05.07.2013 05:39:26
DataProtectionTime : 05.07.2013 05:39:26
LastLogGeneratedTime : 05.07.2013 05:44:06
StatusRetrievedTime : 05.07.2013 05:44:06
ActiveDatabaseCopy : CASMBX01
MailboxServer : CASMBX02
DBName : Users05
DBGuid : 57da90db-bc6d-4bf3-b508-64d3bff41377
Database Copy : Users05\casmbx01
VolumeInfoLastError :
LogPathIsOnMountedFolder : False
LogVolumeName : \\?\Volume{94937623-3da4-49ab-825e-49c982ec79f1}\
LogVolumeMountPoint : E:\
DatabasePathIsOnMountedFolder : False
DatabaseVolumeName : \\?\Volume{73a9913d-1660-487b-8a8b-b53cb017728e}\
DatabaseVolumeMountPoint : F:\
ExchangeVolumeMountPoint :
LastDatabaseVolumeNameTransitionTime : 01.01.1601 00:00:00
LastDatabaseVolumeName :
DiskFreeSpacePercent : 90
DiskTotalSpaceBytes : 107237863424
DiskFreeSpaceBytes : 96646443008
SeedingSource : False
ActivationPreference : 1
LogsCopiedSinceInstanceStart : 0
LogsReplayedSinceInstanceStart : 0
ExtendedErrorInfo :
ErrorEventId : 0
ErrorMessage :
ReplayQueueNotKeepingUp : False
CopyQueueNotKeepingUp : False
SnapshotLatestCopyBackup : False
SnapshotLatestDifferentialBackup : False
SnapshotLatestIncrementalBackup : False
SnapshotLatestFullBackup : True
LatestCopyBackupTime : 01.01.1601 00:00:00
LatestDifferentialBackupTime : 01.01.1601 00:00:00
LatestIncrementalBackupTime : 01.01.1601 00:00:00
LatestFullBackupTime : 03.07.2013 19:30:53
LastLogCopyNotified : 4100
CurrentReplayLogTime : 01.01.0001 00:00:00
LastReplayedLogTime : 01.01.0001 00:00:00
LastInspectedLogTime : 01.01.0001 00:00:00
LastCopiedLogTime : 01.01.0001 00:00:00
LastLogInfoFromClusterGen : 4100
LastLogInfoFromClusterTime : 05.07.2013 05:44:01
LastLogInfoFromCopierTime : 05.07.2013 05:44:06
LastLogInfoIsStale : False
LastCopyNotifiedLogTime : 05.07.2013 05:39:26
LatestAvailableLogTime : 01.01.0001 00:00:00
DumpsterEndTime : 01.01.0001 00:00:00
DumpsterStartTime : 01.01.0001 00:00:00
DumpsterRequired : False
DumpsterServers :
ActionInitiator : Unknown
SuspendComment :
SinglePageRestoreNumber : 0
SinglePageRestore : False
ReplayLagPercentage : 0
ReplayLagPlayDownReason : None
ReplayLagEnabled : Disabled
ReplayLagDisabledReason :
ActualReplayLagTime : 00:00:00
ConfiguredReplayLagTime : 00:00:00
NodeStatus : Up
WorkerProcessId : 7624
ReseedBlocked : False
ResumeBlocked : False
ReplaySuspended : False
LostWrite : False
Viable : False
ActivationSuspended : False
DbSeedingKBytesWrittenPerSec : 0
DbSeedingKBytesReadPerSec : 0
DbSeedingKBytesWritten : 0
DbSeedingKBytesRead : 0
DbSeedingPercent : 0
ContentIndexSeedingSource :
ContentIndexSeedingPercent :
ContentIndexMailboxesToCrawl :
ContentIndexBacklog : 0
ContentIndexRetryQueueSize : 0
ContentIndexErrorMessage :
ContentIndexStatus : Healthy
LastStatusTransitionTime : 01.01.0001 00:00:00
InstanceStartTime : 04.07.2013 17:45:58
CICurrentness : Current
CopyStatus : Mounted
ServerVersion : 1941996140
LastLogReplayed : 0
LastLogInspected : 0
LastLogCopied : 0
LastLogGenerated : 4100
DataAvailabilityTime : 01.01.0001 00:00:00
DataProtectionTime : 01.01.0001 00:00:00
LastLogGeneratedTime : 01.01.0001 00:00:00
StatusRetrievedTime : 05.07.2013 05:44:06
ActiveDatabaseCopy : CASMBX01
MailboxServer : CASMBX01
DBName : Users05
DBGuid : 57da90db-bc6d-4bf3-b508-64d3bff41377
RinkenHi.
I also ran the CheckDatabaseRedundancy.ps1 script. the output was:
DatabaseName : Users05
LastRedundancyCount : 0
CurrentRedundancyCount : 2
LastState : Unknown
CurrentState : Green
LastStateTransitionUtc : 11.07.2013 07:34:16
LastGreenTransitionUtc : 11.07.2013 07:34:16
LastRedTransitionUtc :
LastGreenReportedUtc : 11.07.2013 07:34:16
HasReportedGreenEvent : True
LastRedReportedUtc :
PreviousTotalRedDuration : 00:00:00
TotalRedDuration : 00:00:00
IsTransitioningState : True
HasErrorsInHistory : False
CurrentErrorMessages :
ErrorHistory :
IsOneDatacenter : False
CurrentRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
CurrentSearchRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
DatabaseName : Users04
LastRedundancyCount : 0
CurrentRedundancyCount : 2
LastState : Unknown
CurrentState : Green
LastStateTransitionUtc : 11.07.2013 07:34:16
LastGreenTransitionUtc : 11.07.2013 07:34:16
LastRedTransitionUtc :
LastGreenReportedUtc : 11.07.2013 07:34:16
HasReportedGreenEvent : True
LastRedReportedUtc :
PreviousTotalRedDuration : 00:00:00
TotalRedDuration : 00:00:00
IsTransitioningState : True
HasErrorsInHistory : False
CurrentErrorMessages :
ErrorHistory :
IsOneDatacenter : False
CurrentRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
CurrentSearchRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
DatabaseName : Users02
LastRedundancyCount : 0
CurrentRedundancyCount : 2
LastState : Unknown
CurrentState : Green
LastStateTransitionUtc : 11.07.2013 07:34:17
LastGreenTransitionUtc : 11.07.2013 07:34:17
LastRedTransitionUtc :
LastGreenReportedUtc : 11.07.2013 07:34:17
HasReportedGreenEvent : True
LastRedReportedUtc :
PreviousTotalRedDuration : 00:00:00
TotalRedDuration : 00:00:00
IsTransitioningState : True
HasErrorsInHistory : False
CurrentErrorMessages :
ErrorHistory :
IsOneDatacenter : False
CurrentRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
CurrentSearchRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
DatabaseName : Users03
LastRedundancyCount : 0
CurrentRedundancyCount : 2
LastState : Unknown
CurrentState : Green
LastStateTransitionUtc : 11.07.2013 07:34:17
LastGreenTransitionUtc : 11.07.2013 07:34:17
LastRedTransitionUtc :
LastGreenReportedUtc : 11.07.2013 07:34:17
HasReportedGreenEvent : True
LastRedReportedUtc :
PreviousTotalRedDuration : 00:00:00
TotalRedDuration : 00:00:00
IsTransitioningState : True
HasErrorsInHistory : False
CurrentErrorMessages :
ErrorHistory :
IsOneDatacenter : False
CurrentRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
CurrentSearchRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
DatabaseName : Users01
LastRedundancyCount : 0
CurrentRedundancyCount : 2
LastState : Unknown
CurrentState : Green
LastStateTransitionUtc : 11.07.2013 07:34:17
LastGreenTransitionUtc : 11.07.2013 07:34:17
LastRedTransitionUtc :
LastGreenReportedUtc : 11.07.2013 07:34:17
HasReportedGreenEvent : True
LastRedReportedUtc :
PreviousTotalRedDuration : 00:00:00
TotalRedDuration : 00:00:00
IsTransitioningState : True
HasErrorsInHistory : False
CurrentErrorMessages :
ErrorHistory :
IsOneDatacenter : False
CurrentRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
CurrentSearchRedundancyCountPerSite : {[Default-First-Site-Name, 2]}
Rinken -
Exchange 2013 Event ID 106 MSExchange Common
Event ID 106 is generated on Exchange 2013 ,already updated Perfcounters.ps1 according to this article.still getting
same error.
http://support.microsoft.com/kb/2870416/en-us
Log Name: Application
Source: MSExchange Common
Date: 1/13/2014 8:59:30 PM
Event ID: 106
Task Category: General
Level: Error
Keywords: Classic
User: N/A
Computer: DC4.chickbuns.com
Description:
Performance counter updating error. Counter name is Time in Resource per second, category name is MSExchange Activity Context Resources. Optional code: 2. Exception: The exception thrown is : System.InvalidOperationException: Instance 'ad-w3wp-msexchangeowaapppool'
already exists with a lifetime of Process. It cannot be recreated or reused until it has been removed or until the process using it has exited.
Processes running while Performance counter failed to update:
3148 MSExchangeDelivery
388 wininit
1568 SMSvcHost
8976 w3wp
2748 conhost
6292 w3wp
380 csrss
3924 MSExchangeFrontendTransport
768 svchost
1948 sftracing
1156 spoolsv
956 svchost
7204 w3wp
752 LogonUI
2128 noderunner
3900 MSExchangeSubmission
8968 w3wp
1928 ForefrontActiveDirectoryConnector
1336 taskeng
7048 w3wp
348 svchost
3692 Microsoft.Exchange.EdgeSyncSvc
4676 Microsoft.Exchange.RpcClientAccess.Service
4872 MSExchangeMailboxReplication
340 csrss
1556 UMWorkerProcess
8020 w3wp
3088 Microsoft.Exchange.AntispamUpdateSvc
1312 MSExchangeHMHost
7948 w3wp
424 winlogon
1500 rundll32
4448 MSExchangeMailboxAssistants
900 svchost
6700 scanningprocess
504 lsm
5816 umservice
4244 Microsoft.Exchange.ServiceHost
2736 MSExchangeHMWorker
496 lsass
1840 vmtoolsd
1872 noderunner
488 services
1396 inetinfo
680 svchost
1296 hostcontrollerservice
7036 w3wp
1688 noderunner
1216 svchost
6740 scanningprocess
2364 svchost
1844 svchost
856 svchost
4992 conhost
6760 w3wp
7816 w3wp
4196 Microsoft.Exchange.Pop3Service
2028 updateservice
1236 fms
2220 noderunner
4976 msexchangerepl
7544 w3wp
600 svchost
5364 MSExchangeTransportLogSearch
2464 WMSvc
4376 conhost
1416 Microsoft.Exchange.Diagnostics.Service
3580 Microsoft.Exchange.Imap4Service
6336 scanningprocess
1016 Microsoft.Exchange.Directory.TopologyService
4364 Microsoft.Exchange.Imap4
5992 Microsoft.Exchange.UM.CallRouter
6920 w3wp
2388 wlms
5144 MSExchangeThrottling
808 svchost
3760 Microsoft.Exchange.Search.Service
4744 Microsoft.Exchange.Pop3
248 smss
2964 WmiPrvSE
1584 rundll32
5840 Microsoft.Exchange.Store.Worker
4 System
4336 Microsoft.Exchange.Store.ServiceHi,
Based on my research, the issue can be resolved by removing and re-creating all Exchange performance counters:
add-pssnapin Microsoft.Exchange.Management.PowerShell.Setup
$files=get-childitem “C:\Program Files\Microsoft\Exchange Server\V15\Setup\Perf\" *.xml |where-object {!($_.psiscontainer)}
foreach ($file in $files) {remove-perfcounters -definitionfilename $file.fullname}
foreach ($file in $files) {new-perfcounters -definitionfilename $file.fullname}
For more information, you can refer to the following thread:
http://social.technet.microsoft.com/Forums/exchange/en-US/a8e35d2a-5e09-4ec5-b5c8-43554d3b8b78/lots-of-errors-106-msexchange-common?forum=exchangesvradmin
If you have any question, please feel free to let me know.
Thanks,
Angela Shi
TechNet Community Support
Maybe you are looking for
-
How do i add a display to my mac book pro
Ok I just upgraded my mac book pro OS X 10.8.5 and now when I look under System Preferances and under Displays all I see is the Mac Book built in display I used to see a pictagram of monitors (you could put the monitor to the right or left of the mac
-
In Adobe Creative Suite 5.5 Web Premium Acrobat® X Pro is included, why did it not install on my pc? I upgrade from CS3 and tun on new PC Windows 7
-
How to mute startup sound? (iMac, OS 10.8)
Ever since I've upgraded to Mountain Lion, the startup sound came back. I am using an iMac so you clearly didn't read this post if you're suggesting the Silent Ninja application. I've even tried it myself, and it doesn't work. The Arcana is what I us
-
FF not showing table border style
I have a webpage with css table border style dotted. It shows up in IE but there is just a line around the table in FF. Is there a way to make it show up? Many thanks. table.mytable { border-width: 6px; padding: 15px; border-style: dotted; border-col
-
Will Mac OS 10.5 run on a PPC? I know that 10.6 will not work on a PPC. I can't remember if Leopard came out before the intel Macs.