Transaction logs after large mailbox archive?

Hi all,
I've recently run a large mailbox archive on our mailbox database and I'm concerned about the transaction log files that will be produced.
Some info: We run a single Exchange server on Windows Server 2008, on a single hard disk. The system is run on VMWare with a full Exchange-aware backup run every night. Database file is currently 194GB with about 90GB whitespace.
I archived 20GB worth of email from a mailbox. My problem is that the hard disk with the database and log files on it only has 12GB of free space, so when the Recoverable Items folder is cleared 2 weeks later, is there going to be 20GB of transaction logs
with nowhere to go? Will I have to organise some additional storage to give the log files some room?
Appreciate any help.

Hi,
I notice that there only 12 GB free disk in your mailbox server, it may be too small.
Exchange will not generate much more transaction log when delete Recoverable Items, however it also not delete previous transaction log. Meanwhile, Exchange will generate new log when mail flow and move message to archive database, the size of transaction log
only grow. Therefore, I recommend to add additional disk or full backup for your database on schedule to truncated some unrequired logs.
Here’s the article about Mailbox Server Storage Design, for your reference:
https://technet.microsoft.com/en-us/library/dd346703(v=exchg.141).aspx
Best Regards,
Allen Wang

Similar Messages

SQL Server Database - Transaction logs growing largely with Simple Recovery model

Hello,
There is SQL server database on client side in production environment with huge transaction logs.
Requirement :
1. Take database backup
2. Transaction log backup is not required. - so it is set to Simple recovery model.
I am aware that, Simple Recovery model also increases the transaction logs same as in Full Recovery model as given on below link.
http://realsqlguy.com/origins-no-simple-mode-doesnt-disable-the-transaction-log/
Last week, this transaction log became of 1TB size and blocked everything on the database server.
How to over come with this situation?
PS : There are huge bulk uploads to the database tables.
Current Configuration :
1. Simple Recovery model
2. Target Recovery time : 3 Sec
3. Recovery interval : 0
4. No SQL Agent job schedule to shrink database.
5. No other checkpoints created except automatic ones.
Can anyone please guide me to have correct configuration on SQL server for client's production environment?
Please let me know if any other details required from server.
Thank you,
Mittal.

@dave_gona,
Thank you for your response.
Can you please explain me this in more details --
What do you mean by one batch ?
1. Number of rows to be inserted at a time ?
2. or Size of data in one cell does matter here.
As in my case, I am clubbing together all the data in one xml (on c# side) and inserting it as one record. Data is large in size, but only 1 record is inserted.
Is it a good idea to shrink transaction log periodically, as it is not happening itself in simple recovery model.
HI Mittal,
Shrinking is bad activity yu should not shrink log files regularly, in rare case if you want to recovery space you may do it.
Have manual chekpoints in Bulk insert operation.
I cannot tell upfront what should be batch size but you can start with 1/4 th of what you are currently inserting.
Most important what does below query return for database
select log_reuse_wait_desc from sys.databases where name='db_name'
The value it returns is what stopping the log from getting cleared and reused.
What is version and editon of SQl server we are talking about. What is output of
select @@version
Please mark this reply as answer if it solved your issue or vote as helpful if it helped so that other forum members can benefit from it
My Technet Wiki Article
MVP

Clearing transaction log after ehpi

hello every body
i want to clear my transaction log on mssql server 2005,
b'se after EHP4 upgrade it was reached near to 96 Gb
i trried this
a. Detach the database
b. Rename the log file
c. Attach the database without the log file
d. Delete the log file
but database was not attaching , it says that the default user was not able to login,
before this i can log in easily with the same user.
now after restart it was not connecting the database with same user error .
b'se of this i am not been able to start the sap system too.
hlp needed

First, you need to change the default database of your login, mostly likely the database you detached was default for your login
Please follow this article for instructions: [http://support.microsoft.com/kb/307864]
SAP Note: [4064|https://websmp230.sap-ag.de/sap(bD1lbiZjPTAwMQ==)/bc/bsp/spn/sapnotes/index2.htm?numm=806925&nlang=E&smpsrv=https://websmp204.sap-ag.de]
you don't delete the transaction log if you want to clear the transaction log. you use sql command in management studio:
dbcc shrinkfile('logfilename', 1024), where 1024 is desired size in MB to shrink the file.
Now if you have deleted transaction log file from OS, probably you may have to restore the database.
Thanks
Mush

Exchange 2010 Excessive Archive Transaction Logs

I've got an Exchange 2010 environment with about 225 users over 6 mailbox DB's with corresponding Archive DB's.
They're seeing log files for the archive DB's growing by about 25-30% of the total DB size daily. Those logs are generally about 8 x the logs generated by the corresponding primary mailbox database.
Something like
DB1 = 20GB daily average logs 2GB
DB1Archive = 90GB daily average logs ~28GB
I don't see any Retention policies that have duplicated Tags and the Default policy has no tags assigned.
The customer wants to continue with their existing backup process of weekly fulls and daily incremental/differentials, and missing two days is enough to max out their transaction log volumes. (which are as large as their combined database size).
The archive db's have been in place for at least 12 weeks now so it's not just initial population, which is obvious by the fact that the archive db's are much larger than the original db's and the total logs in a week exceed the DB volumes by 2-3 times.

Hi,
First, please make sure there is no corruption in the retention policies.
If there is no corruption, I recommend you create a new archive mailbox database and move archive mailbox to this new database to check result.
Besides, here is a similar thread for your reference.
http://social.technet.microsoft.com/Forums/en-US/77845ba9-96c4-4b94-8d55-b47c51ef8974/exchange-2010-archive-transaction-logs?forum=exchange2010
Hope this is helpful to you.
Best regards,
Belinda Ma
TechNet Community Support

Ce7305-5.3.3: number of transaction log archives

Could anybody tell me how many archives are kept for transaction logs on a ce7305-5.3.3, and how can we control the number of them?
Thanks in advance.
A.T Doan

Hi Alex,
Actually circular logging/backup was not a solution, I was just explaining that there is an option like that on server but it is not recommended hence not useful in our case :)
- I am not a developer but AFAIK, WebDAV search query shouldn't generate transaction log because it just searches the mailboxes and gives the result in HTTP format and doesn't produce any Exchange transaction.
- I wouldn't open transaction logs since it is being used by Exchange which may generate errors and may corrupt Exchange database sometime too. However it is not readable, as you observed, other than Exchange Information Store service (store.exe).
- You can post this query in development forum to get better idea on this, if any other programmer observed similar symptom while using WebDAV contact search query in Exchange 2007 or can validate your query.
Microsoft TechNet > Forums Home > Exchange Server > Development
Well, I just saw that you are using Exchange 2007, in that case why don't you use Exchange Web Service which is better and improved method to access/query mailboxes where as WebDAV is also de-emphasized in Exchange 2007 and might be disappeared in next version of Exchange. Checkout below article for further detail.
Development: Overview
http://technet.microsoft.com/en-us/library/aa997614.aspx
Amit Tank | MVP - Exchange | MCITP:EMA MCSA:M | http://ExchangeShare.WordPress.com

System Crash after transactional log filled filesystem

Dear gurus,
We have an issue in our PRD system under FlexFrame platform. We SAP NW 7.4 (SP03) with ASE 15.7.0.042 (SuSe SLES 11 SP1) running as BW system.
While uploading data from ERP system, the transactional log was filled. We can see in <SID>.log:
Can't allocate space for object 'syslogs' in database '<SID>' because 'logsegment' segment is full/has no free extents. If you ran out of space in syslogs, dump the transaction log. Otherwise, use ALTER DATABASE to increase the size of the segment.
After this, we increase the transactional log (disk resize). Then, executed ALTER DATABASE <SID> log on <LOGDEVICE> = '<size>'
While ALTER is running the log filesystem was filled (100%), after this, <SID>.log began to grow tremendously.
We stopped Sybase and now, when we try start it all FF node will be down. The filesystem has free space (around 10 GB)
Could you help us?
Add: We think that a posible solution could be to delete the transactional log due to the fact that we understand that the failure is related to this log (maybe corrupted?)
Regards

====================
00:0008:00000:00009:2014/06/26 15:49:37.09 server Checkpoint process detected hardware error writing logical page '2854988', device 5, virtual page 6586976 for dbid 4, cache 'log cache'. It will sleep until write completes successfully.
00:0010:00000:00000:2014/06/26 15:49:37.10 kernel sddone: write error on virtual disk 5 block 6586976:
00:0010:00000:00000:2014/06/26 15:49:37.10 kernel sddone: No space left on device
00:0008:00000:00009:2014/06/26 15:49:37.10 server bufwritedes: write error detected - spid=9, ppage=2854988, bvirtpg=(device 5, page 6586976), db id=4
=======================
1 - check to make sure the filesystem that device #5 (vdevno=5) sits on is not full; make sure filesystem is large enough to hold the entire defined size of device #5; make sure no other processes are writing to said filesystem
2 - have your OS/disk admin(s) make sure the disk fragment(s) underlying device #5's filesystem isn't referenced by other filesystems and/or raw device definitions

How to re-read a 2 GB transaction log archived

I've archived with the backup utility the transaction log of my R/3 system cause we had space problems. Now the file backed-up has a size of 2 GB. I need to read it but I can't open because it's too big. Is there any utility or way to read a so big LOG file? Is there any particular function between the database tools I can use to do it?
Thanx
Sonya

Hello,
you cannot check the free space from outside the SQL Server as you can't open the actual log file as it is locked by SQL Server. If you want to get the information about free log space you can run the SQL command:
dbcc sqlperf(logspace)
If you want to get the information within a bat file you can use the osql utillity from SQL Server:
@echo off
osql -E -Q"dbcc sqlperf(logspace)"
The -E paramter connects you with a trusted Windows connection to the server. If you hae a named instance you have to specify the -S<Instancename> paramter as well. See in SQL Server Books Online for the complete syntax for the osql.exe utility.
Best regards
Clas

Replay transaction logs to a new empty mailbox database

My Exchange 2010 mailbox database got corrupted and do not really have a good backup to recover from and it is not a DAG too.
Using eseutil log files are good but if I do soft recovery, it complains of a missing log file. Going through the log files it is just one file that is missing and even checking the creation date for this file at that time the server was offline because
we were relocating.
Soft recovery has not been successful.
I want to try hard recovery but do not know how much data will be lost. Or better still is there a way to replay log files of the corrupted database into the new database and continue from there?

Without having a good backup, you can not ensure about the security of data that would be recovered.
If you have an old backup of the database and all transaction log files since that backup then you can restore everything up to the last transaction log file.
If you want to do it in the RSG then you can copy all transaction log files from the production storage group to the log file directory of the RSG, then restore you last backup and let the backup program mount the database. Exchange will automatically replay
the log files in the RSG directory and the files on the tape. Please follow this Library : http://technet.microsoft.com/en-us/library/aa998370(EXCHG.65).aspx
If you still unable to recover the data manually, you may consider on this automated software (http://www.exchangeserverrecovery.com/) that might be helpful to recover the data without any losses and resolve
your purpose.

Email account folder in /user/library/mail is much larger than full mailbox archive for the same account

Hi,
I recently changed jobs and want to archive all email (with attachments in place) for the associated work email account. I also plan to remove the old work email account (IMAP) from the list of active mailboxes in Apple Mail. I don't want Spotlight searches for personal or current work email cluttered with results from my old job.
I have created an archive of the old work account by doing Mailbox Archive for all of the IMAP folders for that account. The entire archive is 1.7GB in size.
Before I delete the old account from my Mail preferences, I want to make sure that I have really exported everything. So I've compared the size of the new archive folder with that of the mailbox folder in users/.../Library/Mail for that same account. That latter is 8.7GB in size. Why the enormous difference?
Can the difference be attributed to lack of compression and indices (which would be rebuilt if I import the archive) for spotlight searches? Am I missing something in the archive that I created?
I've created a zip of the system folder. Can I easily restore this at a latter time if I delete the email account from my Mail preferences?
Is there a better way to achieve my objective?
Mitoids

I did find a "Recovered Messages" by looking in the the Mail client under "On My Mac" (I don't normally use that feature). One message with an accicental 99MB attachment that I never sent, was recovered ~60times, consuming 5.7GB.
I deleted all of those, but the size ~/Library/Mail/xxxaccount folder did not change much. It is still much larger than the Archive I created. BTW, this is an IMAP account that was syncing with corporate GMail.

To clear db2 archive log after db2 database backup

After db2 backup archive log remains as it is.is there setting to remove archive logs after database backup.DAS is not installed.
DB2 9.1 FP 6
os HP unix

Hello Anand,
If the archvied logs are not required, ie they are not required for restore
you can remove them.
You can check this is by running
db2 list history all for db <sid>
The above command will give you a detailed overview of the backup
history and what logs were archived and what logs were included or needed for restore of backups.
If they are no longer needed for a restore, then it is safe to remove them.
Kind regards,
Paul

Restoring Mailbox data through Transaction logs

Hello all,
We're running Exhange server 2007 on a dedicated VM.
We're currently running Tri-Daily VM backups and Daily backups via tape in 1 set, and 4 weekly sets of tapes.
Our issue is that now the tape drive has broken and we're trying to source a replacement and or repair of the tape drive, we need to work out how we're going to restore lost data without having to purchase more hardware for VM backups for dailys.
We know that transaction logs can be used to roll forward to a point in time of when the last VM backup was taken, to the time the server went down. to restore as many lost emails as possible.
Our SLA to our users is currently 2-48 hours of lost data on the system, but we'd like to limit this as much as possible, and as it's tri-daily, we run the risk of over running that SLA.
So the main question is, how would we roll our database forward using the transaction logs?

Great link from Ed and regarding rolling logs there are a few things to keep in mind.
1. in order to use ESEutil to roll logs you MUST have a database that is in a dirty/inconsistent state, i.e. system stopped abruptly (was not shut down gracefully) or an Exchange aware backup was made and you are able to restore the DB to disk without rolling
up or mounting the DB.
2. You can only rollup/apply a set of logs to a dirty DB one time, i.e. lets say you have a backup of the DB that is still dirty and the backup was from 1/1/2014 and you have logs up through today 3/11/2014. So you could then make a copy of the logs
through say 1/31/2014 and use eseutil to roll them up and bring the db to a consistent/clean state.
3. However if you want to rollup data through say 2/15/2014 you cannot do so with the DB that was rolled up to 1/31/2014 in step 2 because that DB is now in a clean/consistent state and therefore it will not accept additional log rollup for the logs through
2/15/2014. To solve this you would need to do the following;
A: get a copy of the 1/1/2014 EDB that is dirty/inconsistent
B: copy the logs from 1/14 to 2/15 into a separate directory
C: Roll the logs into the DB using eseutil.
Search, Recover, & Extract Mailboxes, Folders, & Email Items from Offline Exchange Mailbox and Public Folder EDB's and Live Exchange Servers or Import/Migrate direct from Offline EDB to Any Production Exchange Server, even cross version i.e. 2003 -->
2007 --> 2010 --> 2013 with Lucid8's
DigiScope

DPM doesn't clear transaction logs

We use DPM 2012 to backup Exchange 2013. It works as shown the screenshot.
However, the Exchange Admin Center shows no full backup.
Also, we have a lot old transaction logs. How to DPM clear the transaction logs?
Bob Lin, MCSE & CNE Networking, Internet, Routing, VPN Networking, Internet, Routing, VPN Troubleshooting on http://www.ChicagoTech.net How to Install and Configure Windows, VMware, Virtualization and Cisco on http://www.HowToNetworking.com

Hi,
Check the application event log for events from exchange after a DPM synchronization is complete. Make sure DPM is configured to perform FULL backups for one copy of the DB's in the DAG and not just copy only.
DPM is not responsible for truncating exchange logs. Exchange Writer tells Information Store, that backup has completed. Now Information Store using its own logic can decide which logs can be truncated. Basically IS will retrieve from passive copies
information about what is the oldest log not yet replayed to the database and will look for the Checkpoint at Log Generation in log header in this log. It will allow logs older than Checkpoint at Log
Generation to be truncated. Approximately 200 logs should remain.
See Tim’s excellent blog post on this subject:
http://blogs.technet.com/b/timmcmic/archive/2012/03/12/exchange-2010-log-truncation-and-checkpoint-at-log-creation-in-a-database-availability-group.aspx
http://blogs.technet.com/b/timmcmic/archive/2011/09/26/exchange-server-2010-and-system-center-data-protection-manager-2010.aspx#3455825
FROM: http://technet.microsoft.com/en-us/library/dd876874.aspx (exch 2013)
http://technet.microsoft.com/en-us/library/dd876874(v=exchg.141).aspx (exch 2012)
Specifically, the Microsoft Exchange Replication Service manages CRCL so that log continuity is maintained and logs are not deleted if they are still needed for replication. The Microsoft Exchange
Replication Service and the Microsoft Exchange Information Store service communicate by using remote procedure calls (RPCs) regarding which log files can be deleted.
For truncation to occur on highly available (non-lagged) mailbox database copies, the answer must be "Yes" to the following questions:
* Has the log file been backed up, or is CRCL enabled?
* Is the log file below the checkpoint?
* Do the other non-lagged copies of the database agree with deletion?
* Has the log file been inspected by all lagged copies of the database?
For truncation to occur on lagged database copies, the answer must be "Yes" to the following questions:
* Is the log file below the checkpoint?
* Is the log file older than ReplayLagTime + TruncationLagTime?
* Is the log file deleted on the active copy of the database?
Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread. Regards, Mike J. [MSFT] This
posting is provided "AS IS" with no warranties, and confers no rights.

Transaction Logs Troubleshooting

Hi,
I have recently deployed a brand new Exchange 2013 scenario for a customer and the exchange system is working well but I have found the transaction logs are growing at an extra ordinary rate and I'm struggling to troubleshoot the issue.
There are two Exchange servers in this deployment with a WAN connection between the two locations. I have also setup a DAG with a copy of the database at both locations.
The Mail flow is good users are using the system.
This issue only applies to one of the Exchange servers where the transaction logs are being created at about 1 every 5 seconds. There are only about 12 Mailboxes in each location so I see no reason for so many transactions taking place.
I have tried to locate whats causing the issue and have tried to use ExMon but this doesnt appear to work with Exchange 2013. The only bit of useful information I have found was to use this:
http://blogs.technet.com/b/exchange/archive/2012/01/31/a-script-to-troubleshoot-issues-with-exchange-activesync.aspx
where it did show there was one particular Android device that had a very high Hit count. I have asked the user to disable the device's email for the time being while I investigate further but the transaction logs are still growing.
From the same results I also see the Healthmailbox's have high hit numbers.
The script also has a line with some 55000 hits but its user is blank. What is this likely to be?
Is there a tool I can use to help me identify whats causing these logs to grow so fast?
I have installed some backup software to run every night that helps reduce the logs and also enable circular logging which I understand will help prevent running out of space on the drive.
Would really appreciate some guidance.
Thanks
Bill

Do you have any third party software AV installed on Exchange mailbox servers. If so can you disable them for a while or set exclusions for Exchange files on them.
Check the queue and see if there are any emails stuck in the queue
Just run below command to check if there are any large emails with attachment stuck in any of the users mailbox which might cause the issue
get-mailbox -ResultSize Unlimited| Get-MailboxFolderStatistics -folderscope Outbox | Sort-Object Foldersize -Descending | select-object identity,name,foldertype,itemsinfolder,@{Name="FolderSize MB";expression={$_.folderSize.toMB()}} | export-csv OutboxItems.csv
In your case most likely any third party AV might be causing this. Just disable third party AV if any and check.
Remember to mark as helpful if you find my contribution useful or as an answer if it does answer your question.That will encourage me - and others - to take time out to help you

Exchange 2010 SP3, RU5 - Massive Transaction Log File Generation

Hey All,
I am trying to figure out why 1 of our databases is generating 30k Log Files a day! The other one is generating 20K log files a day. The database does not grow in size as the log files are generated, the problem is log file generation.
I've tried running through some of the various solutions out there, reviewed message tracking logs, rpc client access logs, IIS Logs - all of which show important info, but none of which actually provide the answers.
I Stopped the following services to see if that would affect the log file generation in any way, and it has not!
MS Exchange Transport
Mail Submission
IIS (Site Stopped in IIS)
Mailbox Assistants
Content Indexing Service
With the above services stopped, I still see dozens (or more) log files generated in under 10 minutes, I also checked mailbox size reports (top 10) and found that several users mailboxes were generating item count increases for one user of
about 300, size increases for one user of about 150Mb (over the whole day).
I am not sure what else to check here? Any ideas?
Thanks,
Robert
Robert

Hmm - this sounds like an device is chewing up the logs.
If you use log parser studio, are there any stand out devices in terms of the # of hits?
And for the ExMon was that logged over a period of time? The default 60 second window normally misses a lof of stuff. Just curious!
Cheers,
Rhoderick
Microsoft Senior Exchange PFE
Blog:
http://blogs.technet.com/rmilne
Twitter:   LinkedIn:
  Facebook:
  XING:
Note: Posts are provided “AS IS” without warranty of any kind, either expressed or implied, including but not limited to the implied warranties of merchantability and/or fitness for a particular purpose.
Rhoerick,
Thanks for the response. When checking the logs the highest number of hits were the (Source) Load Balancers, Port 25 VIP. The problem i was experience was the following:
1) I kept expecting the log file generation to drop to an acceptable rate of 10~20 MB Per Minute (Max). We have a large environment and use the exchange sevrers as the mail relays for the hated Nagios monitoring environment
2) We didn't have our enterprise monitoring system watching SMTP traffic, this is being resolved.
3) I needed to look closer at the SMTP transport database counters, logs, log files and focus less on the database log generation, i did do some of that but not enough of that.
4) My troubleshooting kept getting thrown off due to the monitoring notifications seeming to be sent out in batches (or something similar) stopping the transport service for 10 ~ 15 minutes several times seemed to finally "stop the transactions logs
from growing at a psychotic rate".
5) I am re-running my data captures now that i have told the "Nagios Team" to quit killing the exchange servers, with their notifications, sometimes as much as 100+ of the same notifications for the same servers, issues. so far at a quick glance
the log file generation seems to have dropped by about 30%.
Question: What would be the best counters to review in order to "Put it all together"? Also note: our Server roles are split, MBX and CAS/HT.
Robert
Robert

WAE 512 and transaction logs problem

Hi guys,
I have a WAE 512 with ACNS 5.5.1b7 and I'm not able to export archived logs correctly. I tried to configure the WAE as below:
transaction-logs enable
transaction-logs archive interval every-day at 23:00
transaction-logs export enable
transaction-logs export interval every-day at 23:30
transaction-logs export ftp-server 10.253.8.125 cache **** .
and the WAE exported only one file of about 9 MB even if the files was stored on the WAE as you can see from the output:
Transaction log configuration:
Logging is enabled.
End user identity is visible.
File markers are disabled.
Archive interval: every-day at 23:00 local time
Maximum size of archive file: 2000000 KB
Log File format is squid.
Windows domain is not logged with the authenticated username
Exporting files to ftp servers is enabled.
File compression is disabled.
Export interval: every-day at 23:30 local time
server type username directory
10.253.8.125 ftp cache .
HTTP Caching Proxy logging to remote syslog host is disabled.
Remote syslog host is not configured.
Facility is the default "*" which is "user".
Log HTTP request authentication failures with auth server to remote syslog host.
HTTP Caching Proxy Transaction Log File Info
Working Log file - size : 96677381
age: 44278
Archive Log file - celog_213.175.3.19_20070420_210000.txt size: 125899771
Archive Log file - celog_213.175.3.19_20070422_210000.txt size: 298115568
Archive Log file - celog_213.175.3.19_20070421_210000.txt size: 111721404
I made a test and I configured the archiveng every hour from 12:00 to 15:00 and the export at 15:10, the file trasnferred by the WAE was only three one of 12:00 the other of 13:00 and 14:00 the 15:00 has been missed.
What can I do?
Thx
davide

Hi Davide,
You seem to be missing the path on the FTP server; which goes on the export command.
Disable transaction logs, then remove the export command and then add it again like this: transaction-logs export ftp-server 10.253.8.125 cache **** / ; after that enable transaction logs again and test it.
Let me know how it goes. Thanks!
Jose Quesada.

Transaction logs after large mailbox archive?

Similar Messages

Maybe you are looking for