DFS initial sync slow-down

We are setting up 3 replication groups, 1 which we are able to do over the LAN and the other 2 which need to be performed over the WAN (10mb IPSec VPN at each site).
The local data set which is 2TB replicated fine in about 2 days.
The 2 WAN data sets have exhibited strange behaviour. They start off quick, then basically hit a block and continue to replicate but very slowly (500mb-1gb/day).
The first one got up to 220gb, then slowed right down. The second one got up to 45gb, then slowed right down.
Hub: Server 2008 R2
Client: Server 2012 R2
The staging quota should be OK as I am not getting any errors in the DFSR log about hitting the high watermark.
If I look at the logs in C:\Windows\debug I constantly see this error:
+ [Error:9027(0x2343) Meet::InstallStep meet.cpp:1879 12296 C A failure was reported by the remote partner]
+ [Error:9027(0x2343) Meet::Download meet.cpp:2296 12296 C A failure was reported by the remote partner]
+ [Error:9027(0x2343) InConnection::TransportRdcGet inconnection.cpp:4423 12296 C A failure was reported by the remote partner]
+ [Error:9027(0x2343) DownstreamTransport::RdcGet downstreamtransport.cpp:5265 12296 C A failure was reported by the remote partner]
+ [Error:9027(0x2343) RpcFinalizeContext downstreamtransport.cpp:1147 12296 C A failure was reported by the remote partner]
+ [Error:9027(0x2343) DownstreamTransport::RdcGet downstreamtransport.cpp:5192 12296 C A failure was reported by the remote partner]
+ [Error:9078(0x2376) DownstreamTransport::RdcGet downstreamtransport.cpp:5192 12296 C All server file transfer contexts are currently busy]
I have had a look through http://blogs.technet.com/b/askds/archive/2007/10/05/top-10-common-causes-of-slow-replication-with-dfsr.aspx however
none of the points seem to apply.
I've noted this solution also, that also suggests possible VPN issues http://social.technet.microsoft.com/Forums/windowsserver/en-US/eeaa60c7-0480-4ae9-b367-4cb9676fabd0/dfsr-event-5014-dfs-replication-service-is-stopping-communication?forum=winserverDS -
I know it references Meraki's VPN setup (which funnily enough we are moving to shortly, but we're just using Cisco IPSec VPN right now via Cisco Routers), but perhaps that may also have some sort of idea as to what the issue may be?
I'm inclined to think though it's definitely something relating to RPC (happy to be proven wrong though!) as if I copy the same data over the WAN using robocopy or even Explorer, it can do 550gb no problems in 3 days.

Hi,
Please test to create a new replication group, create small files in folder and waiting for the initial replication to be finished.
Once it finished, try to put a large file which need to be replicated and see if it will still stopped in several GB.
Meanwhile please understand that generally we recommended to do a pre-staging with robocopy or backup-restore instead of waiting for the initial replication.
If you have any feedback on our support, please send to [email protected]

Similar Messages

DFSR Errors and Initial Sync slows down Network

Hello
I have a Windows 2012 Server (primary member-site A) where i created one Replication Group which replicates one folder with the amount of 104 GB of Data over WAN to another Windows 2012 Server (site B)
I added the Namespace-Server, created the Replication Group with 24 GB Staging quota and now it's waiting for the initial sync which slows down my network on the primary member site badly. Ping-timeouts, 6 times slower ping, i almost can not work remote.
It created the folder structure on site B, ~4GB.
If i stop the DFS-Replication service, network traffic is normal again. I also get a couple of errors in event viewer:
DFSR ID 5012 error 9026
DFSR ID 5014 error 9033
Anybody got an idea? Thanks

Hi,
Sorry for the delay in reply.
Robocopy is sometimes recommended to customers as well as Backup-Restore. For DFS initial replication, the important part is to get most files ready in the other side - it is fine to level some difference such as permission, newly updated files etc. These
difference will be updated soon with finishing initial replication.
Hope the issue was already fixed in these days!
If you have any feedback on our support, please send to [email protected]

Is DFS Initial Sync actually getting anywhere?

Hi,
The other day i had to recreate our DFS name space and replication. One of the servers is running an initial sync and has been for around a week and a half. How long is this supposed to take? Its 2tb over a 10mbps leased line so not that
fast, but it still seems like a very long time.
Is there anyway to see how far its got? if its actually progressing at least would take a load off my mind.
Thanks for the help.
David

Hi,
The other day i had to recreate our DFS name space and replication. One of the servers is running an initial sync and has been for around a week and a half. How long is this supposed to take? Its 2tb over a 10mbps leased line so not that
fast, but it still seems like a very long time.
Is there anyway to see how far its got? if its actually progressing at least would take a load off my mind.
Thanks for the help.
David
2TB over 10 Mbps?! That's insane! Use seeding for DFS to save time & money. See:
DFS Seeding with Robocopy
http://technet.microsoft.com/en-us/library/dn495044.aspx
Good luck!
StarWind VSAN [Virtual SAN] clusters Hyper-V without SAS, Fibre Channel, SMB 3.0 or iSCSI, uses Ethernet to mirror internally mounted SATA disks between hosts.

[Solved]Computer slow down and freeze during data transfer syncing

Hello,
Everytime I make a data transfer, my computer slow down, and sometimes freeze during a few seconds, work for a fraction of seconds and freeze again. I don"t understand why.
As an example, here is a bench of files i transfered during a syncing with Grsync
It took about 12h to sync 64Gb.
I've read a lot of topics talking about this problem but nothing works. I tried to switch off the SWAP and setting the vm.dirty_ratio and vm.background_dirty_ratio but nothing works.
I'm making the trasfer between two Western Digital USB 2.0 external hard drive in NTFS.
Does anyone know how to fix this?
Thanks in advance
Last edited by Neldar (2015-03-04 15:54:29)

It seems it was beacause one of my external hard drive was about to die. I performed the same operation with 2 Western Digital external hard drive 1To USB3 and it works perfectly.

Is initial sync glacially slow normal?

Moved up to a itouch 64GB from 80GB ipod classic. The initial sync with iTunes library is painfully slow. Almost deathly. Is this normal?
I'm just syncing music. No photo or video. Any way to speed it up?

It's been syncing for 3+ hours and has moved 2100 songs out of 9600 or so. At times it will zip thru 5 or 6 songs in less than 20 seconds, then spend 5 minutes for the next 5/6 songs.
Can I cancel the sync or suspend it without losing what's already been synced?. Then do the rest overnite?
Thanx for your reply.

Since downloading OS X Yosemite I have been having issues with Netflix. Video slows down which causes the audio to go out of sync. Netflix plays ok on ipad which makes me think it's the software which is the issue. Has anyone else had this issue?

Since downloading OS X Yosemite I have been having issues with Netflix. Video slows down which causes the audio to go out of sync. Netflix plays ok on ipad which makes me think it's the software which is the issue. Has anyone else had this issue?

Try this:
Go to System Preferences - Bluetooth. Delete the keyboard from the list of devices by pressing the "-" button. Take the batteries out of the keyboard and reinsert them. In Bluetooth Preferences press the '+" button to add the new device. If the keyboard begins to pair, click the word "pair" and type in the passcode. Press return. The keyboard is now paired.
If the mouse is not pairing, try this: shut down the computer completely, unplug any USB mice, then turn off the power to the bluetooth mouse. ONce the computer starts up again, wait for the pop-up looking for a mouse. Turn on the power to the bluetooth mouse. It should work normally now.

Why is TB re-syncing/re-load with GMail all messages each time I open TB? Slows down TB by much each time.

Why is TB re-syncing/re-load with GMail all messages each time I open TB?
It does slow down quite heavily. e.g. It takes almost 5 mins to just write a simple short email, since ''freezing'' at every 3-4 caracters.
All other programs on the computer work fine in the meantime, though. Including word processor. So it is really a TB issue.
Or is it a GMail issue, forcing download everytime a connection is created ?
I am on Win8.1 on an ASUS AiO.
Thanks

IMAP mail accounts see a remote view of the server.
You subscribe to see server Folders.
Headers are downloaded and when you select to view an email, the emails are downloaded to a temp cache to enable quicker access to those emails, but upon exit Thunderbird the temp cache is lost, so you cannot read emails if offline. These emails are not stored on your computer.
If you synchronise subscribed folders, then a copy of the folder is downloaded to Thunderbird Profile folder and stored in an mbox file. This means you can read them even if offline.
However, the folder is set up to synchronise with the server when changes occur, so that your copy and the folder on the server are updated to be the same.
I would recomend that you do not allow folders to get too big as it would take longer to synch.
more info on IMAP:
https://support.mozilla.org/en-US/kb/imap-synchronization
Can you see an 'All Mail' folder?
This is gmails copy of all your emails, so it is gmail Archive of your emails.
This folder can get huge. As it only shows you what you already have in other folders, it also doubles the size of your Profile and can take a while to download. It is recommended that you do not subscribe to see this folder.
Read info at link - under 'all Mail' section:
http://kb.mozillazine.org/Gmail

The initial use of firefox was really fast. Why would it slow down? Takes way too long to load a web page.

After adding bookmarks from IE it seems to have slowed down considerably.

I don't have any netflix add ons or extensions installed. I only have necessary plug ins installed. I have turned off all add ons and restarted so this issue is not related to an add on, plug in or extension. I also can rule out my dsl provider as I have hooked my pc up to other family members connections with the same provider on the same server and it did the same thing, However their pc has no issue. I have taken my pc to 3 technicians and there are no problems they can find with my registry or any infections or spyware. The PC does the same thing on their connections.All hardware passes every test they can throw at it. I have tried other browsers and reinstalling this one as well and the same thing happens. This really is mind boggling. I have ATT/uverse beta 6.0. There should be no delay in starting up my browser. After startup, it works great no problems but the speed starting up is on par with old fashioned dial up right now. I have 3 gigs of ram available and I have 85 percent capacity left on hard drive , processor speed of 3.4 with dual core processor. Makes no sense at all.

BDB Replication, sync slow

Hi,
I'm using Berkeley db with replication (high availability ).
Sometimes, it is very slow when db file is very big (maybe 4 GB).
5 slaves with 1 master, 4 is ok, but the last one very slow. (maybe 10 bytes per second)
How to fix that?
Edited by: user13554567 on 2011-6-28 上午12:27

Your reply does seem to indicate that the master is overloaded. We have several additional questions for you. I'll list them first, and then provide more explanations below.
Have you explicitly set an ack policy, and if so which one?
How do you handle log cleanup, particularly on the master?
Are you seeing the slow client when starting up the replication group for the first time or when starting up a replication group that already existed? If it is the first startup, did you specify the master as the DB_GROUP_CREATOR and then connect the other sites with DB_BOOTSTRAP_HELPER? Is every site connected to all other sites as a DB_BOOTSTRAP_HELPER?
In your first post, you said the slow client was 10 bytes per second. What was it doing when you measured that? Was it still syncing with the master? Or had its sync completed so that it was processing log records from the master?
You said that sometimes data.db is cleaned out to 0KB and sync is restarted. Can you tell us more about when you notice this happening? Had the client already completed a previous sync? Had there been any other changes to the replication group or a change of master? Had you recently cleaned up or archived log files on the master?
And just to clarify, when you see a slow client, do the other clients continue to run at the expected speed, or do the other clients slow down at that point too?
Here are some explanations:
Your ack policy affects how likely you are to see ack timeouts. It also can affect how long it takes a replication group to start up initially because internal txns to add sites to the replication group also use the ack policy.
There are a few possible explanations for data.db getting cleaned out and having the sync restart. One is that the master has changed and that client needs to sync with a new master. Another is that you have removed master log files that the slow client still needs. One way to make sure you keep all the log files needed by all the clients in your replication group is to use DB_LOG_AUTO_REMOVE (see DB_ENV->log_set_config().)
You asked about c2c (client-to-client). This is a strategy for reducing master load when many clients are syncing at the same time. You set it by specifying the DB_REPMGR_PEER flag to DB_SITE->set_config(). You need to plan your startup sequence carefully, though. A client that is going to serve other clients as a peer needs to have completed its sync before other clients can sync from it.
Paula Bingham
Oracle

Dfs initial replication

Hi,
I was wondering whether you can allow users to access the target of an initial replication while the replication is still going. If so, how will dfs cope with changes and deletions on that share? Will it use USNJournal? What's the risk of
a journal wrap destroying data if a lot of changes are made while initial replication is running?
Also, if something should go wrong with that initial replication how would one recover from that failure? I assume just rebuilding the replication group will make a huge mess in such case?
Thanks in advance for your response!
S.
MCP/MCSA/MCTS/MCITP

You might find this helpful:
http://blogs.technet.com/b/askds/archive/2007/10/05/top-10-common-causes-of-slow-replication-with-dfsr.aspx?PageIndex=15
As Ned says in #10, it's ideal to perform initial sync during a change window. As they files are changed it will likely only lead to a larger replication backlog, however the changes will be kept track of in the change journal. If initial sync
never really makes it over the mountain you may just need to increase the staging area:
http://blogs.technet.com/b/askds/archive/2011/07/13/how-to-determine-the-minimum-staging-area-dfsr-needs-for-a-replicated-folder.aspx
However, in a perfect world if we're talking about synching a lot of data it's always best to pre-seed the data from Node1 to Node2 with Robocopy or Windows Server Backup. Here's the case for pre-seeding versus not:
http://blogs.technet.com/b/askds/archive/2008/02/12/get-out-and-push-getting-the-most-out-of-dfsr-pre-staging.aspx
If, as you say, initial replication never seems to make it over the hump and adjustments to the staging area don't help, you might consider stopping replication and pre-seeding the data. This means the replication service will have less to do because
you've done all the work up front with robocopy or Windows Server Backu:.
http://blogs.technet.com/b/askds/archive/2010/09/07/replacing-dfsr-member-hardware-or-os-part-2-pre-seeding.aspx
Hope this helps clear things up a bit.

Itunes music slows down randomly during play

First, my system specs.
CPU- AMD Phenom 9850 Quad @ 2.51ghz
RAM- 2GB Adata ddr2 800
GFX- ATI 4870 Radeon pci-e 500MB
SFX- Creative X-Fi Sound card
HDD- 80Gb, 250Gb, 500Gb, all sata2. (the 500 has all my music files)
OS - Windows XP SP3 (It was doing the same thing in SP2)
Itunes version 9.0.2.25 (version upgrade didn't fix)
I have gone through and upgraded all the device drivers to be recent (in december). I've been dealing with this problem for a little over 8 months now that I can remember, and the driver upgrade didn't seem to help.
Now the problem is that itunes is what I use to listen to music since it syncs with my ipod. But, this only happens in itunes (and recently on my ipod) not in windows media player or in winamp (or media player classic if I just play one song).
It happens randomly. Some songs will play without a hitch a dozen times without a problem. Then I'll come back the next day and the song I was listening to the other day will slow down in the middle of the song. At first I thought it was distorted, but after it happened once or twice, I figured out that the song itself slows down dramatically so that the pitch is dramatically lowered. So much so that certain higher pitched long notes will sound like one long awful bass note. This will continue for a few seconds (it varies. Anywhere from one second to several seconds, up to at one point 10 seconds.)
Sometimes moving the song backwards by clicking on the progress bar will fix it. This hasn't always worked though. Some songs seem to stay distorted and only fix themselves randomly. This is especially true on the ipod, where it seems a slowed-down song stays that way indefinitely. Admittedly I don't listen to the ipod as much so I may be off on that since it happens so infrequently. Though there are songs that play slowed down every time on the ipod (there is a messhugga song that keeps doing it only on the ipod for instance).
It should be noted I don't run anything in the backround of windows. Here is a list of my task manager while running itunes.
system idle proccess
system
svchost.exe
svchost.exe
svchost.exe
svchost.exe
svchost.exe
svchost.exe
svchost.exe
spoolsv.exe
smss.exe
services.exe
lsass.exe
explorer.exe
csrss.exe
winlogon.exe
wscntfy.exe
itunes.exe
Processes: 18
I do run a game pretty often (and listen to itunes as a backround) and I do browse the internet using firefox, so add to that list WAR.EXE and firefox.exe. Whether these are up or not does not seem to matter. The songs slow down with them up and with them closed.
My 500GB HDD has 60GB of space left on it, but erasing/cleaning up the disk or defragmenting it hasn't seemed to help. My itunes library has 55.90 (8940 songs) in it. Cleaning up the library and removing excess duplicates didn't seem to fix the problem. I did move the library from the 500 to the 250, but moved it back when the same thing happened after a few days of playing music.
My RAM doesn't max out, though 2GB is a bit low these days. The WAR.EXE process uses .800-1.4gb (800,000-1,400,000k) of RAM, and the rest of the processes seem to keep well under .400gb max total. itunes stays around ~.064gb (64,984k). And remember, firefox, warhammer online, and the rest running at the same time doesn't automatically cause the slow down. And it slows down whether they are both up or neither are randomly (I listen to itunes sometimes for long periods while reading or painting). I also replaced my RAM fairly recently (other stuff went bad) but the same problem persists.
Lastly, this has happened on my ipod. The problem is that it seems permanent on the ipod, whereas the itunes on my pc will correct itself (seemingly) the ipod version will not correct itself until I sync the ipod.
I have completely removed itunes twice (as well as gotten rid of the registry entries and loose ends using CCleaner). I have deleted the itunes libraries and let itunes create brand new ones. I have upgraded to the most (at the time) recent version of itunes. The problem persists
I may be missing something. I hate using winamp and windows media player, so I haven't just stopped using itunes. But the real problem is that it is so random it's nearly impossible to test. I've tried several different methods of fixing this without tearing down itunes and re-coding it And every time, I THINK I've fixed it only to have it happen again within a week. Hence why this has been a problem for well over 8 months now. It's a small enough issue that I'm still listening to music without loads of problems, but it is a persistent, if infrequent, annoyance.
ANY help you guys can offer me would be greatly appreciated, though I'm not holding my breath since the problem is so weird. But I am willing to try anything if it might work. I can only try them out till they don't work, right?
Thanks ahead of time.
Message was edited by: Rannonzero

I'm sorry to hear about your ipod, I'm also having the same trouble but my is been going on for like a day or two. I have a nano 5th generation but all of the sudden it reseted itself it turn itself off then apple logo appeared and after that it was playing the songs like it should, mine was the same as you I'll be playing a very fast song and then it'll slow it down it was frustraded I hope this will help you. good luck to you and to me too because I only hope that I won't have the same problem later on.

Xorg-server-1.2.0-2 high load, slows down everything

I've just updated xorg-server.
After xorg started, the system is very slow... as if everything works in slowmotion. The load of X (as seen in top) is very high and slows down everything.
I've had this problem with all the beta and RC versions of xorg-server-1.2.0 that I've compiled myself. The version I'm using now from the repositories (1.2.0-2) has the same problem.
This problem happens with kernel 2.6.19-ck and 2.6.20-ck, I haven't tried other kernel versions.
Turning off EXA (that means using XAA) and/or turning off composite in xorg.conf makes X quicker (the load is also lower), but still slower than normal (with EXA, composite and xorg-server-1.1.1).
My problem is probably the same as described in http://bbs.archlinux.org/viewtopic.php?id=29661
My system:
AMD Sempron;
Ati Radeon 9500 using the open-source driver;
glibc-2.5 compiled myself;
kernel-2.6.20-ck1 compiled myself;
kde*-3.5.6 compiled myself;
xorg-server-1.2.0-2 and all the libx*, xf86*, libdrm, libgl-dri and mesa are the newest versions from the repositories.
Last edited by eric (2007-02-27 15:42:55)

Alright, downgrading wasn't the solution I was looking for, so I took the path to darkness and installed the most recent proprietary ATI drivers (8.34.8). Because the laptop has some ACPI issues I have to apply two patches which in turn require a custom kernel. Needless to say the Arch fglrx driver packages don't work with this kernel. So, here's what i did:
1) fetched the proprietary drivers from ati.com
2) run them, looked in awe at the error message
3) went here: http://cvs.archlinux.org/cgi-bin/viewcv … root=Extra and fetched the fglrx-kernel-2.6.20 patch.
4)
cd /lib/modules/fglrx/build_mod/2.6.x
make clean
rm -r .tmp_versions
cd ..
patch < /path/to/fglrx-kernel-2.6.20
./make.sh
cd ..
./make_install.sh
modinfo fglrx
modprobe fglrx
lsmod | grep fglrx
5) Use aticonfig --initial to adapt /etc/X11/xorg.conf
6) Restart X
I hope suspend is still working...

HT4863 I sent an email from my iPhone 3GS (via iCloud account) with around 16GB of attachment. It slowed down the phone for a few seconds, then appeared to be sent. However, the message is now not in the sent box, and I can't see an outbox at all. Any ide

I sent an email from my iPhone 3GS (via iCloud account) with around 16GB of attachment. It slowed down the phone for a few seconds, then appeared to be sent. However, the message is now not in the sent box, and I can't see an outbox at all. Any ideas?

That changes things a little bit , login to icloud.com and see if you can find it in your sent folder.
If it is there you did send, just need to wait until you phone syncs "sent folder" perhaps on wifi.
If it is not, then I would say it is lost and you may have to send again. They have 20 megs limit, so make sure that message plus attachment is under that limit.

System has slowed down considerably after updates from Apple. Is SyncServer the culprit?

I use MacBook with preinstalled OS Leopard since April 2009. I have also regulalry updated my computer system using the Software Update application. However, since my last update on 12th Aug 2011, I have noticed that my system has slowed down. There is long pause between every character I type, delay in switching applications, battery dries out quicker, slow response to every command.
I have started facing this problem after updating following software like iTunes 10.4, Safari 5.0.6, Migration Assistant Update for MAC OS Leopard & Quick Time 7.7 from Software Updater. Although, my OS is still leopard.
I noticed on the Activity Monitor that syncserver is using majority of my RAM and reappers even if I stop the process. Some of its subprocess like AddressBookSync also appears and consumes lot of memory. Is this the problem? Though, I never noticed earlier what size it consumed.
I use Microsoft Office suite for Mac and have also checked and deselected all sync services. Yet, the Process (PID 305) continues to appear in Activity Monitor.
I am no techie, and would appreciate quick help to resolve this issue.
Thanks!

I was just about to write the same problem, but I don't have VMware; my laptop is late 2008 was running Snow Leopard (uptodate version).
I've scientific softwares so probably would require a clean re-installation of ML. I MUST MENTION HERE that those software which were written for PPC will NOT work on ML. Just found out that one of my important softwares version won't work on ML; need $500 to upgrade that software .
Therefore, I'd also want to know how can I go back to SL.
I'll let you know how clean re-installation has worked.

Messages are in to be delivered state and slows down the message processing

Hello,
Messages are in to be delivered state and slows down the message processing.
this happenens in case of DB2 on some machine where the issue about high load on DB2 is caused by standard programming in SAP XI that executes a statement, where it uses the condition 'where 1<0' prio to the original SQL statement configured in the channel configuration,
Can you please help me out in solving this issue?
Thanks,
Soorya

Status: TO_BE_DELIVERED
Which means that the message was successfully delivered from Integration Server point of view and it states that the messages is initially handed over to the Messaging System.
TO_BE_DELIVERED occurs while the message is put into the Messaging System receive queue.
Solution:
This is done via the Messaging System receive servlet:
http://<Host>:<PORT>/MessagingSystem/receive/<CONNECTION>
/<PROTOCOL>
Only if this was executed successfully the Messaging System returns HTTP 200 to the Integration Server and the Status TO_BE_DELIVERED moves to DELIVERING
1. Try logging into Sap GUI with two users: XIAPPLUSER & XIAFUSER
to see if they are blocked
2. We can check the messages:
AdapterFramework
com.sap.aii.adapterframework.serviceuser.language
com.sap.aii.adapterframework.serviceuser.name = XIAFUSER
com.sap.aii.adapterframework.serviceuser.pwd
ApplicationSystem
com.sap.aii.applicationsystem.serviceuser.language
com.sap.aii.applicationsystem.serviceuser.name = XIAPPLUSER
com.sap.aii.applicationsystem.serviceuser.pwd
in the exchange profile to make sure the right passwords

DFS initial sync slow-down

Similar Messages

Maybe you are looking for