[fixed] rsync - not updating existing files?

I am using rsync extensively to backup various machines to a central server (all archlinux, latest versions on ext4). Yesterday I needed one of those backups, and I found out it is as good as useless, since a lot of files never got updated. Even when I enable checksumming the file is not updated. I am pretty sure I am missing something, but am not sure what it is.
The command I use:
rsync --stats --verbose -xaz --append --delete-during --delete-excluded \
--exclude=[cC]ache/ --exclude=.thumbnails --exclude=.Trash*/ --exclude=*.mp3 \
--exclude=qemu/ /home/user /etc \
backup@servername:clientname/
new files get transferred fine, and some files get updated as well. But not everything; here are some examples:
-rw-r--r-- 1 backup nobody 1445 Jan 11 2009 profile
-rw-r--r-- 1 backup nobody 618 Jan 30 2008 profile.bash
drwxr-xr-x 2 backup nobody 4096 May 5 10:38 profile.d
-rw-r--r-- 1 backup nobody 2510 Jan 11 2009 protocols
-rw------- 1 backup nobody 0 Apr 6 2008 .pwd.lock
-rw-r--r-- 1 backup nobody 3304 Feb 28 11:17 rc.conf
drwxr-xr-x 3 backup nobody 4096 May 14 09:54 rc.d
-rwxr-xr-x 1 backup nobody 109 Nov 11 2005 rc.local
-rwxr-xr-x 1 backup nobody 187 Apr 6 2008 rc.local.shutdown
-rwxr-xr-x 1 backup nobody 503 Jan 24 15:35 rc.multi
-rwxr-xr-x 1 backup nobody 3976 May 8 12:51 rc.shutdown
-rwxr-xr-x 1 backup nobody 1970 Jan 24 15:35 rc.single
-rwxr-xr-x 1 backup nobody 12872 Mar 10 2009 rc.sysinit
-rw-r--r-- 1 backup nobody 160 Mar 14 2009 resolv.conf
And this is what the client has:
-rw-r--r-- 1 root root 1419 Nov 1 2009 profile
-rw-r--r-- 1 root root 330 Oct 30 2009 profile.bash
drwxr-xr-x 2 root root 4096 May 5 10:38 profile.d
-rw-r--r-- 1 root root 2510 Feb 26 05:56 protocols
-rw------- 1 root root 0 Mar 16 2009 .pwd.lock
-rw-r--r-- 2 root root 3304 Feb 28 11:17 rc.conf
drwxr-xr-x 3 root root 4096 May 14 09:54 rc.d
-rwxr-xr-x 1 root root 96 Feb 20 15:59 rc.local
-rwxr-xr-x 1 root root 66 May 17 2008 rc.local.shutdown
-rwxr-xr-x 1 root root 503 May 8 12:51 rc.multi
-rwxr-xr-x 1 root root 3976 May 8 12:51 rc.shutdown
-rwxr-xr-x 1 root root 1913 May 8 12:51 rc.single
-rwxr-xr-x 1 root root 12256 May 8 12:51 rc.sysinit
-rw-r--r-- 2 root root 19 May 14 09:22 resolv.conf
Here is an excerpt from the logfile (filtered full log):
[sender] i=66 / etc/profile mode=0100644 len=1419 uid=0 gid=0 flags=0
[sender] i=67 / etc/profile.bash mode=0100644 len=330 uid=0 gid=0 flags=0
[sender] i=68 / etc/protocols mode=0100644 len=2510 uid=0 gid=0 flags=0
[sender] i=69 / etc/rc.conf mode=0100644 len=3304 uid=0 gid=0 flags=0
[sender] i=70 / etc/rc.local mode=0100755 len=96 uid=0 gid=0 flags=0
[sender] i=71 / etc/rc.local.shutdown mode=0100755 len=66 uid=0 gid=0 flags=0
[sender] i=72 / etc/rc.multi mode=0100755 len=503 uid=0 gid=0 flags=0
[sender] i=73 / etc/rc.shutdown mode=0100755 len=3976 uid=0 gid=0 flags=0
[sender] i=74 / etc/rc.single mode=0100755 len=1913 uid=0 gid=0 flags=0
[sender] i=75 / etc/rc.sysinit mode=0100755 len=12256 uid=0 gid=0 flags=0
[sender] i=76 / etc/resolv.conf mode=0100644 len=19 uid=0 gid=0 flags=0
[generator] i=66 2 etc/profile mode=0100644 len=1419 gid=(0) flags=400
[generator] i=67 2 etc/profile.bash mode=0100644 len=330 gid=(0) flags=400
[generator] i=68 2 etc/protocols mode=0100644 len=2510 gid=(0) flags=400
[generator] i=69 2 etc/rc.conf mode=0100644 len=3304 gid=(0) flags=400
[generator] i=70 2 etc/rc.local mode=0100755 len=96 gid=(0) flags=400
[generator] i=71 2 etc/rc.local.shutdown mode=0100755 len=66 gid=(0) flags=400
[generator] i=72 2 etc/rc.multi mode=0100755 len=503 gid=(0) flags=400
[generator] i=73 2 etc/rc.shutdown mode=0100755 len=3976 gid=(0) flags=400
[generator] i=74 2 etc/rc.single mode=0100755 len=1913 gid=(0) flags=400
[generator] i=75 2 etc/rc.sysinit mode=0100755 len=12256 gid=(0) flags=400
[generator] i=76 2 etc/resolv.conf mode=0100644 len=19 gid=(0) flags=400
[generator] i=62 0 etc/profile mode=0100644 len=1445 gid=99 flags=0
[generator] i=63 0 etc/profile.bash mode=0100644 len=618 gid=99 flags=0
[generator] i=64 0 etc/protocols mode=0100644 len=2510 gid=99 flags=0
[generator] i=65 0 etc/rc.conf mode=0100644 len=3304 gid=99 flags=0
[generator] i=66 0 etc/rc.local mode=0100755 len=109 gid=99 flags=0
[generator] i=67 0 etc/rc.local.shutdown mode=0100755 len=187 gid=99 flags=0
[generator] i=68 0 etc/rc.multi mode=0100755 len=503 gid=99 flags=0
[generator] i=69 0 etc/rc.shutdown mode=0100755 len=3976 gid=99 flags=0
[generator] i=70 0 etc/rc.single mode=0100755 len=1970 gid=99 flags=0
[generator] i=71 0 etc/rc.sysinit mode=0100755 len=12872 gid=99 flags=0
[generator] i=72 0 etc/resolv.conf mode=0100644 len=160 gid=99 flags=0
obviously I can remove everything on the server-side, but I'd rather like to know what causes this problem.
Last edited by Spider.007 (2010-05-16 11:37:09)

Okay, the solution was pretty simple, I was using --append, but that is only meant for files that you know will increase in size. Since that isn't the case when backup up /etc/, that flag isn't very useful.

Similar Messages

  • Itunes is not updating my files

    I just moved my entire library onto an external drive, but now I hav to reassociate all of it again and itunes is not updating the files with the multimedia info. Could somebody help me fix this?

    Yes but I did it after i moved the files. Now what i did was to create anew library since the old one was still showing missing all the songs.. tks

  • IWork apps not updating iCloud files automatically

    My iWork apps (pages, keynote, numbers) on my MacBook Pro quit updating iCloud files automatically.  Also the apps will not show files created or updated on my iPhone or iPad automatically.  If I restart or shut down my MacBook Pro, then the iCloud files are updated at the launch of the iWork app.  The iWork apps were updating the iCloud files antomatically until two days ago.  I am looking for suggestions on how to get the automatic iCloud file update feature working again.

    Yes I am using Mountian Lion.  Automatic syncing was working great up to about 2 days ago.  Then it just quit.  I could turn the mac off and back on and it would sync, but still would not automatically.  None of my troubleshooting tricks fixed the issue.  Finally I reinstalled Mountian Lion and now the iWorks apps are syncing.  I still don't the know the reason for the issue, but a complete start over solved the issue for now.  Thanks for your comments.

  • Why does Illustrator CC2014 write temporary files instead of updating existing file?

    Illustrator CC 2014 (Win) keeps saving temporary files rather than overwriting an existing file. This results in illustrations not showing as updated in InDesign. The only way round it is to use the Save As command — and that doesn't always work! Also, upon closing a window tab, it frequently changes text in the illustration to default Myriad Pro, without any input from me. I have to undo text changes to make it revert to the intended font.
    I've worked with every version of Illustrator since version 5.0 and this is the first time I've experienced such an apparent glitch. Any ideas why this should be happening top me?
    Nick
    Using: Adobe Creative Suite - Windows 7 Ultimate

    As explained before, when closing a tab, an open *.eps file suddenly acquires the changed asterisk, and when I go that tab it says under Edit "Undo Type Style". Yet, I can't see any change, even when I toggle between "Undo" and "Redo". also, under "Find Font", I can't find any other font other than the branded Interstate font, even though the current font selection window shows Myriad Pro.
    So, on to some serious detective work. I remembered back from the old days that *.eps files can be opened (and manipulated!) using Notepad.
    I saved the file (Figure 8) which said a change had taken place and compared that file with the original by opening in Notepad, copying and pasting into Word and using the latter's compare function. Obviously there are pages and pages to look through, but then I had a Eureka moment! This was what I found:
    dup /FontName get exch definefont pop
    end
    %ADOEndSubsetFont
    /COGQMXCOGQMV+XXXXXXInterstate-Light /XXXXXXInterstate-Light findfont ct_VMDictPut
    /COGQMXCOGQMV+XXXXXXInterstate-Light*1
    [32{/.notdef}rp /space 13{/.notdef}rp /period /.notdef /zero /one /two
    /.notdef /four 3{/.notdef}rp /eight /.notdef /colon /semicolon 9{/.notdef}rp
    /E /F 2{/.notdef}rp /I 9{/.notdef}rp /S /T 12{/.notdef}rp
    /a /b /c /d /e /f /g /h
    /i 2{/.notdef}rp /l /m /n /o /p /.notdef
    /r /s /t /u 138{/.notdef}rp]
    COGQMXCOGQMV+XXXXXXXInterstate-Light nf
    COGQMXCOGQMV+XXXXXXXInterstate-Light*1 [8.8569 0 0 -9 0 0 ]msf
    3.25928 10.4355 mo
    (Figure 8)
    I have used the XXXXXX to protect my client's anonymity, but the crossed out coding "/COGQMX" is to be found in the unchanged file, and the COGQMV in the changed file!
    Although I have described this as a Eureka moment, I actually don't understand the problem, but I feel I have narrowed it down and Mike is right — it IS a font issue!!

  • How fix Organizer not updating w/"Save As" from Editor?

    After upgrading frm Windows XP to Windows 7, my Elements Organizer - in "Folder Location" mode is not updating with ANY changes frm Editor. I'm checking "include in the Elements Organizer" on SAVE OPTIONS.  Changed file names are updating to the physical file.  In effect the Editor is NOT Working.

    Hi,
    The Catalog is a database used by the Organizer to index you Images. The catalog only contains pointers to your images not physical copies of them.
    The physical files stay where you put them and, if you use the Organizer, you should NOT rename the files or move them outside of the organizer otherwise you will get missing file messages.
    I would normally import my images into the organizer, select the one I want to edit and the go to the Fix menu. This loads the image into the Editor, After editing the image I would close the image and/or the editor and get asked if I want to save the image. It usually offers an alternative name.
    When you use the Save As it should still show up in the organizer.
    Do you have Save in Version Set checked? - If so, the new image maybe stacked with the original. You need to expand the stack by clicking on the little arrow - that should show both.
    Do you save it in the same folder as the original?
    There has been various reports of the Folder View being wrong but it is normally corrected by using F5 or reloading the organizer. The folder view was revamped in Elements 11.
    Hope that helps
    Brian

  • ITunes not updating audio files on iPhone 4s

    On Mac 10.7.2, iTunes 10.5.1, and iOS 5.0.1. I have made changes to the genre of a few of my audio files but they are not updating on iTunes. iTunes appears to go through the entire process of syncing but no changes are made. I'm assuming I'm not the only one this has happened to so are there any known solutions?
    Thanks!

    oh no!! try doing a reset

  • Dreamweaver Template files not updating other files

    I took over a website and the site uses Dreamweaver Templates.  I'm not too familiar with the way that Templates works.  Anyway, the nav (links at bottom of website) need to be updated.  I updated the secondary.dwt file within the Templates folder.  I uploaded it, but it's not updating the pages on the website that use this template file.  Please help! 

    When you update the template from within DW, you should get a dialog asking if you want to update all of the files that use the template. When you click "OK" everything is updated across the site.
    If you updated the template outside of the defined site, it won't update anything and you may have a bit of work on your hands.
    In DW, you should have a Files tab with a drop down menu. The drop down menu should have all of your defined sites. Choose the site you are working on and a list of the files in that site will appear. Choose the template and make your changes and it will ask if you want to update everything else.

  • Template not updating online files

    I use one template for 62 files which I have already
    uploaded. I made a change to the template which updated my files
    offline but do I have to re-upload all these files again? When I
    just upload the template, none of the other files online
    automatically updated. This is my first use of templates and I
    assumed that if you modify the template then the change will carry
    over to each associated file that already resides on the server
    which would be great. What should I do to keep from having to
    re-upload each file after I make a change to the template?
    Thanks, Steve

    >>do I have to re-upload all these files again?
    Yup. That's hw Templates work.
    >>What should I do to keep from having to re-upload
    each file after I make a
    >>change to
    >> the template?
    Nothing you can do, again it's just how Templates work. You
    can however read
    about server side includes (ssi) in DW Help and other places
    (Google) and
    use them to replace some pieces of your Template. For example
    put your menu
    (navigation) in an Include file. Change just that file when
    you need to
    modify your menu. Then upload just that Include file and it
    will be (what
    else?) *included* in all your pages.
    Walt
    "tannermark" <[email protected]> wrote in
    message
    news:gc36cs$r8j$[email protected]..
    >I use one template for 62 files which I have already
    uploaded. I made a
    >change
    > to the template which updated my files offline but do I
    have to re-upload
    > all
    > these files again? When I just upload the template, none
    of the other
    > files
    > online automatically updated. This is my first use of
    templates and I
    > assumed
    > that if you modify the template then the change will
    carry over to each
    > associated file that already resides on the server which
    would be great.
    > What
    > should I do to keep from having to re-upload each file
    after I make a
    > change to
    > the template?
    >
    > Thanks, Steve
    >

  • Finder Content not updating with files on SMB mount

    I have Mountain Lion 10.8.2 on a Mac Mini.  I work in Adobe Lightroom 4 and Photshop CS6 with files hosted on a PC running Windows 7 Ultimate, and access these files via an SMB mount on the Mac.  Both machines are up-to-date on their respective updates.
    This worked fine up til recently, when I started noticing Finder contents don't necessarily update when the files change on the SMB-mounted filesystem.  For example, if I create a new file, say, using Photoshop, and save the file, then try to see the file in Finder  (so I can copy it to another location), the file doesn't show up.  Force-quitting Finder & restarting it causes the new file to appear, but this is a temporary fix, as the problem sometimes recurs again when I create more new files.
    It seems like this problem appeared after the 10.8.2 update, as I never noticed it with earlier releases.  Have any of you seen this?  I do my SMB mounts via the "Connect to Server (CMD-K)" dialog.  Would I be better off mounting it from the command line with some specific options?
    Thanks in advance...

    Try deleting this file: com.apple.sidebarlists.plist
    /Users/YourName/Library/Preferences. Drag that file from the Preferences folder to the Trash, empty the Trash and reboot. See if that helps...
    Seems to me that Adobe is very picky about where the files are kept on the hard drive. You might not want them in the Sidebar. Whenever you do an Adobe software update, the installer needs the path to where those files go. If it's missing in action, it can wreak havoc.
    Make sure when you do Adobe updates, if there is a link included or a Read Me file, check that out first before installing anything.
    Run Disk Utility and Repair Disk Permissions BEFORE and AFTER any software updates:
    Launch Disk Utility. Select MacintoshHD in the panel on the left, select FirstAid, then click: Repair Disk Permissions. Quit DU when it's finished and reboot.
    Carolyn

  • Finder not updating copied files

    When I copy a file to a different folder, Finder does not show it. If I try to recopy, it says the file already exists there.
    Thanks in advance.
    -Mike
    ironmancurtis.com

    Yeah seem to be having the same problem with Finder updating as well.
    I deleted a few of the files in my download folder and all the files disappeared. Yet only the properly deleted files appeared in the Trash. I browsed back to the dowload folder and one thing had reappeared, then all the others suddenly appeared out of nowhere while I was looking at the folder.
    Very strange.

  • Can't not update existing record filter value in java sdk.

    Hi,
    If there is existing record filter, such as " {table.a_field} = {?paramA}"
    Then can't update it to other value. e.g " {table.a_field} = value_A"
    The flow is
    1. Update paramA value
    2. Update record filter value
    Java code
    public void setRecordFilter(ReportClientDocument clientDoc, String filter)
         try
           IFilter iFilter = clientDoc.getDataDefController().getDataDefinition().getRecordFilter();
           iFilter.setFreeEditingText(filter);
           clientDoc.getDataDefController().getRecordFilterController().modify(iFilter);
         catch (ReportSDKException e)
             throw new Error("Couldn't set RecordFilter " + e.getMessage());
    if exsiting filter is empty then "setRecordFilter" works.
    Do you know why? and any idea to update reocord filter if the existing one like "{table.a_field} = {?paramA}"
    Thanks
    Forest

    Hi,
    In uploading of flat file , If you are able to capture the changes to the previously loaded records, Then you can follow the additve delta. So it decreases the time of uploading .Only changed or new records will be uploaded every time.
    If you are not able capture the changes in flat file ,Every time you have to do full upload ,Before this delete the contents of Infocube. (Assuming there is no ODS B/W Infocube and Flat file).
    With rgds,
    Anil Kumar Sharma. P

  • Templates Not Updating .ASPX Files in Dreamweaver CC

    I have website based on .ASPX pages. I have successfully used templates (.DWTs) to update .ASPX pages page in Dreamweaver versions through CS6. I installed CC and updating the templates no longer seems to update .ASPX pages. It seems I have to open each .ASPX page in the site and choose Modify > Template > Update Current Page and then save the page. Is there a better way to update the pages in the .ASPX website?
    I originally posted this in the "Develop server-side applications in Dreamweaver" form, but it was suggested that this would be a better place to post it.

    I decided, after the New Year, to migrate my clients (I support 75 websites) from Microsoft Expression Web to Dreamweaver. I bought the latest version (CC) and started my first migration of an Expression DWT to Dreamweaver. I should not have picked a site with 125 pages. I cannot believe that when I change a DWT the changes are not cascaded to the 125 linked ASPX pages. With Microsoft dropping Expression support, where in the world are we supposed to turn for a really good, modern, design platform. I'm calling Adobe to terminate my subscription as this simply will not work. I downloaded the installed the Extension Manager, installed and enabled the .ZXP files for ASP support and it still doesn't work. Really, seriously, disappointed. I was really looking forward to learning this new platform, but I'll have to stay with Microsoft Expression for now...

  • BAPI_PO_CHANGE not updating existing condition type value.

    Hi,
    I am using 'BAPI_PO_CHANGE' to update the existing condition records.
              MOVE-CORRESPONDING wa_pocond_40 TO gt_pocond_40.
              gt_pocond_40-change_id = 'U'.
              gt_pocond_40-cond_value = '20'.
              gt_pocondx_40-itm_number = <fs_pocond_41_new>-itm_number.
              gt_pocondx_40-cond_st_no  = <fs_pocond_41_new>-cond_st_no.
              gt_pocondx_40-itm_numberx = 'X'.
              gt_pocondx_40-cond_st_nox = 'X'.
              gt_pocondx_40-cond_type = 'X'.
              gt_pocondx_40-cond_value = 'X'.
              gt_pocondx_40-currency = 'X'.
              gt_pocondx_40-change_id = 'X'.
              MODIFY gt_pocond_40 INDEX sy-tabix.
              APPEND gt_pocondx_40.
    I am using 'BAPI_TRANSACTION_COMMIT' also.
    Still, the condition value is not changing.
    what and where do u think is the problem?
    Kindly assist.
    Thanks.

    check the following link
    http://www.sap-img.com/abap/sample-abap-code-on-bapi-po-change.htm

  • Finder not updating when files change

    I’ve started experiencing a really irritating problem whereby the Finder does not automatically update the view of a directory when I save a file in it. It seems to ignore all file system changes.
    This never used to happen. In fact, when I first installed Leopard I was very impressed at how instantly file system changes were reflected in Finder windows.
    Looking at some of the other threads here I tried relaunching Finder to see if that made a difference. However, attempting to relaunch Finder causes it to ‘exit’ and not restart. If I do "ps ax | grep Finder", I get this line:
    486 ?? E 0:00.00 (Finder)
    The process will not exit, even if I try to “kill -9” it.
    Sometimes rebooting solves the problem.

    Yeah seem to be having the same problem with Finder updating as well.
    I deleted a few of the files in my download folder and all the files disappeared. Yet only the properly deleted files appeared in the Trash. I browsed back to the dowload folder and one thing had reappeared, then all the others suddenly appeared out of nowhere while I was looking at the folder.
    Very strange.

  • Not updating xmp files

    For some reason my Lightroom has stopped writing to the *.xmp files for changes I have made. How can I correct that?

    Thanks I had already made that change and noted the files were being updated, but yesterday I updated about 100 files and none of them came across to the xmp file.  Not sure why.  I rebooted my computer and it seems fine now.  Thanks for your quick response it does seem to be working correctly now.

Maybe you are looking for

  • Two forms on same page..save state of one form while submitting other.

    Hi.... I have 2 form on same page.... first is form on table.... nd another is tabular form..... now if I make an entry in both table ,,,,and after entering data in tabular form if click on submit button of tabular for the data of tabular form get su

  • Users and Group in OBIEE 11g

    Hi, I am trying to bind LDAP with OBIEE 11G. I am using following Rittman Blog http://www.rittmanmead.com/2010/11/oracle-bi-ee-11g-security-integration-with-microsoft-active-directory/ whenever i click USERs and GROUPs it takes a hell of time(more th

  • Problem in creating queue in Oracle9i Enterprise Edition Release 9.0.1.0.0

    Hi, I am facing a problem in creating queue using DBMS_AQADM.CREATE_QUEUE_TABLE, in Oracle 9i. Have given the following command DBMS_AQADM.CREATE_QUEUE_TABLE ( queue_table=>'ORA_TRIG_TOPIC_TAB', queue_payload_type=> 'SYS.AQ$_JMS_TEXT_MESSAGE', storag

  • Mouse not working on start-up.

    Hi, I've just bought a used powerbook, which seems mostly fine. However, when I boot up and the sign in screen comes up, the mouse is not working. If I remove and refit the usb plug, it then works. It seems like the usb is not being scanned. Anyone h

  • Online training available for BI-IP

    Hello, I am a SEM-BPS consultant and need to get up to speed on BI-IP, is there any online training available for SEM-BCS or BI-IP ? Regards Fiona