Rsync - to compare remote directories

Hi Friends,
I did use the below syntax to compare remote directories , but it listed all the files in the source directories even if the files are same as in the target directory.
rsync -avn -e 'ssh -l target user' target:path path
Thanks,
Revathi

The files might be the same, but do the permissions and ownerships match? rsync's "-a" option checks for these, too; "-a" is the "archive mode" and equals to "-rlptgoD" (where "-p", "-t" and "-o" preserve permissions, time stamps and ownerships).
BTW, the "-e ssh" option might not be necessary. Recent versions of rsync default to ssh anyway. You can use "user@target:path" instead.
Edited by: Lenz Grimmer on Jun 7, 2011 1:16 AM

Similar Messages

My manager request me to compare between (Directories, initialization param

hi,
my manager request me to compare between (Directories, initialization parameters, roles, profiles, tablespaces, users, redo logs) different databases by using SQL command line ( built-in package) not by tool ( Toad , ... )
regards.
Edited by: user13364155 on Mar 7, 2011 7:37 AM

You have plenty of answers already in Re: Comparing Two DBs

Jfilechooser on remote directories

Hi guy's I wish to create a java swing applet to use the jfilechooser to browse the directory structure of a remote server. what is the best way of going aboput doing this?
thanks in advance
Danny

Back when there was only SunOS (Solaris 1 as it's known now), when my C program needed to display a directory contents, I would simply do a system call to "ls -lt" and pipe the output to a file or something that I can read. But after having taken a cursory look at the source code for the JFileChooser class in JDK1.3.1, my suggestion would not work....I do not believe the bottleneck is in JFileChooser -- it's simply the sheer size of the list that is causing the problem.
Of course if the only thing you are using the JFileChooser for is to list the contents of that humongous directory, you can use the trick that I mention but instead of using JFileChooser, put the list in a list box that the user can do the selection from.
:o(
V.V.

Webserver remote directories issues

We have netware 65sp5/sp6 in production on a multicontainer network. I
have configured Apache to allow user webpages to be served from their home
directory/PUBLIC_HTML. This works great on three containers, but the 4th
refuses. Logs show it not parsing accounts on that system for the proper
directory, instead looking to the actual WWW server and of course failing.
We HAVE discovered a user key that is not on accounts setup prior to the
NW6x upgrades is critical to this technique working, but I have assured
myself that the test users in each context are setup similarly... Now,
this containers server experienced a failure a few months back and we had
to restore and rebuild from scratch.
It is my assumption there is some deep access configuration that is
different with this server and not the others, but I cannot find it.. How
do I make sure the homedir is being searched properly and how do I debug
things at this level when the normal logfiles don't give us any real
detail. The users do have all normal access (i.e., Groupwise, data
directories, etc.)
Your advice would be greatly appreciated.
MJK

Update to debugging...
Tried replacing the mod_edir.c with the latest and greatest... Now, when I
try to go to the unreachable server for the users home dir, it will kill
the main www page... Very odd... Only way to get it back is to issue
AP2WEBDN & AP2WEBUP.
MJK

Compare directories on separate workstations

I am having a terrible time trying to come up with a way to compare two directories stored on separate computers. Any tips would be greatly appreciated.
A little background: I am writing an rmi application that provides file sharing an backups of music, videos pictures, etc. The problem is I want to compare a directory on the client machine against a directory on the server so that I can display what is missing in a JTree. I created a class that takes two files as arguments and creates tree nodes from them that are color coordinated. This works great as long as I run the client and server on the same machine. I didn't realize that I couldn't pass the directory stored on the client machine as a "File" to the server and have all the subdirectories intact.
I assume I will have to come up with some way of representing the directory and all is subdirectories in some way that I can pass to the server. However I am at a loss at this point. Maybe an XML representation of the directory? Any suggestions would be appreciated.
Thanks in advance,
Dan

Hi fromhereon,
If you're using RMI, you can manage the client sending a simple list of the files(an array of String) present in his directory and you compare its content with the directory content on the server side. IMO, there's no need to jam the application with XML files which need to be build, parsed or validated.

Cloning a Mac OS X Server to a remote location

Scenario: A Mac Mini running Mac OS X Server is in location A and a second Mac Mini running Mac OS X Server is to be acquired and setup at a remote location.
Desire: Do a nightly backup of Server A to the second Mac Mini so that Server B is a bootable clone of the primary server.
Question: What is the best software/approach to do this?
Discussion: I'm familiar with and use SuperDuper, Synchronize Pro and Carbon Copy Cloner for performing file by file backups and synchronization where the hard drives are on the same server ... but I'm not sure if any of these are the best alternative to backup a MAMP Pro installation on the Server (along with other applications and data) to a remote server box.
I realize that particularly within the Moodle VLE (that will be running on the servers) that absolute links will still point to the primary server but that is not an issue for me. In the event of a catastrophic failure of Server A at least there would be an offsite clone that could be accessed if a few settings were changed.
BTW: Server A is hosted by a commercial hosting service and no backup drive is available on-site for a file x file backup/synchronization. We do have full access to the server via ARD, Timbuktu Pro, AFP, etc.

Can you expand your info on the use of these two approaches, particularly the mysql replication
Well, my approach requires that there's some kind of connectivity between the two machines - preferably a VPN network to secure the traffic, but it doesn't have to be done that way.
rsync essentially takes two directories - one local and one remote - and compares the differences. Depending on the switches you use it will copy the changes from one system to the other (or both if that's what you prefer). In this case I'd set it to copy the local web directory to the remote machine, so the remote machine has a copy of all the files.
rsync works best for static files (e.g. .html, .php, etc. in the case of a web application), but shouldn't be used for dynamic files such as your database files.
As for the data, MySQL has substantial built-in replication routines that are designed to keep multiple database servers in sync. There's far more to it than I can go into here, suffice to say it can maintain a real-time copy of your data on a second, remote machine, and you should read the documentation for the specifics.

REG:Error in rsync

Hi,
When im moving files from one server to another server using rsync command,
(i.e) rsync -av -e ssh /pix/cvs_bak_local [email protected]:/cvs_new_bkp
Here using this command the following errors are coming,how to clear this.please help me.
Error:
@ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that the RSA host key has just been changed.
The fingerprint for the RSA key sent by the remote host is
65:29:63:ad:9c:28:ac:95:91:b9:40:27:23:34:ac:bd.
Please contact your system administrator.
Add correct host key in /root/.ssh/known_hosts to get rid of this message.
Offending key in /root/.ssh/known_hosts:1
RSA host key for 117.19.1.11 has changed and you have requested strict checking.
Host key verification failed.
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(359)
[root@drapps /]# @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @
-bash: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@: command not found
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that the RSA host key has just been changed.

Hi user;
Please check below and compare your command wiht it
http://www.cyberciti.biz/tips/linux-use-rsync-transfer-mirror-files-directories.html
Also check:
rsync: connection unexpectedly closed (0 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(359)http://samba.anu.edu.au/rsync/FAQ.html
http://lists.samba.org/archive/rsync/2006-May/015360.html
PS:I suggest move your issue other forum part, i belive You could get more quick help on Forum Home » Infrastructure » Linux (non-OEL)
Regard
Helios

Comparing files in two folders to find duplicates using part of file name

I'm not sure if this is something Automator or perhaps Terminal can do, hoping someone might be able to offer guidance or suggestions.
I have two folders filled with files of photographs.
First folder has approx 15,000 files.
Second folder has approx 1,200 files.
I need to compare the files in the two folders and remove duplicates from the First folder. In other words, the 1,200 files in the Second folder are also in the First folder and they need to be removed from the First folder, leaving 15,000 - 1,200 = 13,800 files in the First folder.
To add a wrinkle to the comparison (nothing is ever that easy), the file names are consistent between folders for the first 17 characters (files follow the format of my name_6 digit date_4 digit # sequence, ie nickB0904087110.jpg) but in the Second folder, the files will have an additional tag added to the file name (ie nickB090408_7110Final.jpg).
Any suggestions or help much appreciated!
nick

Old post, sorry, but for the sake of trying to answer it:
The method described here can accomplish the goal, as I understand it.
http://texo.wordpress.com/2009/08/17/comparing-large-directories-fast-in-osx-or- linux/
rsync -rvn --delete /FirstDirectory /SecondDirectory
(He describes: The 'n' flag is a 'dry-run'; remove it and the files will be copied. And '--delete' deletes any files NOT in the FirstDirectory.)
I found I needed to put slashes at the end of the directory name too. ... /Directory1/ /Directory2/
That way it seems to compare those actual folders. Without the slashes, it just put a copy of Directory1 into Directory2. I'm sure there's something I don't understand about rsync though.

Directory RSync help with a twist..

I wish to sync two directories of multiple folders and files (mp3s). Using rsync I have managed to create one master set of directories from the original two...but with unwanted duplicates
If a number of files are identical (jazz.mp3, rock.mp3 etc.) but are located in different directories in both locations, how can avoid/exclude copying them across and therefore creating duplicates of the files.
e.g. /new/jazz.mp3
and /old/jazzfiles/jazz.mp3
using rsync -r /old /new
would result in two directories in /new
/new/jazz.mp3
and /new/old/jazzfiles/jazz.mp3
If someone understands what I am getting at...any pointers much appreciated.
Joel.

I'm not certain, but it sounds like you should to look at rsync's --compare-dest switch:
--compare-dest=DIR
This option instructs rsync to use DIR on the destination
machine as an additional hierarchy to compare destination files
against doing transfers (if the files are missing in the desti-
nation directory). If a file is found in DIR that is identical
to the sender's file, the file will NOT be transferred to the
destination directory. This is useful for creating a sparse
backup of just files that have changed from an earlier backup.
so something like:
rsync -r -compare-dest=/new/jazzfiles /old /new
The command specifically references destination directories, though, but it sounds like you want to compare multiple source directories. I have no idea off hand whether the above still applies.

Spry Tab Panel is not working properly on remote server

Hello All,
I have a problem with spry tab panel, it is not displaying image in the background when it is active, it is working properly in local server but when i upload to remote it vanishes.
Here is the link
http://www.geftas.com/temaritestpage/about.html
Also I am uploading Css and html code below
Any help would be exteremely appreciated.
Thanks
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="content-type" content="text/html; charset=utf8"/>
<meta http-equiv="content-type" content="cache" />
<meta http-equiv="robots" content="INDEX,FOLLOW" />
<meta http-equiv="keywords" content="Enter Keywords"/>
<meta http-equiv="description" content="Description Here" />
<title>TEMARI&CO. | Business Strategists</title>
<link href="css/about.css" rel="stylesheet" type="text/css" media="screen" />
<script src="SpryAssets/SpryMenuBar.js" type="text/javascript"></script>
<script src="SpryAssets/SpryTabbedPanels.js" type="text/javascript"></script>
<link href="SpryAssets/SpryMenuBarHorizontal.css" rel="stylesheet" type="text/css" />
<link href="SpryAssets/SpryTabbedPanels.css" rel="stylesheet" type="text/css" />
</head>
<body>
<div id="wrapper">
          <div id="header"></div>
<div id="navigation">
    <ul id="MenuBar1" class="MenuBarHorizontal">
      <li><a href="index.html">HOME</a></li>
      <li><a href="about.html" class="current">ABOUT</a></li>
      <li><a href="#" class="MenuBarItemSubmenu">CONSULTING</a>
        <ul>
          <li><a href="#">Business Plan</a></li>
          <li><a href="#">Marketing Plan</a></li>
          <li><a href="#">Incorporation</a></li>
          <li><a href="#">Accounting System</a></li>
        </ul>
      </li>
      <li><a href="#" class="MenuBarItemSubmenu">INDUSTRIES</a>
        <ul>
          <li><a href="#">Untitled Item</a></li>
          <li><a href="#">Untitled Item</a></li>
          <li><a href="#">Untitled Item</a></li>
          <li><a href="#">Untitled Item</a></li>
        </ul>
      </li>
      <li><a href="#">OUR PROCESS</a></li>
      <li><a href="#">CAREERS</a>      </li>
      <li><a href="#">CONTACT</a></li>
    </ul>
</div>
<div class="shadow" id="content">
<div id="TabbedPanels1" class="TabbedPanels">
    <ul class="TabbedPanelsTabGroup">
      <li class="TabbedPanelsTab" tabindex="0">values</li>
      <li class="TabbedPanelsTab" tabindex="0">people</li>
    </ul>
    <div class="TabbedPanelsContentGroup">
      <div class="TabbedPanelsContent">
                <div id="scrolltext">
                    <h1>Heading1</h1>
        <p>Lorem ipsum dolor sit amet, consectetuer adipiscing elit. Aenean commodo ligula eget dolor. Aenean massa. Cum sociis natoque penatibus et magnis dis parturient montes, nascetur ridiculus mus. Donec quam felis, ultricies nec, pellentesque eu, pretium quis, sem. N</p>
        </div>
      </div>
      <div class="TabbedPanelsContent">
                  <div id="scrolltext">
                    <h1>Heading1</h1>
        <p>Lorem n, </p>
                            <h1>Heading1</h1>
        <p>Lorem ipsum dolor sit amet, , </p>
                           <h1>Heading1</h1>
        <p>Lorem ipsum dolor sit a, </p>
                           <h1>Heading1</h1>
        <p>Lorem ipsum dolor sit amet, </p>
        </div>
      </div>
    </div>
</div>
</div>
<div id="footer">
<div id="legal">
                      <ul>
                          <li>Copyright © 2012 Temari&Co</li>
                    <li>| Privacy Policy |</li>
                    <li>Terms of Use</li>
                </ul>
    </div>
            <div id="socialmedia">
                      <ul>
                          <li><img src="images/fbicongri.png" width="20" height="20" alt="fbicon" /></li>
                    <li><img src="images/gicongri.png" width="20"          height="20" alt="gicon"/></li>
                    <li><img src="images/linkedinicongri.png" width="20" height="20" alt="linkedin"/></li>
                    <li><img src="images/twittericongri.png" width="20" height="20" alt="twitter"/></li>
              </ul>
      </div>
</div>
</div>
<script type="text/javascript">
var MenuBar1 = new Spry.Widget.MenuBar("MenuBar1", {imgDown:"SpryAssets/SpryMenuBarDownHover.gif", imgRight:"SpryAssets/SpryMenuBarRightHover.gif"});
var TabbedPanels1 = new Spry.Widget.TabbedPanels("TabbedPanels1");
</script>
</body>
</html>
@charset "UTF-8";
/* SpryTabbedPanels.css - version 0.6 - Spry Pre-Release 1.6.1 */
/* Copyright (c) 2006. Adobe Systems Incorporated. All rights reserved. */
/* Horizontal Tabbed Panels
* The default style for a TabbedPanels widget places all tab buttons
* (left aligned) above the content panel.
.TabbedPanels {
          overflow: hidden;
          margin: 0px;
          padding: 0px;
          clear: none;
          width: 100%;
          height:100%; /* IE Hack to force proper layout when preceded by a paragraph. (hasLayout Bug)*/
.TabbedPanelsTabGroup {
          margin: 0px;
          padding: 0px;
.TabbedPanelsTab {
          position: relative;
          float: left;
          background-color: #FFF;
          list-style: none;
          -moz-user-select: none;
          -khtml-user-select: none;
          cursor: pointer;
          font-family: Arial, Helvetica, sans-serif;
          font-size: 9pt;
          font-weight: normal;
          color: #666;
          height: 30px;
          width: 116px;
          text-transform: uppercase;
          text-align: center;
          line-height: 30px;
          margin: 0px;
          padding: 0px;
.TabbedPanelsTabHover {
          background-image: url(../../SUPEROLDU/images/menubaractive.png);
          background-repeat: repeat-x;
          color: #FFF;
.TabbedPanelsTabSelected {
          background-image: url(../../SUPEROLDU/images/menubaractive.png);
          background-repeat: repeat-x;
          color: #FFF;
          height: 30px;
          width: 116px;
.TabbedPanelsTab a {
          color: black;
          text-decoration: none;
.TabbedPanelsContentGroup {
          clear: both;
          background-color: #FFF;
          height: 100%;
          width: 824px;
          font-family: Arial, Helvetica, sans-serif;
          font-size: 9pt;
          color: #666;
          border-top-width: 1px;
          border-right-width: 1px;
          border-bottom-width: 1px;
          border-left-width: 1px;
          border-top-style: dotted;
          border-top-color: #CCC;
          border-right-color: #CCC;
          border-bottom-color: #CCC;
          border-left-color: #CCC;
.TabbedPanelsContent {
          height: 100%;
          width: 100%;
          overflow:hidden;
.TabbedPanelsContentVisible {
.VTabbedPanels {
          overflow: hidden;
          zoom: 1;
.VTabbedPanels .TabbedPanelsTabGroup {
          float: left;
          background-color: #EEE;
          position: relative;
.VTabbedPanels .TabbedPanelsTab {
          float: none;
          margin: 0px;
          border-top: none;
          border-left: none;
          border-right: none;
.VTabbedPanels .TabbedPanelsTabSelected {
          background-color: #EEE;
.VTabbedPanels .TabbedPanelsContentGroup {
          clear: none;
/* Styles for Printing */
@media print {
.TabbedPanels {
          overflow: visible !important;
.TabbedPanelsContentGroup {
          display: block !important;
          overflow: visible !important;
          height: auto !important;
          margin-top: 0px;
          margin-right: auto;
          margin-bottom: 0px;
          margin-left: auto;
.TabbedPanelsContent {
          clear:both !important;
          margin-top: 0px;
          margin-right: auto;
          margin-bottom: 0px;
          margin-left: auto;
          width: 744px;
.TabbedPanelsTab {
           overflow: visible !important;
           display: block !important;
           clear:both !important;

Hi
Please Upload SpryTabbed Panels.css and menubaractive.png to their respective remote directories/folders.
The images have not been uploaded at all, the online CSS is the one without a link to the images
Regards
Adaan Pre-Media Services
For more image editing services follow us @
web designing services

How do you compare multiple files in Linux

I have these two folders on a linux server they have similar file structure... I am windows user so I wanted to find out what would be a command to do a diff on all the files withing these two folders on the linux server... is that possible...

I really need to see an example of this to be sure we are talking about the same behavior.
When diff(1) compares two directories, the files within them must have the same name, and be character-by-character the same. Even if one file has an extra space, that change will show as a difference.
Diff(1) can output its findings in several formats. For example, using the "-u" switch (as we have) some lines on either side of the change are printed to help you see exactly where the changed lines are. This is called the "context" of the changes. You can try leaving off the "-u" switch like this:
$ diff -r dirA dirB
to get a different output style. The diff(1) program has many command line options so you can probably experiment and find some that do what you want. Maybe you want to ignore changes in the spaces around individual words: there is a switch for that and many more.
Hope this helps.

Empty folders on remote server after synchronization

I am trying to set up a working environment for a very large web site and to get to the point of my post...
Whenever I try and synchronize my FTP with my local copy, I am selecting "Delete remote files not on local drive."
While the files are deleted on the remote server as they should be, it leaves behind empty directories all over the place where these files used to be.
The site is large enough that it takes over an hour to ftp it up to my testing server and I am doing a large amount of cleanup and deleting un-necessary files / directories all over the site. If I am going to have to manually track down every empty directory and remove them one by one, it is going to be faster to completely delete my FTP space and re-upload the site every single time I make some revisions which is a bit ridiclulous.
Isn't deleting the remote directories if I have deleted them locally considered part of SYNCHRONIZATION?
The site is so large that I can go grab a coffee while the synchronization is taking place but it is not quite as bad as re-uploading the entire local copy of the site every time I make significant changes to the site structure.
I guess this is related to why Dreamweaver throws "_notes" folders all over my site CONSTANTLY even when I have design notes turned off for my sites?
I have so many complaints about Dreamweaver and the fact that it pretty much has not improved much at all since Adobe took it over from Macromedia I don't know where to begin. I guess this would be a good place to start LOL!

As much as I hate replying to myself...
I was reading through this thread
http://digg.com/apple/OSXLeopard_Another_Serious_BUG_Unable_to_Browse_SMB_WindowsShares
I tried many of the suggestions one at a time. Unfortunately, I tried way too many suggestions to know if/which any single one was the "fix". The last three configuration changes I made were to disable IPV6, enable SMB sharing, then disable AFP sharing. After each of these, I did "sudo killall Finder" from a terminal.
Now it works for me as desired.
I hope this helps someone else.

Remote servers on class path

Is it possible to include an URL of a remote server on the classpath.
In other words is it possible to store compiled byte-code of classes on a "storage" server and make them available across a network to applications which might need them.
cheers

In other words is it possible to store compiled
byte-code of classes on a "storage" server and make
them available across a network to applications which
might need them.You can mount remote directories and put these in your classpath. But having a URL on the classpath is not possible.

ORBD + Servertool Remote Servers

I'm having trouble finding documentation that covers this scenario and wondered if anyone could help.
I'm developing a Java CORBA solution that has 5 different servers. These servers will be distributed among a number of physical computers on the same network and there is inter-server communication...the servers must know where eachother is.
I would like them to be CORBA persistent servers and have successfully got a server up and running using ORBD and the servertool.
The problem is: it appears that the server class files need to be local to the ORBD application. Is this the case? If so, how would this work in a distributed environment? Would each server and physical computer need an ORBD running? If this it the case, how will the servers know where the other is...this isn't a problem when using a transient naming service as the servers/clients and naming servers can all be distributed over any number of nodes.
Thanks in advance for any help.

In other words is it possible to store compiled
byte-code of classes on a "storage" server and make
them available across a network to applications which
might need them.You can mount remote directories and put these in your classpath. But having a URL on the classpath is not possible.

Hardlinking via Finder or SSH

Hi,
I am running a mac mini as a file server connected to a drobo to store all my files in a central place. The issue that I am having is that I would like to use hard links instead of aliases, is there a way to do this from a remote machine or the machine itself in Finder?
As another way to do it i tried logging into the mac mini using terminal and creating the hard linked files manually, When I remotely issue the command that works perfectly in a local terminal window it tells me that the operation is unsupported. How can this be? I would have assumed that once connected it should be the same as being on the machine itself.
Any help please?
Regards
D

As long as the hardlinks are between directories both residing on the same device, you can do this via ssh.
ssh remote.system.addr 'cd /somewhere/useful;ln /otherdir/file hardlink.file'
However, if this is for backup purposes, then you should know that Time Machine effectively does this when it does its hourly backups. It uses hardlinks to avoid having multiple copies of the same file.
The "rsync -E --compare-dest=reference.directory.tree" command can be used to create incremental backups where files that are the same as what is currently in the reference directory tree are hardlinked to the new directory tree instead of creating a new copy.
There is an open source perl script (rsnapshot) that will manage backups that use rsync --compare-dest and provides hourly, daily, weekly, monthly backups and manages the incremental backups. rsnapshot via ssh can be used to reach out from your Mac mini and backup multiple systems in your home, and if you configure things correctly you can backup systems across the internet. rsnapshot will require some hands on setup for a Mac environment, but if you want to get your hands dirty, it might be what you are looking for.

Rsync - to compare remote directories

Similar Messages

Maybe you are looking for