Full disk backup size is 2x what Finder says I have *in total*...why?

So, I admit it, I'm a Unix guy - it's one of the reasons OS X appealed to me in the first place. When I went to test my new external 320gb FireWire drive, I thought I'd make a full backup of my MacBookPro (10.4.11) using the tool I know best....tar. I mounted the drive and then did the backup from the command line:
cd /
sudo tar cvjf /Volumes/BigPartition/Save_All.tbz .
Hey, not pretty, but it worked. Except the backup tar file was 15GB - which was really odd since it's being compressed with Bzip and Finder says I'm using only 14GB _in total_ on my disk, and I'd expect a compressed backup to be much smaller - maybe 7GB. So it was 2x bigger than I thought it would be.
So I did it again, but this time without compression in case that was the problem (compressing already compressed data, etc). And it took up 31GB. So I'm REALLY confused here:
1) Am I using a whole lot more (17GB more!) disk than the Finder claims I am? OR
2) Is my 'tar' command saving files that don't really exist (like copies of virtual memory, etc.) that make it save 2x-3x as the actual data size would save as? OR
3) Is there some other explanation I'm not getting on this?
If #2, what's a tar command I could use to save the "real" system and data, but nothing else? Meaning, which directories/files do I need to exclude to save just the system and data I need to do a full restore, but no more?
Finally, besides the Backup app included with the OS, is there another tool/script I should be using to do a full system backup to my external drive?
thanks....and please scale the technical level of your answer to someone who programs in assembly language for fun. :}

You definitely need a backup program with a GUI for MacOSX. That's because of the bad news: MacOSX is not Unix. Open Darwin! Right...Apple, to my knowledge, never modified tar, cpio, dump, pax, ..., everything but 'ditto' for its augmented file system, with aliases, meta-data, 16-bit unicode fonts, resource forks, &c. All but 'ditto' will backup only Unix data in Unix files.
'Ditto' will archive HFS+ files, and can even strip architectures not needed from 'fat binaries', and use the BOM (bill of materials) to copy applications. What it does with aliases is unknown to me, but I believe it follows both soft & hard links to their sources (as tar does, I think), overwriting these if you try and restore from it. So, 'ditto' was clearly touched-up by Apple solely for creating archives, not backups.
I should examine the standard archives, like VersionTracker, for freeware from 'sourceforge'. I've never found an adequate backup applications; but I stopped looking some time ago. I just drag from Finder windows to archive, burning DVDs with 'Disk Utility'. That should work.
Note something really cute, however: a genuine tape backup released some years ago. The little mini-cartridges that fit in a digital VCR hold 20 to 30 GB! This little application was a real 'tar', sells for about $40, writes files twice, has various levels of compression, can follow aliases & links or not, and can be found on VersionTracker. After experience with quarter-inch cartridges, which were a nightmare, I distrust any tape drive that sells for less than $3000. But I've never had a VCR not playback! It's worth a look; and, what the ****, it's romantic.
Bruce
Demand Paging Forever

Similar Messages

  • Finder says i have an .rtf on iCloud.. what iCloud folder is it in???

    finder says i have an .rtf on iCloud.. what iCloud folder is it in???

    When you search for a file in Finder with ⌘F, you should see the folder in the path bar at the bottom of the search window, when you select one of the found items in the list:

  • WhatsApp claims I have no storage on my phone to restore a backup while I have more than enough space for the backup size required. What do I do?

    Hello community,
    I used to have storage problems on my phone, and chose to delete WhatsApp since it consumed nearly a whole gigabyte on my phone. I thought that through deleting it and reinstalling, it would get rid of the overload of data and start fresh. However, once I got to the page to restore from a back-up of my messages, I didn't have enough space on my phone. So I did further research into how to free up some space (turned out I had a lot of deleted photos hiding in my phone which should've been totally gone) and managed to get nearly 500 MB free. So I went back to my WhatsApp app, and tried to restore the back-up since it says the size of the back-up is 360 MB. However, it still gives the following error message that it had given me before:
    "Sorry, there isn't enough room on you iPhone to restore from your iCloud backup. Make room by deleting existing videos or photos and try again."
    I didn't (and still don't) understand why it says there is no room on my phone even though I had about 450 MB free. I have tried switching my phone off and then back on. Still, I get the same message. I have also tried deleting WhatsApp again and re-installing it but still I get the same message, still when I have enough room on my phone. By now, I have already consumed my storage on other apps so I don't have much space left anyway, making the error message reasonable.
    I would really appreciate if anyone could just throw me some possible solutions that could solve the problem of WhatsApp not recognizing that I've got enough space for it on my iPhone to restore all my messages. I would like them back because I have some important and nice message threads I would love to have retrieved. Remember, I have already tried switching my phone off and back on and also deleting WhatsApp when I had sufficient storage. Currently I don't have enough storage, which makes sense for the error message to appear, but if anyone gives me a possible solution I will make way for enough storage and try the solution.
    Also a weird thing is that at first, I still got notifications of messages people sent me through private chat (so not group chat). I don't know what it exactly means, but hopefully that helps with finding a solution.
    If you think that I might as well post this question on a WhatsApp forum, please tell me, because it does indeed seem like it lies on the app and not my phone.
    Thank you all anyway for reading and wanting to help.
    Shaynidw.

    Does your Cloud subscription show on your account page?
    https://www.adobe.com/account.html for subscriptions on your Adobe page

  • Finder says "You have unknown access"

    Hi! I wonder what "You have unknown access" means in the priviligies section in Finder (when you choose "get info"). I can see this in a, from mac, browsable folder, which is shared from Synology Diskstation 212. Folders within the shared folder is not possible to sync with Synology Cloud Station, that is the reason why I'm asking. Also how can I change this to "You have custom access"? Would love to have an answer! Best Regards/Fredric

    Get Info - then click the padlock on the bottom right to unlock. Then set user (me) to Read/Write.

  • Time Machine does not cope well with nearly-full disk

    Although Time Machine is supposed to delete old backups when the disk fills up, under some circumstances it does not cope well with a disk-full condition.
    Hardware: iMac (mid 2007)
    OS: Mac OS X version 10.6.8 (Snow Leopard)
    Processor: 2.8 GHz Intel Core 2 Duo
    Memory: 2 GB 667 MHz DDR2 SDRAM
    The other day I noticed that I had not had a successful Time Machine backup in over a day. Backups were taking a long time to run (4 hours or more), during which time the backup disk was chattering constantly and the disk showed "Estimating index time" in the Spotlight menu (even though I had excluded the disk from Spotlight indexing). When the disk finally stopped chattering, the backup finished with no visible errors but Time Machine continued to state that the last successful backup was yesterday. The backup disk was nearly full, but I had assumed that Time Machine was designed to cope with this situation by deleting old backups.
    A complete annotated log file of the incident and my observations can be found here: http://bentopress.com/backup.log.zip
    Here are some of the interesting entries from the system.log file:
    Sep  7 16:22:14 Bento-iMac com.apple.backupd[56515]: Starting standard backup
    Sep  7 16:22:14 Bento-iMac com.apple.backupd[56515]: Backing up to: /Volumes/My Backup Disk/Backups.backupdb
    Sep  7 16:23:07 Bento-iMac com.apple.backupd[56515]: No pre-backup thinning needed: 100.0 MB requested (including padding), 137.2 MB available
    Sep  7 16:25:49 Bento-iMac com.apple.backupd[56515]: Copied 32984 files (23.7 MB) from volume iMac HD.
    Sep  7 16:25:53 Bento-iMac com.apple.backupd[56515]: No pre-backup thinning needed: 100.0 MB requested (including padding), 108.4 MB available
    Sep  7 16:25:57 Bento-iMac KernelEventAgent[47]: tid 00000000 type 'hfs', mounted on '/Volumes/My Backup Disk', from '/dev/disk1s3', low disk, very low disk
    Sep  7 16:25:58 Bento-iMac mds[45]: (Normal) DiskStore: Rebuilding index for /Volumes/My Backup Disk/Backups.backupdb
    Sep  7 16:25:58 Bento-iMac KernelEventAgent[47]: tid 00000000 type 'hfs', mounted on '/Volumes/My Backup Disk', from '/dev/disk1s3', low disk
    Sep  7 16:25:59 Bento-iMac mds[45]: (Normal) DiskStore: Creating index for /Volumes/My Backup Disk/Backups.backupdb
    Sep  7 16:26:00 Bento-iMac KernelEventAgent[47]: tid 00000000 type 'hfs', mounted on '/Volumes/My Backup Disk', from '/dev/disk1s3', low disk, very low disk
    Sep  7 16:26:00 Bento-iMac mds[45]: (Warning) Volume: Indexing reset and suspended on backup volume "/Volumes/My Backup Disk" because it is low on disk space.
    Sep  7 16:26:02 Bento-iMac mds[45]: (Normal) DiskStore: Reindexing /Volumes/My Backup Disk/.Spotlight-V100/Store-V1/Stores/35367D91-8096-4D43-802B-A8658DBAB581 because no basetime was found.
    Sep  7 16:26:02 Bento-iMac mds[45]: (Normal) DiskStore: Rebuilding index for /Volumes/My Backup Disk/Backups.backupdb
    Sep  7 16:26:04 Bento-iMac mds[45]: (Normal) DiskStore: Creating index for /Volumes/My Backup Disk/Backups.backupdb
    Sep  7 16:26:14 Bento-iMac com.apple.backupd[56515]: Error: Flushing index to disk returned an error: 0
    Sep  7 16:26:14 Bento-iMac com.apple.backupd[56515]: Copied 776 files (17.3 MB) from volume iMac HD.
    Sep  7 16:26:15 Bento-iMac com.apple.backupd[56515]: Backup canceled.
    Note the "error: 0". Error code zero normally indicates success.
    There were also many, many, many copies of the following message, which occurred while Spotlight was trying to index the backup disk:
    Sep  7 17:28:40 Bento-iMac com.apple.backupd[58064]: Waiting for index to be ready (100)
    Here's what I think is happening: at the very end of the backup, after the files have been copied to the backup disk, mds resets indexing because the disk is now full. backupd's attempt to flush the index to disk then fails because indexing is suspended (error zero), so the backup is canceled. I suspect that this may occur when the new backup and the old one(s) being deleted are both small enough that the disk "packs" tightly, leaving no room for the index. If a large (>500MB) old backup had been deleted to make room for a small (<100MB) new one, the problem would not have occurred.
    I worked around the problem by switching Time Machine from the full disk to my Time Capsule. (I did not have this system backing up to the Time Capsule originally because I purchased the Time Capsule later for a different system.) The downside of this is that I lost access to older backups (though they are still accessible by right-clicking on Time Machine in the dock and selecting "Browse other Time Machine disks..."—however, I have not actually tried this). I'm also not completely happy having both my main systems backing up to the same hardware, but everything seems to be working well at this point and I do have a secondary backup system, using SuperDuper to clone the systems' disks to an external HD, which I do about once a month.
    Although I have worked around the problem, I am posting this in the hope that it will be useful to someone else, in the hope that someone at Apple will notice and perhaps improve the performance of Time Machine in this situation, and also in the hope that someone can suggest a solution that does not involve throwing a bigger disk at the problem. Is there any way to free up space on Time Machine's backup disk, for example by manually pruning older backups, either through Time Machine itself or via the Finder or command line?

    If you suspect that the disk being full is the problem, have you tried deleting some of the old backup data on the TM disk?
    When in TM, go back to the past a long way, right click on a file/directory and select "delete backup". Do this on some big files you have (so that you get more space per removal) that you change all the time (so you'll still have recent backups).

  • Disk Utility says I have only 115kb of free space left, but Finder says 1TB is this why my computer is slow?

    I want to instal the beta version of Yosemite on a partition, but when I open Disk Utility to do so, it won't allow me. After pressing the plus sign at the bottom of the screen I can not enter a value for the size. When I look down at the very bottom I read the following:
    Capacity: 3.12TB
    Available: 115KB
    Used: 3.12TB
    My trash is empty and Finder says I have 1TB in free space available, so what's going on?
    Perhaps related, my computer has been unreasonably slow (which is why I want to take the Beta for spin). I'm thinking there might be a connection. Is there a way to clear the detailed space so that Disk Utility will recognize it? In an attempt to speed things up I just reinstalled Maverick but nothing happened. I still can't partition and my computer is still slow.
    Everything is up to date.

    Maybe <About Time Machine local snapshots>
    and <http://osxdaily.com/2011/09/28/disable-time-machine-local-backups-in-mac-os-x-li on/>
    If this is not the case, maybe try OmniDiskSweeper to see where all the storage is
    <http://www.macupdate.com/info.php/id/7402/omnidisksweeper>

  • Hard Drive Size (Get Info) vs Actual Backup Size

    Get Info on my Hard Drive clearly states that 168 GB are used, HOWEVER when using Time Machine and Super Duper the backup size is 60 GB. Moreover, I have done a manual compare on the backup and actual hard drive directory by directory and the folders are all the proper sizes. What can be triggering et Info to be reporting such a discrepancy?

    davidavdavid wrote:
    Get Info on my Hard Drive clearly states that 168 GB are used, HOWEVER when using Time Machine and Super Duper the backup size is 60 GB. Moreover, I have done a manual compare on the backup and actual hard drive directory by directory and the folders are all the proper sizes. What can be triggering et Info to be reporting such a discrepancy?
    If you've done more than one Time Machine backup, looking at the size of each backup folder will show a wildly inflated size: each backup will appear to be roughly the size of your entire system. This is because each folder has "hard links" to all the files that didn't change between backups.
    If you're putting Time Machine backups and SuperDuper backups on the same disk drive, they should be in separate partitions. See #3 in the Frequently Asked Questions *User Tip,* also at the top of this forum.

  • RMAN CONFIGURE DEVICE TYPE DISK BACKUP TYPE TO BACKUPSET;

    I configure this , How i can clear this ?
    CONFIGURE DEVICE TYPE DISK BACKUP TYPE TO BACKUPSET;

    I assume you would have tried
    CONFIGURE DEVICE TYPE DISK CLEAR;(as described in the documentation) before asking the question.
    What about this does not work for you?

  • Why is there a huge difference between what the Finder says is available on my internal hard drive and what System Information says is available?

    The Finder says I have 123 Gb available on my 500 Gb internal hard drive.
    Systen Information says I have 61 Gb of capacity remaining
    Tech Tools says I have 61 Gb abailable.
    Why the difference?
    Since I am experiencing performance problems I tend to believe System Information.
    Will optomizing my hard drive with Tech Tools or the equivalent help improve my performance?
    At what % of capacity do I need to begin offloading stuff from my hard drive?

    At what % of capacity do I need to begin offloading stuff from my hard drive?
    According to Apple documentation, you need at least 9 GB of available space on the startup volume (as shown in the Finder Info window) for normal operation. You also need enough space left over to allow for growth of your data. There is little or no performance advantage to having more available space than the minimum Apple recommends. Available storage space that you'll never use is wasted space.

  • Can't open sites requiring Adobe Flash but Adobe finder says installed

    Adobe finder says I have latest version installed I have un-installed several times and always get the same results I followed procedures suggested under help "how do I install- - " and I get to the pop up that is showing in #5 I check "i agree" exit the browser and chose install the SAME pop up runs and then says "done" I do not have any icon nor is it showing in my computer program list nor will any program requiring Adobe Flash work

    Please do the following. Download both the Flash uninstaller and installer from these links:<br><br>
    * [http://download.macromedia.com/pub/flashplayer/current/uninstall_flash_player.exe uninstall_flash_player.exe]<br><br>
    * [http://fpdownload.adobe.com/get/flashplayer/current/install_flash_player.exe install_flash_player.exe]<br>
    ''See screenshot for an example of what these files look like''.<br>
    Next:<br><br>
    #Close Firefox and then run the uninstall_flash_player.exe file to remove Flash from your system.<br><br>
    #Reboot to remove it from the Windows Registry. This step is important, so don't skip it please.<br><br>
    #When the machine boots back to the desktop, run the install_flash_player.exe file, but '''do not open Firefox'''.<br><br>
    #Providing the installation completes successfully, start Firefox and go to http://www.adobe.com/software/flash/about/ You should be able to see the Flash animation which confirms it's been installed properly.
    If the problem persists, it might be due to malware. To eliminate that as the culprit, please download the free version of Malwarebytes from http://www.malwarebytes.org/products/malwarebytes_free and run a full system scan.

  • HT2518 unable to open files from my pc on my new mac from migration; can see them but finder says i don' have permission to open or it says files moved or deleted. any clues??

    unable  to open pc files from my migration to new mac; can see them but finder says they have been moved or deleted and will say i don't have permission to open  any clues???

    Have you logged-on to the new account that was created by the Migration app for the Windoze files?  That user should have normal access to them.

  • Why cant verrzion customer service do what they say they will and put me on the correct plan.

    Have been calling to get my plan changed, since march, to the plan for customers that lost unlimited data. Have been told 5 time it is taken care of, to day 7/1/2014 makes 6 calls to fix the problem, because they do not do what they say i have been over charged more than $100. i am a long time customer and am thinking of dropping them.

    That is(or was?) a promotional plan to get people with unlimited data to move to a tiered data package.
    See HERE.

  • My Mac is showing that I am out of disk space.  It says I have 175 MB of videos.  I cannot find any videos in Itunes, Imovie or IPicture.  What gives?

    My Mac is showing that I am out of disk space.  It says I have 175 MB of videos.  I cannot find any videos in Itunes, Imovie or IPicture.  What gives?

    For information about the Other category in the Storage display, see this support article. If the Storage display seems to be inaccurate, try rebuilding the Spotlight index.
    Empty the Trash if you haven't already done so. If you use iPhoto, empty its internal Trash first:
    iPhoto ▹ Empty Trash
    Do the same in other applications, such as Aperture, that have an internal Trash feature. Then restart the computer. That will temporarily free up some space.
    According to Apple documentation, you need at least 9 GB of available space on the startup volume (as shown in the Finder Info window) for normal operation. You also need enough space left over to allow for growth of the data. There is little or no performance advantage to having more available space than the minimum Apple recommends. Available storage space that you'll never use is wasted space.
    When Time Machine backs up a portable Mac, some of the free space will be used to make local snapshots, which are backup copies of recently deleted files. The space occupied by local snapshots is reported as available by the Finder, and should be considered as such. In the Storage display of System Information, local snapshots are shown as  Backups. The snapshots are automatically deleted when they expire or when free space falls below a certain level. You ordinarily don't need to, and should not, delete local snapshots yourself. If you followed bad advice to disable local snapshots by running a shell command, you may have ended up with a lot of data in the Other category. Ask for instructions in that case.
    See this support article for some simple ways to free up storage space.
    You can more effectively use a tool such as OmniDiskSweeper (ODS) or GrandPerspective (GP) to explore the volume and find out what's taking up the space. You can also delete files with it, but don't do that unless you're sure that you know what you're deleting and that all data is safely backed up. That means you have multiple backups, not just one. Note that ODS only works with OS X 10.8 or later. If you're running an older OS version, use GP.
    Deleting files inside an iPhoto or Aperture library will corrupt the library. Any changes to a photo library must be made from within the application that created it. The same goes for Mail files.
    Proceed further only if the problem isn't solved by the above steps.
    ODS or GP can't see the whole filesystem when you run it just by double-clicking; it only sees files that you have permission to read. To see everything, you have to run it as root.
    Back up all data now.
    If you have more than one user account, make sure you're logged in as an administrator. The administrator account is the one that was created automatically when you first set up the computer.
    Install the app you downloaded in the Applications folder as usual. Quit it if it's running.
    Triple-click anywhere in the corresponding line of text below on this page to select it, then copy the selected text to the Clipboard by pressing the key combination command-C:
    sudo /Applications/OmniDiskSweeper.app/Contents/MacOS/OmniDiskSweeper
    sudo /Applications/GrandPerspective.app/Contents/MacOS/GrandPerspective
    Launch the built-in Terminal application in any of the following ways:
    ☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
    ☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
    ☞ Open LaunchPad. Click Utilities, then Terminal in the icon grid.
    Paste into the Terminal window by pressing command-V. You'll be prompted for your login password, which won't be displayed when you type it. You may get a one-time warning to be careful. If you see a message that your username "is not in the sudoers file," then you're not logged in as an administrator.
    The application window will open, eventually showing all files in all folders, sorted by size. It may take a few minutes for the app to finish scanning.
    I don't recommend that you make a habit of doing this. Don't delete anything as root. If something needs to be deleted, make sure you know what it is and how it got there, and then delete it by other, safer, means. When in doubt, leave it alone or ask for guidance.
    When you're done with the app, quit it and also quit Terminal.

  • Find Backup Size And Backup Window

    Hi Guys,
    Can any one give script to find backup size and backup window (total time taken to conduct backup).
    I am using Oracle 10gR2 on sun solaris 5.8
    Backup-RMAN Full backup every day.
    Regards

    Hi,
    backup size
    what do you mean by backup size .. ??
    User show all to list out the configuration details;
    Thanks
    Pavan Kumar N
    Message was edited by:
    Pavan Kumar

  • Different full backup size of identical databases

    Hello,
    I am on Oracle 10GR2.
    I have 1 database instance with size approximately 50GB. Today I created second instance with RMAN duplication process from the first instance. So now I have two similar DB instances with same size 50GB.
    What is strange to me is size of FULL LEVEL0 backups of these databases.
    Backup size of original database has approximately 22 GB, backup size of second (duplicated) instance has 7GB.
    Can you explain me why? Or what should I do with original database to have same small backup size.
    Executed RMAN command for backup is: BACKUP INCREMENTAL LEVEL 0 DATABASE PLUS ARCHIVELOG;
    Thank you

    select sum(bytes)/1024/1024/1024 GB from dba_segments;
    This select gives me 6,79 GB in both instances.
    I did not used UNTIL TIME for duplication.
    RMAN settings is same for both instances and I don't use any compression
    RMAN configuration parameters are:
    CONFIGURE RETENTION POLICY TO REDUNDANCY 1; # default
    CONFIGURE BACKUP OPTIMIZATION OFF; # default
    CONFIGURE DEFAULT DEVICE TYPE TO DISK; # default
    CONFIGURE CONTROLFILE AUTOBACKUP ON;
    CONFIGURE CONTROLFILE AUTOBACKUP FORMAT FOR DEVICE TYPE DISK TO '%F'; # default
    CONFIGURE DEVICE TYPE DISK PARALLELISM 1 BACKUP TYPE TO BACKUPSET; # default
    CONFIGURE DATAFILE BACKUP COPIES FOR DEVICE TYPE DISK TO 1; # default
    CONFIGURE ARCHIVELOG BACKUP COPIES FOR DEVICE TYPE DISK TO 1; # default
    CONFIGURE MAXSETSIZE TO UNLIMITED; # default
    CONFIGURE ENCRYPTION FOR DATABASE OFF; # default
    CONFIGURE ENCRYPTION ALGORITHM 'AES128'; # default
    CONFIGURE ARCHIVELOG DELETION POLICY TO NONE; # default

Maybe you are looking for