Corrupt sparse images

Twice now I've run into situations where my wireless network connection to my MacBook was interrupted during a backup, and the sparse image (On a 1 TB Time Capsule) containing the TM archive became corrupt. I lost all my back-ups both times. A third times things got a little trashed, but Disk Utility was able to recover the image.
This is completely unacceptable. What's the point of keeping all this history if I can lose it all with one small network glitch. This is a major design flaw. Sparse images should never have been used if they can be trashed this easily. I hope it gets fixed, but, I'm not sure its possible given the way this has been set up.
I'm looking at other backup options now. Terrible, just terrible.

OK, fair enough, but then why attach a hard drive to a wireless hub??? For me, the whole point of this was that I could keep my laptop backed up without having to tether it. If I have to plug it into something to back it up, then I might as well just use a hard-drive. Also, Time Machine has no preference for this, so I'd need to leave it turned off, and then only say "back up" when I had plugged the hard drive in... This completely runs counter to what they are going for with TM... And I can tell you from experience that it means that I'll realistically get backed up about once a week, at best! The only back-ups that get done with regularity, are ones that run automatically.
Additionally, since there's no way to set the frequency in TM, I'm stuck with it backing up every hour... so its a real pain in the neck to try and "be careful with it" when its backing up... because its almost always backing up!
The only way that this sort of always-on behavior can work, is if it works flawlessly, and invisibly. Well, they more or less got the invisibly part right.
I bought into the marketing ('cause I thought it was a great idea) and upgraded to Leopard, and bought a Time Capsule, just for this feature... Turns out I got suckered. That'll teach me to be an early adopter. I'm surprised that there hasn't been more talk about this design flaw on the news sites.

Similar Messages

Finder error -36 when transferring some sparse images over 100GB+

Hi,
I'm currently backing up sparseimages of different sizes onto backup hard drives for video editing.
I'm using the latest iMac with Mountain Lion.
I use Sparseimages in order to seperate FCPX projects (best way to keep organised so far in my opinion).
Although with the amoung of footage and size of files, I need to backup them up on different drives every so often to free up some space for myself.
While transfering the backups I noticed the error -36 would happen on the finder for some files. Specifically the larger ones sized 100GB+.This is for my work and is VERY important. So whoever can find me a good fix or explanation for this issue, will have my greatest gratitude!
Now before I get bombarded by questions and abused by "its already been covered - google is your friend", here are the setup and the things I found out about the issue:
iMac w/ OSX 10.8
- Thunderbolt to Drobo 5D (with 5x 3TB drives)
- USB 3.0 Startech Dock for 3.5" Sata hard drives - I'm using a WD 3TB internal drive on the dock
1. In most cases transfering a file between the following locations causes the WD drive to eject and the finder to create a -36 error:
(In every case, smaller sparseimages are copied just fine - anything 100GB+ just ejects the disk and causes the error)
- Drobo 5D to WD - Ejection + Error -36
- iMac Fusion Drive to WD - Ejection + Error -36
- Drobo 5D to iMac Fusion drive: NO ERROR
Now before you go and say that it may be an issue with the particular drive i'm using in the dock; I've swapped the WD drive I want to copy the files on with another WD drive and managed recreated the same error.
I've used Carbon Copy Cloner and got an error saying I shouldn't modify or change the disk while transfering when attempting to transfer the larger files.
I did find a way around it, but it's really long and would take days to do. It's to create a new sparseimage on the desktop and transfer all the content of the old sparse into the new one then transfer the new sparse into the WD docked drive. For some reason... that works, although, generally it takes a few hours to transfer one of the 100GB+ sparses, and having to copy the entire content onto the desktop then yet again copy it to the WD drive seems lenghty and unecessary. There MUST be a fix, I'm sure there's a way around it. Otherwise I'm stuck for the next few weeks with transfering alone
Thanks in advance for help!
Luke

Sorry, I see what you mean, although I'm having difficulty figuring out which one it could be for the following reasons:
1) Corrupt Directory:
The sparse images in question, the ones giving me the errors, mount fine if I run them directly from the Drobo 5D. They also can be transfered successfully to the desktop and can run from there too. But transfering to the 3.0 USB dock causes the error.
2) Failing Disk:
I've used a different 2 different hard drives in the same dock and tried to transfer the same sparse images... but no luck! Although copying it straight onto the deskop is fine. So the drive hasn't failed.
So that's why I reckon it has something to do with transfering large files to the Dock.
Any suggestions will help! It could be the docking station but I thought it could maybe be the OS handling the large files the wrong way or perhaps an issue with USB 3.0? I don't know...
NOTE: There are generally no errors, I can transfer many many files and folder at a time without an issue. It is ONLY when the file is very large and transfering that it EJECTS the drive and causes the -36 error
UPDATE:
Just saw your update! Will do a block test on the drive now, although, as I mentioned early on this comment, it seems to be that the other drives I used have the same problem.
Also, I was wrong, it's Seagate drives I'm using, if that makes any difference?
So many drives here, I'm getting confused! hehe

Mail Folders as sparse images?

There was a discussion on this issue a couple of years ago, but I'd like to check if anyone has tried it.
The problem:
20 GB of mail history that I would like to keep on line and accessible; however only the current year's folder changes
128GB MacAir disk that is getting close to full
The potential solution:
.Close mail
.Create compressed sparse images for the two large historical mail folders
.Move the folders into them
.Create symlinks from the original locations to the sparse image contents
.Automount the sparse images at login
I can foresee some potential problems:
.If I forget and put mail into my startup items, I'll create a race condition that, if mail ever wins, is likely to corrupt the mail folders
.I better not unmount the sparse images while mail is running (ideally, I'd like to lock the mount, but I don't know any way to do that)
I'd appreciate any advice, especially from anyone who has already done something like this...
Best Wishes
Bob

That idea makes no sense. If you want to compress your old mail files, use something like afsctool (free) or this:
Clusters: Seamless File Compression

Corrupted Disk Image

I have a sparse disc image that was corrupted during a hard reset. Now, when I try to open it, it says that it cannot because "disk image is corrupted". I have very important files on the disc image and really need to get it recovered. So far I have only tried repairing it in disc utility-to no avail.
Is there any other way I can recover it?
Thank you in advanced.

I hate to be the bearer of bad news, but I don't know of anyway to mount a corrupted disk image. That said, you could investigate the Unix command, which may have way to verify and mount it:
hdiutil
Launch the Terminal app in /Apps/Utilities/, type this in, and hit the return key;
man hdiutil
Hit the space bar to page through the document, when you get an alert sound, type in a q, and quit the Terminal program.
G4 450 MP Gigabit Mac OS X (10.4.7)

A sparse image or sparse bundle question in relation to a NAS

Hi all,
I want to create a sparse image or bundle on my Synology DS713+ NAS to store my iPhoto and Aperture libraries.
The reason for a sparse image or bundle lies in the fact that both iPhoto and Aperture very much like a solid Mac Journal formatted drive to operate on.
Because I use an iMac and a MacBookPro I want these libraries available for both computers, and while they reside on a NAS they are 'automatically' backed up, and acessible to both computers.
I've tried storing the iPhoto library on the NAS directly (not Mac formatted but some Linux format, nót FAT32 anyway), but this was performing very poor (copying the library took hours and hours), and I've read on many NAS and Synology forums that this is not the way to go. The best solution I've read from these forums is to create a Sparse Image or Bundle on the NAS to benefit fully form an iPhoto or Aperture Library.
Now I have created a Sparse Image, and mounted it, and moving (copying) an iPhoto Library to it is done in a snap (amazing).
But having the Sparse Image mounted on my iMac, I cannot acess it on my MacBookPro unless I first umount it on the iMac, and then mount it on the MacBook.
Is there a way that such a Sparse Image can be mounted on more than one computer at the same time. In my case, mounted on both the iMac and the MacBook?
Or must it specifically be a Sparse Bundle to accomplish this, or maybe some Terminal wizzardry to get this done?

I'm a little confused here, but what you did answer did help quite a bit. Thanks for that. Anyway, I'm having problems adding to the array. It keeps telling me 'cannot find symbol - method add (double). I'm assuming that this method should be defined in the AuditRecord class, which has been given to me but there seems to exist no method in that class called 'add'. I suppose I could make one, but my professor said that we shouldn't be modifying the AuditRecord class at all, which leads me to believe I'm on the wrong track again. Anyway, here's my updated code in the hopes that it's a simple mistake that I'm making once again:
public class AuditTrail
    private ArrayList<AuditRecord> auditTrail;
    //ArrayList<AuditRecord> auditTrail = new ArrayList<AuditRecord>();
    //private double amount;
public AuditTrail()
   auditTrail = new ArrayList<AuditRecord>();
* Add a record
public boolean add(double amount)
       if (amount > 0)
       //create auditrecord and add to audit trail (array list)
       AuditRecord auditTrail = new AuditRecord(amount);
       //auditTrail.AuditRecord(amount);
       auditTrail.add(amount);
       System.out.println("Amount of "+amount+" added.");
       return true;// similar behavior to a collection
    else
        System.out.println("Invalid deposit amount.");
        return false;
}

Why can't I open multiple sparse image files at the same time in FCPX?

I work in a multiple editor enviroment, where we have hundreds of different projects. They are all divided into sparse image files to keep them all separated. I used to be able to mount multiple sparse image files and see them all in FCPx. But recently, FCPx upon opening, will close out all but one sparse image. The images are still mounted to the OSx but FCPx will not recognize them. I can only open one sparse image at a time. I am needing to export multiple projects at the end of the day, and can't batch export or send them all to compressor because I can open up multiple projects.

I work in a multiple editor enviroment, where we have hundreds of different projects. They are all divided into sparse image files to keep them all separated. I used to be able to mount multiple sparse image files and see them all in FCPx. But recently, FCPx upon opening, will close out all but one sparse image. The images are still mounted to the OSx but FCPx will not recognize them. I can only open one sparse image at a time. I am needing to export multiple projects at the end of the day, and can't batch export or send them all to compressor because I can open up multiple projects.

How do I move a user's sparse image BACK into the correct folder

Please help if you can!
I accidentally moved the sparse image connected to my administrator account into the 'shared' folder. (I was trying to confirm shared settings between users, and inadvertently moved the file.) There were no error messages or warnings, the file moved easily into the shared folder.
After it was moved, I was unable to login to that user's desktop, and the only explanation is "...because there was an error." The only thing I can think of is that it's because of the moved sparse image for that user.
But, I can't move it back. The computer won't allow me to move the file, and when I try to copy it to the appropriate folder I get an error message that there is not enough disk space. I tried creating a new administrator account, but that didn't work. I've tried changing the file-sharing settings, but nothing I've thought of doing has worked. I've tried turning off Fire Vault for that user, but I can't seem to do it from a different user account.
If you have any ideas of how I could log into this user account, I would be very, very grateful. It's my main desktop, and I need access to the files located there!
Please help!!

Dear jsd2 and William,
Thank you both so much for your help. I cannot tell you how much I appreciate both of you taking the time to help me figure out this problem.
William - The Library folder was basically empty. It had some Quicktime preferences in it, but nothing else. The Terminal didn't even recognize it, and I actually couldn't delete through Terminal, but simply sent it to the trash. Even so, I couldn't log in the user account.
jsd2 - I was able to log in as root and had no problems opening the sparseimage. I then copied all of the data to an external HD. Once that was finished I verified the sparseimage mounted disk, but there were no problems found. Even so, I repaired disk, but still no problems found. Even so, I couldn't log into the user account. I did get to the point where it asked for the master FireVault password (by entering the wrong password 3 or 4 times). It accepted the master password, but then it wouldn't let me change the password and login (the master password only led me to a new-password screen).
So, after verifying that ALL of my data was safely on the external HD (including music, pictures, mailboxes, files, etc...), I deleted the user account and home folder for the account I was locked out of. Then, I created a new account, and manually transfered the necessary files back into the user folder. Then, I restarted my computer and breathed a huge sigh of relief when my wallpaper came up on the screen. About 98% of my settings are in tact. All music, pictures, files, and e-mails survived. Although I have to re-ad the actual e-mail accounts, all of the other account settings are there.
I will leave the copied files on the external HD for at least a few days or a week to make sure nothing important is missing, then I will set up Time Machine and start making regular backups.
So, thank again, both of you, for your invaluable help, which led to a successful, if somewhat roundabout, solution to this problem.
Also, jsd2, I don't remember if I turned Fire Vault off when I upgraded or not. It seems to me that the directions said I should, and in which case I would have - but the upgrade wasn't recent, so I don't really remember. (Or rather - clearly I didn't, if what you say is true.) At the moment, FireVault is off for all accounts on this computer. I want to turn it back on, but, to be honest, I'm really scared to now....Since I don't know what caused the problem in the first place, I'm leery that if the problem hasn't been fixed I might end up in the same situation again. Although I hadn't had any problems before today, and I know that I must have done something in the 'sharing' settings that created the problem.

Offline updates mechanism: how many times can you use it before corrupting the image(wim)?

Hi,
As title mentions: "how many times can you use sccm 2012 offline updates for the wim file before corrupting the image(wim)"?
J.
Jan Hoedt

In my experience the offline servicing feature is only OK and too unreliable for production.
Gerry Hampson | Blog:
www.gerryhampsoncm.blogspot.ie | LinkedIn:
Gerry Hampson | Twitter:
@gerryhampson

Hdiutil and creation of more then one partition in a dmg and sparse image?

Hello,
My main question,
after reading the man page and googling, I can't find any way to create a DMG file with more then one partition. Is this even possible?
My finaly goal is to attach those with -mountRandom and - nobrowse from inside a cocoa.app.
I need the return value to get the random path to those partitions.
hdiutil attach test.dmg -mountrandom /Users/dev/Desktop/testdmg
/dev/disk7 GUIDpartitionscheme
/dev/disk7s1 Apple_HFS /Users/dev/Desktop/testdmg/dmg.A43MrA
But I see that when I use a mutli partition dmg ( here simulated ) I will have to look for one or more random paths, something like this.
hdiutil attach test.dmg -mountrandom /Users/dev/Desktop/testdmg
/dev/disk7 Applepartitionscheme
/dev/disk7s1 Applepartitionmap
/dev/disk7s2 Apple_HFS /Users/dev/Desktop/testdmg/dmg.A43MrA
/dev/disk7s3 Apple_HFS /Users/dev/Desktop/testdmg/dmg.7IaUpK
What is the best way?
to grep a line wich contains '/dmg./ and then awk print $3 ?
path=/Users/dev/Desktop
hdiutil attach $path/test.dmg -mountrandom $path/testdmg | grep '/dmg.' | awk '{ print $3 }'
but what when I attach f.e a sparse image not using the -mountRandom, then I have no '/dmg.' just volumes?
Is that doable in one universal piece of code?

I can only answer your question re:multi partition on a .dmg with:
doug-penningtons-power-mac-g4:Desktop dougp$ diskutil list
/dev/disk0
#: TYPE NAME SIZE IDENTIFIER
0: Applepartitionscheme *57.3 Gi disk0
1: Applepartitionmap 31.5 Ki disk0s1
2: Apple_Driver43 28.0 Ki disk0s2
3: Apple_Driver43 28.0 Ki disk0s3
4: AppleDriverATA 28.0 Ki disk0s4
5: AppleDriverATA 28.0 Ki disk0s5
6: Apple_FWDriver 256.0 Ki disk0s6
7: AppleDriverIOKit 256.0 Ki disk0s7
8: Apple_Patches 256.0 Ki disk0s8
9: Apple_HFS Joe 57.1 Gi disk0s10
/dev/disk1
#: TYPE NAME SIZE IDENTIFIER
0: Applepartitionscheme *10.0 Mi disk1
1: Applepartitionmap 31.5 Ki disk1s1
2: Apple_HFS me 10.0 Mi disk1s2
doug-penningtons-power-mac-g4:Desktop dougp$ diskutil partitionDisk disk1 2 HFS+ leroy 5M HFS+ madge 5M
Started partitioning on disk disk1
Creating partition map
Formatting disk1s2 as Mac OS Extended with name leroy
Formatting disk1s3 as Mac OS Extended with name madge
[ + 0%..10%..20%..30%..40%..50%..60%..70%..80%..90%..100% ]
Finished partitioning on disk disk1
/dev/disk1
#: TYPE NAME SIZE IDENTIFIER
0: Applepartitionscheme *10.0 Mi disk1
1: Applepartitionmap 31.5 Ki disk1s1
2: Apple_HFS leroy 5.0 Mi disk1s2
3: Apple_HFS madge 5.0 Mi disk1s3
Message was edited by: doug pennington

Disk Utility Restore from Sparse Image taking forever

I created a sparse image backup of my MBP C2D using SuperDuper! before sending the laptop back to Apple for repair. I wiped the drive clean before shipping. I now have the laptop back and am trying to restore the sparse image to the HD.
The sparse image file is on an HD in my G5 tower and is just over 108 GB. I booted the G5 into target disk mode and connected it to my MBP via FW800. I then booted off the Leopard install disk and launched Disk Utility to do the restore.
The sparse image mounts fine in Disk Utility and is specified as my source for the restore.
I started this restore last night before I checked out for the night and when I got up this morning, Disk Utility showed about 35-40% of the image had been restored and 14 HOURS were remaining. That seems a little excessive after it had already been running for well over 9 - 10 hours.
The sparse image mounts on the MBP just fine using target disk mode from my G5 -- so as far as can tell, my backup image itself is ok.
My question is this: is the Restore function performance of Disk Utility with sparse images really this bad or is something wrong with what I am doing? I really don't want to rebuild my laptop from scratch, but if I have to wait 34 or more hours for Disk Utility to finish a restore -- it might be quicker to rebuild it.
Any ideas out there?
Message was edited by: Randy Vose

Randy Vose wrote:
I created a sparse image backup of my MBP C2D using SuperDuper! before sending the laptop back to Apple for repair. I wiped the drive clean before shipping. I now have the laptop back and am trying to restore the sparse image to the HD.
The sparse image file is on an HD in my G5 tower and is just over 108 GB. I booted the G5 into target disk mode and connected it to my MBP via FW800. I then booted off the Leopard install disk and launched Disk Utility to do the restore.
The sparse image mounts fine in Disk Utility and is specified as my source for the restore.
I started this restore last night before I checked out for the night and when I got up this morning, Disk Utility showed about 35-40% of the image had been restored and 14 HOURS were remaining. That seems a little excessive after it had already been running for well over 9 - 10 hours.
The sparse image mounts on the MBP just fine using target disk mode from my G5 -- so as far as can tell, my backup image itself is ok.
My question is this: is the Restore function performance of Disk Utility with sparse images really this bad or is something wrong with what I am doing?
no the restore function is not this bad.
something must be wrong with your sparse image. you should have tested it before sending the computer for repairs. and why did you use a sparse image at all?! you should have made (and tested) a standard clone.

Disk Utility doesn't offer sparse images

I want to make disk images of hard drives, but Disk Utility no longer offers the "sparse image" format. Why is this?
iMac (27-inch Mid 2011), OS X Mountain Lion (10.8.2)

Please read this whole message before doing anything.
This procedure is a test, not a solution. Don’t be disappointed when you find that nothing has changed after you complete it.
Step 1
The purpose of this step is to determine whether the problem is localized to your user account.
Enable guest logins* and log in as Guest. For instructions, launch the System Preferences application, select Help from the menu bar, and enter “Set up guest users” (without the quotes) in the search box. Don't use the Safari-only “Guest User” login created by “Find My Mac.”
While logged in as Guest, you won’t have access to any of your personal files or settings. Applications will behave as if you were running them for the first time. Don’t be alarmed by this; it’s normal. If you need any passwords or other personal data in order to complete the test, memorize, print, or write them down before you begin.
Test while logged in as Guest. Same problem?
After testing, log out of the guest account and, in your own account, disable it if you wish. Any files you created in the guest account will be deleted automatically when you log out of it.
*Note: If you’ve activated “Find My Mac” or FileVault, then you can’t enable the Guest account. The “Guest User” login created by “Find My Mac” is not the same. Create a new account in which to test, and delete it, including its home folder, after testing.
Step 2
The purpose of this step is to determine whether the problem is caused by third-party system modifications that load automatically at startup or login.
Disconnect all wired peripherals except those needed for the test, and remove all aftermarket expansion cards. Boot in safe mode* and log in to the account with the problem. The instructions provided by Apple are as follows:
Shut down your computer, wait 30 seconds, and then hold down the shift key while pressing the power button.
When you see the gray Apple logo, release the shift key.
If you are prompted to log in, type your password, and then hold down the shift key again as you click Log in.
Safe mode is much slower to boot and run than normal, and some things won’t work at all, including wireless networking on certain Macs. The next normal boot may also be somewhat slow.
The login screen appears even if you usually log in automatically. You must know your login password in order to log in. If you’ve forgotten the password, you will need to reset it before you begin.
*Note: If FileVault is enabled, or if a firmware password is set, or if the boot volume is a software RAID, you can’t boot in safe mode.
Test while in safe mode. Same problem?
After testing, reboot as usual (i.e., not in safe mode) and verify that you still have the problem. Post the results of steps 1 and 2.

List view for folders on a sparse image disk

I have set up a sparse image on an external disk. I cannot get the sparse image disk folders to default to "List View". It always opens as "Icons" and I have to click on list view everytime. Any ideas?

Go to the Preferences under the small box at the upper-left:
On the General pane, check the box to "Show list views for all media".
Regards.

How can I make a password protected encrypted sparse image?

How can I make a password protected encrypted sparse image?
Doing what worked in 2006 does not produce password protection even though I have typed one in and re-entered it as requested. Clicking on the Disk image opens it without asking for the password. I am stumped. Many thanks.
(OS 10.10.2 on 2010 MacPro)

John Roehm wrote:
That did it. The Keychain box was automatically checked and I did not know enough to uncheck it. Many many thanks.
Yeah, nobody does. They should put up a custom password save box when you make an encrypted disk image that explains what will happen if you store the password in the keychain. In the current "how-to" article, they mention it, though: How to create a password-protected (encrypted) disk image - Apple Support

Problem Moving Large Files to Sparse Image

Hi All,
So I'm playing around with sparse images (new to mac so trying to learn lots). I occasionally share an external terabyte usb HDD with workmates and want to use a password protected image to save my files on it. I will be using about 200gb of space. A few good people here put me onto sparse images as opposed to dmg images which is great however I've run into a couple of problems...
Firstly when I try to copy a folder of work (I do photography) to the sparse image that is more than about 4Gb I get a message saying it cannot copy as there isn't enough space on the image to do so. I'm assuming this is something due to the image creating free space on the fly so therefore am wondering if there is a way of increasing this??
Secondly, and more alarming for me is that after copying about 50Gb of work I discovered that whilst the files seem to be the correct size in the image they cannot be previewed or opened. The error says it may be damaged or to use a file format preview recognises. I tried copying a few movies too and found that vlc cannot play them too.
Hoping someone may be able to point me in the right direction with this.
As a side note....I am quite fastidious about backing up so no work going into this image will be done so without a backup saved elsewhere.
Cheers
Matt

HI,
"*4Gb I get a message saying it cannot copy as there isn't enough space"*
Make sure have enough free space on your startup disk to do this.
Right or control click the MacintoshHD icon. Click Get Info. In the Get Info window you will see Capacity and Available. Make sure you always have a minimum of 10% to 15% free disk space at all times.
This is the best paragraph I've read on these forums...
*"I am quite fastidious about backing up so no work going into this image will be done so without a backup saved elsewhere"*
Backing up your important documents can save many a headache later on. Good on you!
Try repairing disk permissions and see if that helps.
Quit any open applications/programs. Launch Disk Utility. (Applications/Utilities) Select MacintoshHD in the panel on the left, select the FirstAid tab. Click: Repair Disk Permissions. When it's finished from the Menu Bar, Quit Disk Utility and restart your Mac. If you see a long list of "messages" in the permissions window, it's ok. That can be ignored. As long as you see, "Permissions Repair Complete" when it's finished... you're done. Quit Disk Utility and *restart your Mac.*
Carolyn

Import into LR 5.5 or Raw 8.5 corrupts raw image from 5d Mrk iii

I am running Adobe LR 5.5 with Raw 8.5, shooting with canon 5d Mrk iii. When I import my images they become corrupt after image previews are completed. The imgae thumbnail from the camera looks great until processed in LR or Bridge. The corruption is visible lines of red, blue, green or yellow and sometimes covers the entire picture.

The image preview comes from the camera-embedded JPG at the beginning of the file. The raw data is corrupted and LR shows you this corruption once it completes its processing.
Copy the images from the card, again, and see if they are corrupted exactly in the same way or not.
If the corruption is different from one transfer to the next then the corruption is occurring during or after the transfer.
If the corruption is identical between the two sets transferred from the card then the data on the card is most likely corrupted and so either the card or the camera is bad.
The card is usually the culprit but sometimes it's memory or hard-disk on the computer.

Corrupt sparse images

Similar Messages

Maybe you are looking for