Backup / APS Solution

Good afternoon. I have been reading the archives, and there are numerous questions about backup, but nearly every one lacks enough information for the question to get answered, so I am going to try again.
I have an X-serve with one 80GB drive. We use this server primarily as a web/mysql server. I use built-in apache and mysql along with Omnipilot Lasso to serve our webpages.
Up to now, I have been using this as a test server only, but plan to make it our primary web server sometime in the next few weeks. My questions:
*What is the best software/program to use for a backup?
*How tough is it to add another 80gb drive and stripe it for raid so I have redundancy?
*In a perfect world, I would like to have the following configuration:
Drive 1: 80GB -> Primary Drive
Drive 2: 80GB -> Second Primary Raid with #1
Drive 3: 80GB -> Backup Drive
Then, I would want to back up quickly to the third drive.
Finally, I want to backup to tape so I can have a daily copy on tape and a fire backup off site. What hardware would you suggest? Although I don't have tons of data now, we could end up with 40-50gb of photos, drawings, etc.
Finally...what is the best APC hardware/software for xserve?
Thanks!

*What is the best software/program to use for a backup?
There is no one single answer to this question.
There are many products that aim at different segments of the market, offer different performance levels and cost different amounts of money (from $0 to thousands)
If all you want is a copy of the entire drive then the bundled tools such as asr, rsync and even cp with a little creating shell scripting might be sufficient.
If you want automated, point-in-time replicas so that you can restore the system to its condition on a specific date then you'll probably benefit from one of the commercial applications such as Retrospect, NetVault, or Time Navigator (amongst others).
You might also want a backup solution that can handle backup to tape for secure, off-site backups. Or maybe you want a disk-to-disk-to-tape solution for speed. Or maybe you want a network-based solution that can backup your network clients, too.
You see what I mean about there not being a single answer to that question, at least not without first answering the other questions that go along with it.
*How tough is it to add another 80gb drive and stripe it for raid so I have redundancy?
Striping adds nothing to redundancy. In fact, it's worse than a single drive.
When striped across two disks, you have twice as many points of failure that will result in the loss of data (either drive could fail and you're out of luck).
Maybe what you mean is mirroring, where the data is written to two drives at the same time. This offers redundancy against a single-disk failure and can be done without reformatting the volume, although it's easier to do if you can reformat.
*In a perfect world, I would like to have the following configuration:
Drive 1: 80GB -> Primary Drive
Drive 2: 80GB -> Second Primary Raid with #1
Drive 3: 80GB -> Backup Drive
You could have a RAID 1 mirror on disks 1 and 2, using asr> to replicate the entire volume to disk 3 on a periodic basis. Current cost $0.
Finally, I want to backup to tape so I can have a daily copy on tape and a fire backup off site. What hardware would you suggest? Although I don't have tons of data now, we could end up with 40-50gb of photos, drawings, etc.
There are numerous tape options available. You need to consider not just the current amount of data, but plan for growth, and also for full vs. incremental backups - even if there's 60GB of data on the drive, you might only need to backup 1 or 2GB per day.
Then you might want a single -tape drive that you have to load with tapes, or you could use an autoloader which can automatically load a spare tape for unattended backups.
Finally, budget is often the largest factor when considering tape backup. There is a direct relationship between speed, capacity and price. You can spend as little as a few hundred dollars if you don't mind backing up to 10 tapes, and taking 8 hours to do it, or you could spend thousands and have it done automatically in a few minutes. Set your budget then find a system that fits.
Note that if you do go to tape you will need some third party software since the Mac OS doesn't come with anything capable of talking to a tape drive directly. You should factor this into your budget, and make sure that whatever tape system you buy is compatible with whatever software solution you use.
Finally...what is the best APC hardware/software for xserve?
How long do you want the system to run on battery power before powering down?
Do you want just the server to run on battery power? What about the switch, router, and other infrastructure so that your web site stays up and accessible to the outside world?
APC units serve two purposes - first is power smoothing to reduce/eliminate spikes and drops in the power supply and second to provide a power source in the case of a power loss.
You'd need to look at your current power situation to decide what's important to you. If you're in an area with flaky power supply and frequent brownouts and blackouts you'll want a higher-rated supply that can keep you ticking for an extended period. If your power supply is generally good and reliable then a smaller unit might suffice given that it's not going to be the sole power supply frequently, and even when it is it's likely to be for a short period of time before utility power is restored.

Similar Messages

  • Xserve Backup/Archive Solutions

    Hi,
    We currently have a MacPro running our wiki along with some file sharing and user directory service. It has a hardware raid with (3) 1TB drives and has served well so far with great feedback. We want to extend the wikis to a much larger audience and wanted to move to an xserve. The problem is that our IT department is not cooperating with supporting the xserve and will not allow us to use their central backup system.
    Our current usage is for one course which includes 20 students and 4 instructors. We are wanting to extend the wikis to about 20 courses to give you an idea for traffic.
    My question is what are my options with backup solutions if we decide to go ahead with the xserve. We want to be able to go back at least a week before. We are looking for automated backups. What would I need in terms of hardware and software? I have no prior experience with backups so just want to know what I might be getting into.
    Please let me know your thoughts.
    Message was edited by: leadstrand

    2 TB will need to be backed up. That is the capacity of our RAID 5 setup.
    Not sure how often it should run but I want to be able to restore back to a week (5 days)
    Budget is of low priority at this time but should be less our Xserve setup (Quad 2.8 4GB RAM Hardware RAID 3x 1TB drives)
    none

  • Advice please: Time Capsule as backupable NAS solution?

    *_The situation:_*
    My girlfriend and I each have a laptop that are on a home wireless network. I've got a number of design work files that are currently on FireWire drives because my laptop HD isn't large enough to hold them all. We both use Time Machine to backup our individual systems to separate external hard drives.
    I'm typically use my laptop in various rooms around the house so I tend to move around with it a bit. As such, having an external hard drive tethered to it is kind of a drag and I'd love to have some kind of file server that I can access wirelessly which will also be backed up.
    *_My plan:_*
    Buy a USB 2.0 hard drive for all the work files and attach it to a Time Capsule which I want to backup (1) the USB drive with all the work files (2) my laptop, and (3) the girlfriend's laptop.
    *_What I want to know:_*
    Is this a good idea? Will it work? Will accessing files from the attached USB drive be horribly slow? Am I risking anything in this approach? Is there a better solution?
    Thanks in advance,
    B.

    You mean when I go into Time Machine on my Mac, that drive won't show up in the drives to include/omit section?
    Yes, that is correct.
    I guess I'm kind of baffled that the Time Capsule is billed as this great backup device, but can't back up the drive that's connected directly to it.
    Yes, I would have to agree to that as well. It would be reasonable to expect that it could, but I guess the design goal was aimed more to making it easier for folks to back up their computers as seamless as possible.
    Can you recommend a better solution for what I'm trying to accomplish?
    Two that come to mind are solutions based on either Microsoft's Windows Home Server or FreeNAS, but either of these would require additional hardware. Both however support Time Machine backups.

  • Best Backup/Sync Solution?

    i only want a sync/ back up from left to right (only files that got changed or new files that got added) to an external drive...
    i'm tired of manual copy and would like to find a nice app that does it automaticly. i tried a few but i wasn't so statisfied with cronosync and i dont know what else there is that is better.
    any suggestion?

    Hello!
    Being a student, I have had to backup stuff for a while, and so have stumbled across several solutions. I found that the most reliable way was to create an Automator workflow to find and archive the files i want, but this is not for everyone.
    Before that, i used a nifty application called iBackup (http://www.grapefruit.ch/iBackup/). you select the origin folder, and the destination, and it copies and replaces existing files from the source to the destination. it also has the option of only replacing files with older changes.
    Another nice .app is silverkeeper (http://www.lacie.com/silverkeeper/index.htm). whilst not as feature full or nice looking as ibackup, its interface is simpler to view, and arguably easier to setup. however, i wasn't impressed with its scheduling options, persuading me to change to iBackup. also, it has an installer worth of Windows, me preferring the standard application packages.
    Finally, econ's Chronosync is worth a mention (http://www.econtechnologies.com/site/Pages/ChronoSync/chronooverviewold.html). the best backup application i've used so far, and recommended to me by the guys at switchers, Chronosync has extensive scheduling options, an easy to understand interface, a host of options, and a $30 price tag! :P I tried it and enjoyed it, but at the end of the day they all do the same thing, and i think it just wasn't worth $30. if you want my backup script to edit, give me a PM and i'll email you the workflow.
    Good Luck,
    Phil
    EDIT: for an extensive list and review of a lot more backup solutions see http://www.pure-mac.com/backup.html

  • Backup full solution

    Dears,
    Could anybody please advise which is the best Oracle backup strategy for large 24*7 systems? Please provide me with the full details like RMAN hot backup scripts...shell scripts ( e.g. linux crontab ) .. the hardware stuff and tapes you recommend..the full solution please if you can.
    ( I specifically use 11.5.10.2 on Linux platform )
    Appreciate your help.
    Cheers,
    Firas

    It is your application, you should know about hardware required for backupsThis is wrong i have Oracle Applications and Linux platform and it should be some recommended type of tape drives and libraries.
    Also, the backup strategy depends on how much downtime you can have (afford).I think i said a 24*7 system above which means i can't afford any down time by default. so i should use hot backup of course.
    RMAN can backup database only not application tiers. If your DB is large (1-2TB or >>more) you could consider incremental backups, otherwise full daily backup is >>feasible.You are right.
    May be it is better for you to find the commands for yourself.By the way i have my own hot backup RMAN scripts like:
    ===============================================================
    #! /bin/sh
    # User defined parameters
    #set the values for those;
    #SQL> select value from v$nls_parameters where parameter = 'NLS_LANGUAGE';
    #SQL> select value from v$nls_parameters where parameter = 'NLS_TERRITORY';
    #SQL> select value from v$nls_parameters where parameter = 'NLS_CHARACTERSET';
    sid=$1 # Source database
    outputfile=/tmp/$$$sid.bck
    ORACLE_SID=$sid;export ORACLE_SID
    ORAENV_ASK=NO;export ORAENV_ASK
    . oraenv
    unset ORAENV_ASK
    # Setup userid and connections
    echo "connect target /" >> $outputfile
    echo " backup full tag full_backup_08012007 database ;" >> $outputfile
    logfile=/tmp/rman_hot_$sid.log
    rm $logfile 2>/dev/null
    rman cmdfile=$outputfile msglog=$logfile
    rm /tmp/*.bck
    exit 0
    ===============================================================
    And many many scripts..but sharing always good to know if there is a better way to do things. If you have any useful info. Please post it to me here..commands..scripts....backup strategy for a 24*7 systems..
    Cheers my friend,
    Firas

  • Backup of solution manger system on DB2 and windows.

    Hello Gurus,
    I am new to this DB2 database. I have newly installed the Solution Manager 7.0 on windows 64 bit EE and DB2 V9.5 UDB. I am not able to take full backup by choosing the action 'Database Backup to Device'. I am also confused for what value to be entered for Number of Buffers,Buffer Size,Parallelism,Priority in Action details. I am getting the following error in Action log tab.
    Message
    Job started
    Step 001 started (program RSDBAJOB, variant &0000000000000, user ID BASIS)
    Backup_Dev:Database Backup to Device
    Backup_Dev:started by CL_DB6_JOB_BACKUP_DEVICE       on server SOLMAN
    Backup_Dev:Parameter TESTMODE has not been set
    Backup_Dev:Parameter PARALLELISM has been set to " 0"
    Backup_Dev:Parameter RUNTIME has not been set
    Backup_Dev:Parameter BACKUP_MODE has been set to "ONLINE"
    Backup_Dev:Parameter PARTITION has not been set
    Backup_Dev:Parameter BACKUP_TYPE has been set to ""
    Backup_Dev:Parameter COMPRESS has been set to "COMPRESS"
    Backup_Dev:Parameter INCLUDE LOGS has been set to "INCLUDE LOGS"
    Backup_Dev:Parameter NUMBER_BUFFERS has been set to " 0"
    Backup_Dev:Parameter BUFFER_SIZE has been set to " 0"
    Backup_Dev:Parameter PARALLELISM has been set to " 0"
    Backup_Dev:Parameter UTIL_IMPACT_PRIORITY has not been set
    Backup_Dev:Parameter FILE_PATH has been set to "H:\BKUP_251108"
    Backup_Dev:Command '   'failed
    Exception CX_DB6_CON in program CL_DB6_JOB_BACKUP=============CP / CL_DB6_JOB_BACKUP=============CM002 at line ADBC error with return code = 1.208
    Backup_Dev:Exception CX_DBA_JOB in class CL_DB6_JOB_BACKUP
    Backup_Dev:  Kernel Error ID:
    Backup_Dev:SYSID:
    Backup_Dev:  SY-SUBRC: 1208
    Backup_Dev:  SY-TABIX: 0
    Backup_Dev:  Message: ADBC error
    Backup_Dev:  Database:
    Backup_Dev:caused by
    Backup_Dev:Exception CX_DB6_ADMINCMD in class CL_DB6_ADMIN_CMD method EXECUTE_CM
    Backup_Dev:  D line 43
    Backup_Dev:  Kernel Error ID:
    Backup_Dev:  SYSID: SMS
    Backup_Dev:  SY-SUBRC: 1208
    Backup_Dev:  Message: ADBC error
    Backup_Dev:  Command: BACKUP DATABASE SMS ONLINE TO"H:\BKUP_251108" COMPRESS INCL
    Backup_Dev:UDE LOGS
    Backup_Dev:  Database:
    Backup_Dev:caused by
    Backup_Dev:Exception CX_SQL_EXCEPTION in class CL_SQL_STATEMENT
    Backup_Dev:  Kernel Error ID:
    Backup_Dev:  DB Error: Yes
    Backup_Dev:  SQL Code: 2413-
    Backup_Dev:  SQL Message: SQL2413N Online backup is not allowed because the dat
    Backup_Dev:  abase is not recoverable or a backup pending condition is in effect ro
    Backup_Dev:w=1
    Backup_Dev:  DB Object Exists: No
    Backup_Dev:  Duplicated Key: No
    Backup_Dev:  Internal Error: 1
    Backup_Dev:  Invalid Cursor: No
    Backup_Dev:  Unknown Connection: No
    Backup_Dev:  Connection Closed: No
    Exception CX_DBA_JOB in class CL_DB6_JOB_BACKUP method  line 40
    Backup_Dev:terminated with error
    REASON=ADBC error
    Job finished
    Please suggest me what to to resolve this problem. Is there I need to set the perticular db parameters settings by changing default one. Also please tell me any special post installation activity required for DB2 database after installation unlike Oracle or SQL server.
    Please Reply.

    Backup_Dev:  SQL Message: SQL2413N Online backup is not allowed because the dat
    Backup_Dev:  abase is not recoverable or a backup pending condition is in effect ro
    You are cyclically overwriting your log - that´s why you can´t do an online backup. To change that, you have to configure logging properly and then do an offline backup first. After that you can do online backups (also see https://publib.boulder.ibm.com/infocenter/db2luw/v9r5/index.jsp?topic=/com.ibm.db2.luw.messages.sql.doc/doc/msql02413n.html)
    To get an idea what you need to do configure check the guide
    https://www.sdn.sap.com/irj/sdn/db6
    --> Database Administration Guide "SAP on IBM DB2 for Linux, UNIX, and Windows
    Markus

  • Best Backup / Archive Solution?

    I'm new to the forum discussions and was hoping someone could offer some advice as to the best and easiest back-up solution in my situation.
    I work for a company that does not have a back-up solution for the 1 G5 mac connected to their windows SBS network. Yes, this is insane because this mac contains thousands and thousands of graphic files that go back 10+ years or so and probably occupies 80GB+ of space too.
    The company has a graphic artist that uses this G5 daily creating more graphic files. I am looking for the best Automated back-up solution that doesn't require the user to manually start a back-up and have to wait for it to complete - especially since there is 80GB worth of files. I'm not really concerned with backing up applications or program files, but more concerned with archiving the graphic files. I've looked online at solutions such as rsync, disk image files, raid with 2nd hard drive, and back-up apps with external drives such as Carbon Copy or Super Duper but wanted to get some advice from experienced mac users that may have dealt with my same issue.
    Any help or advice would be appreciated. Thanks.
    Message was edited by: bbstyl

    Basic Backup
    Get an external Firewire drive at least equal in size to the internal hard drive and make (and maintain) a bootable clone/backup. You can make a bootable clone using the Restore option of Disk Utility. You can also make and maintain clones with good backup software. My personal recommendations are (order is not significant):
    1. Retrospect Desktop (Commercial - not yet universal binary)
    2. Synchronize! Pro X (Commercial)
    3. Synk (Backup, Standard, or Pro)
    4. Deja Vu (Shareware)
    5. Carbon Copy Cloner (Donationware)
    6. SuperDuper! (Commercial)
    7. Intego Personal Backup (Commercial)
    8. Data Backup (Commercial)
    The following utilities can also be used for backup, but cannot create bootable clones:
    1. Backup (requires a .Mac account with Apple both to get the software and to use it.)
    2. Toast
    3. Impression
    4. arRSync
    Apple's Backup is a full backup tool capable of also backing up across multiple media such as CD/DVD. However, it cannot create bootable backups. It is primarily an "archiving" utility as are the other two.
    Impression and Toast are disk image based backups, only. Particularly useful if you need to backup to CD/DVD across multiple media.
    Visit The XLab FAQs and read the FAQs on maintenance, optimization, virus protection, and backup and restore. Also read How to Back Up and Restore Your Files.
    Although you can buy a complete FireWire drive system, you can also put one together if you are so inclined. It's relatively easy and only requires a Phillips head screwdriver (typically.) You can purchase hard drives separately. This gives you an opportunity to shop for the best prices on a hard drive of your choice. Reliable brands include Seagate, Hitachi, Western Digital, Toshiba, and Fujitsu. You can find reviews and benchmarks on many drives at Storage Review.
    Enclosures for FireWire and USB are readily available. You can find only FireWire enclosures, only USB enclosures, and enclosures that feature multiple ports. I would stress getting enclosures that use the Oxford chipsets (911, 921, 922, for example.) You can find enclosures at places such as;
    Cool Drives
    OWC
    WiebeTech
    Firewire Direct
    California Drives
    NewEgg
    All you need do is remove a case cover, mount the hard drive in the enclosure and connect the cables, then re-attach the case cover. Usually the only tool required is a small or medium Phillips screwdriver.

  • Is there a good backup / imaging solution for Windows 10, yet?

    I'm waiting for Veeam Endpoint 1.1 to hit, supposedly within the next week or two.

    We upgraded one laptop at home and I wasn't very surprised to find out that the backup / imaging program we were using on Windows 7 (Backup Exec System Recovery) stopped working.  It's a nice program that I've been using for years - creates a base image then incrementals on a schedule.  Allows for simple full bare metal recovery or for file recovery by mounting an image inside the program.
    Have any of you tested anything similar in Windows 10?
    This topic first appeared in the Spiceworks Community

  • Macbook Backup/Storage solution

    I have an older Macbook (purchased in 2007 or 2008) and have been getting the error message start up disk full.  I have deleted a lot of files or moved them to an external hard drive and emptied the trash but am still getting the error message.  When I try to do software updates, I get the same message.
    Is it time to get a new laptop?  I was also considering joining icloud and migrating my photos and music there but I would have to get Snow Leopard and then Lion to have the right OS for that and I'm not sure my laptop would have enough space for me to install those.  Any recs?  I'd like to have a good long term solution for backing up files, music and documents and helping keep my start up disk running:)
    Thanks,
    Laura

    I have an older Macbook (purchased in 2007 or 2008) and have been getting the error message start up disk full.  I have deleted a lot of files or moved them to an external hard drive and emptied the trash but am still getting the error message.  When I try to do software updates, I get the same message.
    Is it time to get a new laptop?  I was also considering joining icloud and migrating my photos and music there but I would have to get Snow Leopard and then Lion to have the right OS for that and I'm not sure my laptop would have enough space for me to install those.  Any recs?  I'd like to have a good long term solution for backing up files, music and documents and helping keep my start up disk running:)
    Thanks,
    Laura

  • Backup & Storage Solutions?

    Hi,
    I'm a new Mac user and just got a 13"MBA. I have already filled up the hard drive, mostly with pictures and videos. I have an external hard drive (2TB) which I am using for the Time Machine. Can I also use this to store files? How do I transfer them from the Air to the external drive, and then how can I access them when I need them?
    Thanks!

    Make sure that you have read & write permission to the file,
    click the file (two finger) to bring up menu
    select "get info "
    on the the bottom by Sharing & Permissions:
    you should have Read & Write Access
    if you do not  click on the lock enter the administrator password. give yourself permission
    Hope this helps
    kathy

  • Backup Solutions for my MacBook Pro+

    I have a Macbook Pro (2010) w/500gb hard drive. I have one 500gb external hard drive that holds movies and my Aperture library. My current backup solution is a 2nd external hard drive (2TB) that I attach to my laptop while my smaller external hard drive is attached (it is not excluded from the backup).
    I manually attach the laptop and 500gb ehd every week or so to backup to Time Machine
    The problem?  My laptop is approaching it's limit and I'm thinking that I need to move my iPhoto library off to an ehd as well.
    I'm wondering if backing up to my Time Machine drive with a laptop and two ehd (each 500 gb) is smart or if I need to backup those hard drives to other ehd separately.
    Also, I plan to buy an iMac for my family in the next couple of months.  Not sure how that should impact my backup configuration.
    I've also heard that in addition to Time Machine I might consider getting an ehd specifically with the purpose of being a bootable drive (via Super Duper)
    With all of these options my head is swimming a bit.
    Would love recommendations for a backup workflow/solution based on my equipment.
    Thoughts?

    Pretty much any drive will work, but for a laptop, you might like to get a portable drive (doesn't require that you connect it to power) with USB3. Thunderbolt drives are also available, but they're more expensive and no faster than USB3 for a single hard drive.
    I personally like the Lacie rugged series: http://store.apple.com/us/product/H9377ZM/A/lacie-1tb-rugged-hard-drive-triple-u sb-30-5400-rpm?fnode=5f
    If you shop around you should be able to get it a little cheaper than Apple's prices.
    Matt

  • UCS Backup solution

    Hi all,
    Recently, my company bought Cisco UCS system, but we couldn't build the backup solution for it.
    We have experienced on RLX blade servers. It has very good backup and restore solution. The system is controlled by Control Tower server.
    Can I do the same thing on the Cisco UCS?
    If it is not, how can I do backup solution for UCS blade server?
    Best regards,
    Enkhbat.N

    Enkhbat,
    Are you referring to backing up the UCS Manager configuration or the blade Operating Systems?
    UCS can backup & restore it's configuration from UCS Manager.  This can also be scripted using XML and other 3rd Party management applications also.
    There's no "bundled" backup solution specifically for UCS.  The hardware itself will work with any backup software solution the bare metal OS can support.  We have many customers using many different backup solutions depending on your requirements.  To name a few of the popular ones:
    EMC Avamar
    Commvault Simpana 
    Symantec Backup Exec
    Vertias Netbackup
    Are you looking for a blade network based or Fiber Channel array backup solution?
    Regards,
    Robert

  • The backup disk image could not be mounted - I found the cure?!

    Hi all,
    being a recent Windows to Mac convert I was very happy about my new MBP together with a brand new 1 GB TimeCapsule. First time, worked like a charm backup and restore. Then, last backup with 10.5.2, install 10.5.3, "Backup now" - nothing. I was pretty p*ssed and thought: that is exactly why I didn't want to use Windows anymore. I thought, Apple can't be doing the same cr@p as the Redmond dudes. Well, they did. Soon after 10.5.3 was out word had it that 10.5.4 as already around the corner so I figured, I'll wait for it. Just to be disappointed. After hoping for a solution in these forums none of the just re-assign the backup drive solutions worked for me.
    Having found a solution somewhere about mounting the TC manually I managed to run backups again which clearly showed that the fr@cked it up as it indicated a stupid permission issue. I then took a look at the error message again:
    "Network mountpoint /Volumes/Time Capsule not owned by backupd... remounting"
    So I went and looked for that backupd and found it within /System/Library/CoreServices. Knowing that it did work last with 10.5.2 I figured, let me grab the 10.5.2 combo update and restore the backupd + the backup.bundle from the old version and give it a shot (making backup copies of them first).
    Sure enough, told it to install them 2 to the default location, re-selected the TimeCapsule as backup target, hit "Start Backup" et voilà: currently "Backing Up: 1.4 GB of 5.1 GB"
    Bottom line: Apple messed up the backupd binary somehow - way to go, QA team!
    Anywho, seems to be working now. Also access is working at this point. Have to recheck if Time Machine still works if the TC is not mounted due to the running backup.
    Maybe someone else can verify this to see if it helps them too?
    Cheers!

    Actually the path is shown in the system log. (My log had just rolled over and I didn't see the exact error message anymore - had used "locate" to find it)

  • VERY IMPORTANT QUESTION: Backup/Storage problems

    Please help!!!
    Ok. I'll try to explain this but it's kind of confusing so I'll do my best.
    OK, so a few weeks ago, (maybe 2 or 3 weeks I don't remember) I had about 30 GB free on my MacBook Air's Macintosh HD storage drive. I have a Windows partition that takes up about 48GB out of my 121 total GB. The mac part of my computer has like 72 GB. Like I said, I had about 30 GB free on my mac side; I had about 9-15 GB or so of pictures from my iPhone, photo stream, and laptop. I had about 18 GB of apps, etc.
    This was on November 10th I think, and the only thing that happened between then and like 1 week ago was free space went from 30>> 27GB or so.
    Problem: iCloud almost full from iPod backup, iPhone almost full from videos and pictures.
    Proposed solution: Move iPod and iPhone pictures to MacBook Air so I have space on iCloud, iPod, and iPhone.
    Anyway, for Christmas, I got a new Seagate 1 TB backup external drive thing. I thought this was plenty of room for my tiny computer. I decided to backup my computer. 
    Problem: I forgot to transfer my iPod and iPhone pictures >> MacBook Air >> Backup
    Proposed solution: Move photos from iPod and iPhone to MBA and go from there.
    On Christmas, I decided to just synch everything. I plugged in my iPod and put my photos onto my computer and deleted them from iCloud (at this point, I was trying to free up space on my iPhone). I had about 3.2 GB on my iPod of photos and videos, and I transfered them to my iPhoto on my MacBook Air. I deleted them off of iCloud. Then, I plugged in my iPhone, and I transfered my 6.5 or so GB of videos and pictures to iPhoto.
    What happened: I transfered all of my iPod and iPhone stuff to my MacBook Air. My iPhoto now has about 16-17 GB of stuff.
    Problem: My backup doesn't have my pictures. The last time I backed it up was before I had all my pictures on my computer.
    Proposed solution: Get all iPod pictures in one folder, get all iPhone pictures in one folder, move them to the backup.
    I didn't want to backup my computer with my pictures on it, because if I deleted them from my computer and backed my computer up again, my backup would delete the pictures it had backed up. If that makes sense.
    Proposed solution: Move folders to backup. Like so:
    After doing all these transfers all night until 12:30, I thought I was done. Then, this morning, I remembered that I still had to delete my pictures off of my computer, because they were now on a flashdrive (forgot to mention that) and a backup.
    THIS IS WHEN THE BIG PROBLEM OCCURS/IS REALIZED
    OK:
    1) I go to iPhoto, select all of my pictures, and I move pictures to trash
    2) I go to the trash bin/can/whatever it is and I click "empty."
    3) I thought this would free up the 15 or so GB on my computer.
    4) I go to Finder, and I realize that iPhoto has indeed shrunk from 16.9 or so GB >> 1.27 GB.
    5) I go to Finder >> Macintosh HD >> info >> says I have 24.38 GB free. I'm happy.
    HOWEVER
    I go to the upper left-hand corner, click the apple, hit about this mac, hit more info, hit storage... AND:
    My iPhoto went from 16.something >> 1.27 now. I deleted like 15.64 or 15.65GB. This is now under backups. My Photos and movies number shrunk, but my other and backups increased dramatically
    What happened/Problem: The exact amount of storage space I deleted from iPhoto is the amount for Backups (it differed by like 1 MB). Coincidence? How did this happen?! Why did this happen?
    What happened/Problem II: Now there is 23.65 GB under other?!?! All I did was move pictures temporarily to my computer and then I deleted them, and I also backed up my computer using Time Machine to back it up to my... backup.
    What finder thinks:
    My Question: WHAT THE HECK HAPPENED AND HOW DO I FIX IT. I thought this would free up space on my iPod, iPhone, and computer, but it took away free space on my computer. I've read online and I can't find a solution or answer. Finder and storage say completely different things. I don't know how much space I really have, and why they differ.
    What is this and what do I do to remove the other/backup space? I threw away the pictures and deleted the iPhoto pictures, but it thinks they are still there? I've tried searching finder, but I can't find out where all my space is vanishing to.
    Thank you so much for reading and please help! It would be VERY MUCH APPRECIATED.

    Personally, I say you forget about the data allocation feature of "About this Mac." I swear, someone in Cupertino designed that feature to drive up support calls more than provide insightful information on your storage allocation.
    You are correct that the "backup" component is the local snapshots of Time Machine and that flagged as allocated space frees up in the event that you need the space. In Apple's defense that functionality of Lion & Mt. Lion is pretty neat. Even though it just gives people another excuse to be lazy about not keeping a good and proper external backup solution.
    Notice my Backups allocation, it's Zero KB. It's always Zero KB. There's a terminal command to stop OS X from creating the local snapshots, it'll require you to authenticate in terminal to process the command.
    The command - sudo tmutil disablelocal
    In the event you change your mind and want to re-enable it, the command for that is as follows -
    sudo tmutil enablelocal (you'll be prompted for the admin password again)
    For what it's worth, there's no harm in disabling this functionality. It's just extremely important that you maintain current backups of your data at regular intervals should you decide to disable this functionality... you know like you had to do with every other version of OS X (pre-Lion).
    Regarding the "other" category, here's a pretty good write up.
    http://pondini.org/OSX/LionStorage.html
    Personally the accuracy of the reporting categories are a bit wacky. Even more frustrating is that you can't dive into what exactly is considered "other" or see it color categorized in Finder. Perhaps that'll be a feature of OS X 10.9 - Ocelot*
    *I have no idea if Apple will even release an OS X 10.9 or what it'll be called, it was a joke. You can call off the forum police.
    If you're looking for an accurate representation of what's on the drive, where it's located in the various folder directories and exactly how much space it's using then a program like:
    - Daisy Disk
    - OmniDiskSweeper
    - Disk Inventory X
    - WhatSize?
    All will be much, much better for those purposes. I used ODS for years and love the product, I just recently started using Daisy Disk after a recommendation from someone on these message boards. All of them are "free" but many of them require you to pay to enable features. But for the purposes of inventory, categorization and displaying of your data that functionality is free.

  • Algorithm for online backup and restore of the entire grid

    Hello!
    I am trying to write a utility program that backs up the entire grid data to a binary file and restores it at a later point in time. Assuming that the class files are not updated, I am using the following simple logic
    1. Use the cluster and CacheService APIs, get the names of all named caches of types replicated, distributed and optimistic
    2. Iterate through each named cache and use ExternalizableHelper.writeMap method to extract the data as byte arrays
    3. Create a custom datagrid object holding a map of byte arrays by names
    4. Write the custom object to a persistent storage
    Similar logic to restore the data grid from the custom object on the disk.
    I have the following questions
    1. I am sure the above logic is not going to recreate the entire datagrid in the exact state it was backed up. For e.g. if I used write-behind, I must either flush or backup the write-behind queue. What other objects should
    I consider backing up other than the data from the named caches? If I used the incubator patterns, I am guessing I need to backup the command objects and functor objects.
    2. I do not have a need for other cache services now. If I need to use the same utility across different grid configurations, what other services should I include for the back up (overflow, external, paged external) ?
    3. Are there best practices for such use cases? Any insights you can provide to enhancing this utility would be much appreciated.
    Thank you
    Regards,
    Sairam

    Hi Sairam,
    If you want a non-intrusive solution then you cannot really use cache stores, as these would certainly intrude into the cluster. Cache stores would also not really be an option if the cluster already used another type of cache store - unless you write some sort of multiplexing cache store.
    If your backup/restore solution needs to be a "client" (optionally over Extend) then you have two choices:
    1. Build something that is run whenever you want to do a backup - this would usually be an Extend client application. This application would then read data out of the caches and write it to disk. With this option a backup might take a while if the cluster is large but running the backup is pretty easy.
    2. Build something that is permanently connected to the cluster being backed up and uses Map listeners to listen for inserts and updates and stores the data to disk. This application could be either an Extend client or a storage disabled cluster member. With this option your cluster is always backed up in real time but you have the overhead of another process to manage.
    If all your caches use POF serialisation then either of the above options could be written to just store the POF binary without having to deserialize it and could then be "bolted on" to any cluster. Re-loading stored binaries would need a bit of thinking about although a couple of options come to mind. If you just worked with the binary you might not need to worry about you backup application needing the pof-config of the cluster.
    You backup application would need to either be told which caches to back up or be able to dynamically figure out what caches had been created. You cannot always do this from the cache config file if the cache names in the mappings section use wild card names.
    As you can see there is lots to think about if you want to build something truly non-intrusive.
    JK

Maybe you are looking for