Critique my backup solution please, suggestions?

My system generally looks like this:-
/home/data has the majority of my 'work', its a separate partition (by far the largest).
/home is also a separate partition. /home/ngoonee doesn't have much, just configs and stuff I was lazy to move (about 20 MB).
Under /home I have:-
/home/LinuxProg - some programs which are outside pacman management (Matlab and small utils) as well as my wine/dosbox drives (20 GB...)
/home/scripts and /home/shortcuts - my own utility scripts and some .desktop files which I link to /usr/share/applications for those scripts (I use gnome and gnome-do).
Previously I would simply backup /home/data using rsync and tar up /home to a single 20+GB file. The reason for that backup configuration was basically that my external hard disc was NTFS.
Today I decided to reformat the external hard disc, will be splitting its space between NTFS and ext3. So I have the following plan:-
rsync for /home/data to the NTFS partition, since some data there would sometimes be used by Windows systems.
rsync for /home/LinuxProg to the ext3 partition, since the wine prefixes especially need the links maintained, which NTFS can't do.
rdiff-backup for /home/ngoonee - incremental backups of my configs sounds good
rdiff-backup for /home/scripts and /home/symlinked - see above
rdiff-backup for /etc - I haven't backed this up before, but figure I may as well. Would have to run this one as root.
Any comments? Seems simple enough. Are there better tools for the job (rdiff-backup seems to be best recommended on our wiki)?

ngoone,
I feel that the most useful backup strategy involves historic backups rotated over several periods of time. My linux experience at this point does not allow me to provide you with the tools to do such. But here's what I have learned way back in the early 90s when I was a junior maintaining an IBM ES9000 and a VAX/VMS in Alcatel, and adapted to what I believe could be your requirements (I've been using similar strategies on my own systems ever since):
Daily Backups:
1. Keep a daily sync backup of what you want to manage
2. Rotate the daily backups over a period of 1 week (working days, or full weeks depending on your computer usage pattern)
Weekly backups:
1. Keep a weekly sync backup from the last daily backup that week
2. Rotate the weekly backups over a period of 1 month
Usually the need to restore happens across small time spans (e.g. you need the backup from yesterday because you messed up with some files). However you are also guaranteed sync access to a full weekly backup in daily intervals and a full monthly backup in weekly intervals, in case things did get hectic.
You'll also note I don't take diff backups in a high regard But for completeness, you may want to maintain an history backup on top of that (a diff monthly backup that you do at the end of each month).
Of course you can adjust all this to your needs (personally I usually like to span daily backups over a larger period of time while still maintaining weekly backups). Maybe you will want to ignore the brunt of all this. But, as far as my humble opinion goes, no backup strategy is sound without you taking an historic approach to it. For even better security, include ewaller advise above into all this.
Note:
This is a disk hog. But for all the better reasons. Personally, I'd rather have a dedicated disk or partition for my backup needs.
Last edited by marfig (2010-08-23 13:08:13)

Similar Messages

  • 2x 10.5.2 xServe + raid backup solutions  - Suggestions please!

    Hello,
    I'll give a brief overview of what I'm rolling out. *Limited budget* So keep that in mind
    Basically I'm just looking for suggestions on backup solutions for this particular setup. I have been hearing mixed reviews of most backup solutions under 10.5.x... (In 10.4.x server I was relatively confident with Retrospect and had performed restores before).
    --2 xServes, One web server, one for local services like mail, OD, AFP, Cal, etc. each has 2x 80gb drive (boot volume + mirror). Advanced server config.
    --1x raid configured as raid6 with 4TB useable after formatting and parity. Data (user directory, mail store, calendar, web sites and database, etc) will be on the raid volumes, the 80 gb drives in xserves are only for OS and log files.
    --All clients are using MacBook Pro's and most users have minimal data. Most data will be mail and quicktime videos (compressed for web, originals on mini dv tapes).
    --MacBook Pro's already live, current server is SBS 2003 and it handles backups via Retrospect.
    --Backups will have to be D2D, tape is not an option in this case. This means two external drives for backup (one on site and one off site, cycle on friday). Probably 2TB FW800 for each drive as entire raid isn't being backed up, some of it is scratch storage so 2 TB is plenty for now).
    Naturally I want to use time machine but I am hearing of horror stories using time machine to backup advanced server in 10.5. Also seeing issues with cyrus (mail) and time machine (I will be running mail services). In addition, I don't think I could do any sort of cycle with the two external drives using time machine? The lack of configurability in time machine worries me. And finally, I don't know how time machine does with active database' (Ie: sql database for web server, I just don't know if time machine will cause problems when trying to back live database up). If someone has experience with time machine in a similar setup I'd love to hear your thoughts / suggestions.
    Alternatively there is retrospect. We already own a license and I am familiar with administering it on 10.4.x. How reliable is it for backing up 10.5.2 clients and 10.5.2 server? Including active databses (Again the web server sql databases, etc? Kind of a pain restoring anything from retrospect (Especially entire server if / when it has to be done) but it was tried and true for me in 10.4.x server installations.
    These MacBook pro's will also likely become mobile homes once all is said and done (But currently are not as the xServes are not installed yet). Time machine + mobile home directory seems like a lot of data being backed up that is probably redundant?
    To top it all off, until new office is ready (All gigabit when that happens in ~1 year) network is as follows:
    Servers have 100 mbit full duplex connection
    Clients have 10mbit half duplex (This is where time machine really frightens me with hourly client backup).
    Considering above, I can either:
    A: Run proactive backup script from retrospect for all clients and then nightly backup for select raid volume contents + server boot volumes.
    B: Not backup clients directly via retrospect and only backup contents of the raid volume (Which is where the mobile homes will be stored). Mobile home sync would be set to occur on login / logout only (Considering 10mbit client connections, I don't want active or user initiated sync heh).
    Thoughts / suggestions? Thanks in advance, any suggestions are much appreciated. Hardware is set in stone but backup solution is not so most aspects of backup solution can be changed =)

    First of all, thanks for your reply!
    Well I should clarify in that I wasn't going to operate "network" homes and that they were just going to be the mobile homes with sync only occurring at login / logout. Even then, I think I'd run in to issues with the 10base-T for the client systems. The servers are on 100base-T full duplex. Currently All of the Windows systems do the same and logging in / out isn't too terrible but I couldn't imagine actually running the home directories off the server on 10base-T.
    Do you still think mobile homes would be too much with just the login / logout sync? If so, I'll simply avoid this option until we get our new building and gigabit networking all around in the next year.
    You're correct in that all clients will be running 10.5.2.
    If I am not running mobile homes, I suppose the easiest way then is to in fact backup clients via time machine to the raid volume and then backup the entire raid volume (Hence all of our sites, compressed video files and databases to a large external drive (Maybe I'll get a couple 3 or 4 TB raid drives instead... lol). Naturaly I'd select the scratch disk directories and tell time machine to ignore them. Only issue there being that I may run in to space concerns like you say. If it becomes a huge problem and apple still hasn't made TM more configurable by then, I could use the time machine editor app or modify the intervals myself. I'd rather not and will only do this if it becomes an issue
    From what I can gather, time machine is not making complete duplicates of an active database (MS Entourage in this case) and is only backing up the changes. I was worried about how it handled this and whether it would detect a change and just backup the entire database again (Which would be a nightmare if it did this for our web directories as they have active databases running).
    Do you know of time machine will wreak havoc with active databases (Like the ones our websites use, a couple small sql databases and one larger one).
    I think time machine would work well with the method you suggested. So I can just set it to backup all clients to the raid volume and then setup time machine to backup the raid volume to the external disk? For my off site... I suppose I could just bring in the second identical external drive every Friday and copy the time machine backup database from the on site backup drive on to it and then get it out of there each evening.
    As for backing up the servers themselves, they will not be storing much of anything and most everything will be pointed to the raid volume (Hence the 80GB drives). Because of this, the data on the servers themselves will not change THAT much compared to the raid volume which will change drastically every day so full backups of the servers is fine. Perhaps just setting psyncX (assuming it works in 10.5) to backup the 80GB boot volume for each server would be best? I could just set psyncX to backup each server boot volume to the same external drive the raid volume is backing up to and then each friday just copy the data from the on site drive to the external, killing two birds with one stone. (Tape would make this all easier but it isn't gonna happen in this case sigh).
    I worry about the cyrus / mail issues I'm reading about on servers running time machine though.

  • In mail, after importing mailboxes the process gets stuck on '1619 of 72826' and 'time remaining' climbs infinitely. Please suggest a solution.

    In 'mail', after importing mailboxes the process gets stuck on '1619 of 72826' and 'time remaining' climbs infinitely. Please suggest a solution.
    I converted my mail boxes from POP to imap for the purpose of syncing all my devices. I backed up my mail boxes and further more perfomed a timemachine backup.
    Upon restoring ther mailboxes, either by manually copying them to the mailboxes folder, and restoring a timemachine backup, both pocesses result in the above problem.
    Please recomend a solution.
    file://localhost/Users/redwood/Desktop/Screen%20Shot%202013-10-15%20at%201.48.10 %20PM.png
    file://localhost/Users/redwood/Desktop/Screen%20Shot%202013-10-15%20at%201.38.30 %20PM.png

    Can anyone out there please help!

  • I cannot send email over 3G. Receiving email is ok. Using wifi from my landfibre allows me to send email. No idea where to find the solution. Suggestions please. Thanks ia

    I cannot send email over 3G. receiving email over 3G is ok. Using wifi from my landline (glass) is ok. No idea where to find the solution. Suggestions please. Thanks i.a.
    TheOne

    You need a DATA service enabled by your carrier to be able to send e-mail via thier network.  Do you have a data plan with your carrier ?  If so - is it enabled ?
    Can you access internet thru your network (not wifi) ?

  • Hi, I recently upgraded my xcode to 5.1, my project is running well in ios 7.0,6.0, But in ios 7.1 i'm getting error like"iOS Simulator failed to install the application". Can anybody please suggest the solution for it.

    My project is not running in ios 7.1 simulator i'm getting error like "iOS Simulator failed to install the application". Please suggest a solution for it.

    We aren't Apple, just users like you. Have you tried a reset? Hold down the home button along with the sleep/wake button until the screen goes black and you see the Apple, then let go. (No data loss)

  • Hi .. My phone has stopped vibrating.I have read the solution given by some users on this forum and have tried all the tricks. But nothing seems to be working. My phone still does not vibrate.please suggest

    Hi .. My phone has stopped vibrating.I have read the solution given by some users on this forum and have tried all the tricks. But nothing seems to be working. My phone still does not vibrate.please suggest.

    Hi .. My phone has stopped vibrating.I have read the solution given by some users on this forum and have tried all the tricks. But nothing seems to be working. My phone still does not vibrate.please suggest.

  • I am using UPK developer 12.1.0 single user. My sofware has crashed and needs reinstallation. Please suggest how can I take back up of my source files. I am unable to open the application and i can not locate the library backup folder on my local machine.

    I am using UPK developer 12.1.0 single user. My sofware has crashed and needs reinstallation. Please suggest how can I take back up of my source files. I am unable to open the application and i can not locate the library backup folder on my local machine.
    Also, does reinstallation takes the back up automatically or the files will be lost. Please help.

    Here are a bunch of scripts to get folder size under all circumstances.  Take your pick.
    https://gallery.technet.microsoft.com/scriptcenter/site/search?query=get%20folder%20size&f%5B0%5D.Value=get%20folder%20size&f%5B0%5D.Type=SearchText&ac=2
    ¯\_(ツ)_/¯

  • I have a situation please suggest some transactional solution.

    hi,
        I have two databases one is entry database (DB1) Where entery is done, other database is reporting database (D2).
    we are trying to transfer data using stored procedure from db1 to db2. the  sp will be scheduled to run after every 20 to 30 sec.
    in db1 we keep three cols in all tables transferedcol, updatedcol, activecol.
    --activecol gets 1 if when record is entered first time and remain same while updation.
    this col gets 2 if deleted( we do not do physical deletion we only mark 2 in activecol and updagtedcol)
    --transferedcol gets 1 if not transfered to db2, if transfered to db2 then we put 0 in it.
    if record gets updated then it gets 1 again so that we can transfer it again.
    --updatedcol gets 0 for new entry of  each record and 1 if updated after transfer of the record to db2 else if any one tries to updated it before transfer then it will be 0 for new record , after the transfer of that record if some one updates the record
    then it gets 1 and remains 1 throught out the life . yes it gets 2 if record is deleted ( deletion is not  physical , it is logical by setting 2 in activecol and updatedcol).
    in db2 we have only required cols for reporting,  but if required we can keep some cols like transfered ,active and updated.
    this db2 has fk and table gets record from joins of many tables of db1 which also has  fks
    that is schema is not same.
    Q1) i want to transfer only the records having transfered col marked as 1 and after transfering i want to make them 0 from the stored procedure which runs after every 20 30 sec.
    please suggest some solution with isolation level.
    note: on db1 i want that entery should not be blocked to much and at the same it want stored procedure to transfer the data from db1 to db2 so that people can see the report at the very time.
    yours sincerley

        I have two databases one is entry database (DB1) Where entery is done, other database is reporting database (D2).
    we are trying to transfer data using stored procedure from db1 to db2. the  sp will be scheduled to run after every 20 to 30 sec.
    Have you considered replication?
    BOL: "SQL Server Replication
    Replication is a set of technologies for copying and distributing data and database objects from one database to another and then synchronizing between databases to maintain consistency. Using replication, you can distribute data to different locations and
    to remote or mobile users over local and wide area networks, dial-up connections, wireless connections, and the Internet.
    Transactional replication is typically used in server-to-server scenarios that require high throughput, including: improving scalability and availability; data warehousing and reporting; integrating data from multiple sites; integrating heterogeneous data;
    and offloading batch processing. Merge replication is primarily designed for mobile applications or distributed server applications that have possible data conflicts. Common scenarios include: exchanging data with mobile users; consumer point of sale (POS)
    applications; and integration of data from multiple sites. Snapshot replication is used to provide the initial data set for transactional and merge replication; it can also be used when complete refreshes of data are appropriate. With these three types of
    replication, SQL Server provides a powerful and flexible system for synchronizing data across your enterprise. Replication to SQLCE 3.5 and SQLCE 4.0 is supported on both Windows Server 2012 and Windows 8.
    As an alternative to replication, you can synchronize databases by using Microsoft Sync Framework. Sync Framework includes components and an intuitive and flexible API that make it easy to synchronize among SQL Server, SQL Server Express, SQL Server Compact,
    and SQL Azure databases. Sync Framework also includes classes that can be adapted to synchronize between a SQL Server database and any other database that is compatible with ADO.NET."
    Kalman Toth Database & OLAP Architect
    SQL Server 2014 Database Design
    New Book / Kindle: Beginner Database Design & SQL Programming Using Microsoft SQL Server 2014

  • Please suggest on: SAP Solution Manager Installation

    Hi Experts,
    We are going to install SAP Solution Manager in our landscape. Our present SAP version is: ECC 6.0 and Database is: Oracle 10.2.0.2 and OS is: AIX 5.3
    1. Please suggest us which is the suitable Solution manager version for our environment?
    2. What are the pre-requisites and needful steps to take before starting the installation?
    3. Where can I get complete step by step documents for this activity?
    4. Which OS & DB  is suitable for our environment?
    Thanks in advance!
    Veera

    Can I also ask for some confirmation about a couple of things.  I have looked at the SAP documents but I can't find a definite answer to these questions:
    1.  David Kroone - you say that Solution manager should be set up on a new server but I understand that it is possible to run it on one of our existing R/3 servers.  Is this correct?  Does anyone have any comments about this?
    2.  David - you also say that we can pick any OS & DB for the Solution Manager server. We are running R/3 on Oracle/Solaris but would prefer to run Solution Manager on a Windows server running SQLServer.  Is this definitely OK?  (it would be cheaper though you advise that using the same platform could make it simpler - is this because Solution Manager works better on the same platform or is it just because we would then have a more homogeneous environment?)
    3.  We are currently on 4.7 but plan to move to ECC6 this summer.  We want (need?) to install Solution Manager before we upgrade to ECC6.  Should this affect our decision in anyway?
    Sorry to re-ask the same questions but it's difficult to find a precise answer in the SAP documents.

  • I am unable to use Highlight Tool in Adobe Reader X. Please suggest me solutions.

    I am unable to use Highlight Tool in Adobe Reader X. Please suggest me solutions.

    Hi -graffiti
    Thank you again for your 10.24 post.  I tried your suggestions today.  The university computer lab i use has Adobe Acrobat Pro 6.  The OCR function is under the dropdown menu "Documents>>Paper Capture".  This permits conversion a scanned page to searchable text.  Before beginning it asks you to select 1 of 2 Settings defined as:  "Primary OCR Language English", or "PDF Output Style:  Searchable Image (Exact)".  That is the only choice to be made before conversion begins.  After the conversion you can review and correct suspect words on captured pages.  I tried both choices and regardless of which ended up with a document that was searchable, but still would not permit highlighting (I selected text with the highlight tool, clicked and dragged over a captured page, and nothing happened, same result as my earlier post).  If I search for a particular word, all occurrences become shade-highlighted but if I expressly attempt to highlight a word with the highlighter it won't do it. 
    Do you have any suggestions as to how I might further massage the data?

  • I have a mac book pro with Windows for Mac, I have really been struggling to figure out a keyboard shortcut to switch between 2 excel files can someone suggest a solution please ?

    I have a mac book pro with Windows for Mac, I have really been struggling to figure out a keyboard shortcut to switch between 2 excel files can someone suggest a solution please ?

    someonehelpmaddy wrote:
    My Mac knows that it is connected to the montior...
    Open your Displays system preferences.  Is there an Arrangement tab and does it show two screens?  If no Arrangement tab then your mac does not know it has two screens.  Maybe smc and pram reset will shake it free and maybe not.  Maybe there's something wrong with the connection.  Thunderbolt plugs are similar to mini-displayport plugs so make sure the plug is pushed firmly in so that essentially all the metal part disappears inside the socket.  The plugs can be a little tricky in that you need to make sure the plug is fully seated in their socket.
    If you do see two screens in the Arrangement tab then click Detect Displays and Gather Windows to get the Displays preferences of the other monitor on to your main monitor.  Check the resolution and if there is a refresh rate check that as well.

  • TS1389 Repeatedly prompts of authorize this computer but there is no solution for this & it still prompts authorize this computer. Please suggest me another solutions

    i tried above all sugget to prevent repeatedly prompts of authorize this computer but there is no solution for this & it still prompts authorize this computer. Please suggest me another solutions

    Hello Kuldip13,
    It sounds like iTunes keeps asking you to authorize the computer. If you have already tried all the steps within the article you came from:
    iTunes repeatedly prompts to authorize computer to play iTunes Store purchases
    http://support.apple.com/kb/TS1389
    I would next check to see if the same Apple ID is signed into, that was used to play these purchases with this article:
    Recovering a forgotten iTunes Store account name
    http://support.apple.com/kb/ht1920
    Open iTunes
    Highlight one of the items you have purchased (You can find your purchases in your Purchases playlist).
    Choose File > Get Info.
    Click the Summary tab.
    The Account Name area will list the account used to purchase the item. Unless you have changed accounts, this is your iTunes Store account name.
    Thank you for using Apple Support Communities.
    All the very best,
    Sterling

  • Hi! I bought my notebook in october last year but from last month oftenly my WiFi connection hangs up nd stops catching any available Wifi connection? please suggest the solution

    Hi! I bought my Macbook Pro 13" in october last year but from last month oftenly my WiFi connection hangs up nd stops catching any available Wifi connection?
    At last I restart the modem and dn it catches the signal but that too is short lived.
    please suggest some solutions
    Thanking U,

    I have this problem on my home network but at the same time when my connection hangs up my other wifi machine remians connected. So i think there's no problem with the modem.

  • When I try to manually backup my ipad2, I receive an error message stating "There was a problem completing the backup.  Please try again later" ... and this happens each time I try to back up.  Grateful for suggestions ...

    When I try to manually backup my ipad2, I receive an error message stating "There was a problem completing the backup.  Please try again later" ... and this happens each time I try to back up.  Grateful for suggestions ...

    Seems to be a common enough problem. I've deleted the partial failed backup from iCloud, restoring all 5Gb of storage. Then started a manual backup. After about 20 minutes I get the same error message. I have repeated this several times. According to my iTunes on my laptop I managed one backup to iCloud from there but it is pointless if u can neither backup to or restore from iCloud via my iPhone 4. I had hoped ios 5.0.1 would solve this glitch but ....
    So much for "it just works".
    I have yet to see any suggested fix that works for me. Any other suggestions?

  • RMAN Backup script for RAC Database..please suggest

    Hi All,
    I am currently working on backup policy for RAC Database for my client.The client requirement is to backup while database is shutdown(mount state).I have made below script and could any one please suggest what further things should I need to add with below rman script.
    echo "Shutdown Database";date
    srvctl stop database -d PROD
    srvctl status database -d PROD
    echo "Database shutdown on";date
    echo "Mount Database ";date
    srvctl start instance -d PROD -i "PROD1" -o mount
    srvctl status database -d PROD
    echo "Start Full Database Backup on";date
    $ORACLE_HOME/bin/rman target / nocatalog <<EOF
    configure controlfile autobackup on;
    configure controlfile autobackup format for device type disk to '/BACKUP/PRODBKP/%F';
    run{
    allocate channel c1 device type disk connect 'sys/******@node1-vip:1521/PROD';
    allocate channel c2 device type disk connect 'sys/*****@node2-vip:1521/PROD';
    backup format '/BACKUP/PRODBKP/PROD_df_%t_%s_%p.bak'(database);
    backup format '/BACKUP/PRODBKP/archive_%t_%s_%p.bak' archivelog all;
    copy current controlfile to '/BACKUP/PRODBKP/PROD.ctl';
    delete noprompt obsolete;
    release channel c1;
    release channel c2;
    exit
    EOF
    echo "RMAN Backup Finished on";date
    echo "Shutdown Database";date
    srvctl stop database -d PROD
    echo "Start Database";date
    srvctl start database -d PROD
    srvctl status database -d PROD
    Please share your experiences.
    Regards

    Hi,
    Some tweaks for your script.
    echo "Shutdown Database";date
    srvctl stop database -d PROD
    srvctl status database -d PROD
    echo "Database shutdown on";date
    echo "Mount Database ";date
    srvctl start instance -d PROD -i "PROD1" -o mount1. If you database does not shutdown properly , does your script stops the execution of next step?
    2. configure controlfile autobackup on;
    configure controlfile autobackup format for device type disk to '/BACKUP/PRODBKP/%F';(Why you need to configure this every time) ?
    It's persistent at db level one time setting (until some other script changes the settings by other dba - else remove that - set the configuration at db level once for all)
    - Pavan Kumar N
    3.

Maybe you are looking for

  • My new MacBook Pro thinks it's an iBook G4.

    Okay, so, this is weird. I'd been using a 14" 1GHz iBook G4 for about four years, and just recently upgraded to a 15" 2.5GHz MacBook Pro. When I got it, I used the Migration Assistant (during the initial setup) to transfer all my files. I connected b

  • Help undoing Boot Camp Windows 7 install -- "no bootable device"?

    I think there's some residual stuff from a Boot Camp install I need help getting rid of. Let me explain what happened so you'll understand what's wrong: Ok so I set up Boot Camp utility to partition a 32 GB partition for Windows. I have a 250 GB hard

  • New iPod touch 4 won't work or restore after update

    I got an iPod touch 4 in January. (I am using an H-P desktop, 3.0Ghz, 2.5 GB RAM, 250 GB HD, mostly empty, with Win XP home.) The first time there was an iOS software update available, it didn't work after the update and would not restore. After many

  • Aggregate in ODI - Part 2

    Not sure why I am not getting how to aggregate in ODI! I have been trying to come up with a way to produce these results in ODI for 2 weeks now, and I am missing something. I don't believe this should be that difficult. This is the sql code I am usin

  • How do i find a dead ipod

    I have lost my ipod touch i cloud says its died is there ant other way to find it