Suggested methods for full backup of XServe RAID data

I know this is only peripherally related to the discussion topic, but since every other suggestion posted here is followed by the disclaimer that you should make a full backup of your data before proceeding with any major operations on your RAID arrays, I'd like to know what more experienced admins do in order to create a full backup for reasonably fast recovery in case of substantial data loss during maintenance/repair.
Our current "backup" availability is incremental optical disc archival (our data is mostly "write-once"), but this isn't entirely practical for recovery since it's over a terabyte of data. Since the connected server has a free hot-swappable SCSI drive bay as well as an interface for external SCSI devices, not to mention the fiber channel and ethernet interfaces, the options that I'd consider in order would be:
1. A handful of 150-500 Gb SCSI hard drives, rotated out of the hot-swappable bay
2. An external tape drive attached to the SCI interface (with appropriate tape size, maybe the LTO-2 with 200Gb native capacity?)
3. Some other external SCSI storage device
4. Larger optical disc archival (I hear there are technologies arriving in the near future)
5. Network-based option; remote seems impractical due to sheer size, but perhaps local?
The idea is to make a full backup (long-term solutions are superior of course) of 1-2 Tb of data on the XServe RAID before attempting major surgery. Suggestions for common, accepted, tested, efficient methods for accomplishing this would be greatly appreciated. I apologize if this thread isn't on-topic enough for some of you.
-Brian

Brian,
Tape IMO is kinda yucky (to steal a term from your average 3 year old). It's fairly slow to back up to, it's very slow to restore, and it's actually not that reliable by itself (I worked with a large enterprise customer who said their backups were successful about 70% of the time (!!!)).
That said, tape has the advantage that you can offsite it and archive it very cheaply, and the media are fairly cheap, so you can make lots of backups, so if one fails, you probably can restore the data from another tape.
Disks are more expensive initially, but end up being pretty reliable, and you get a lot more flexibility (plus, they're fast).
An emerging "best of both worlds" backup strategy is what's called disk to disk to tape, where you typically back up to another large "disk," for example a second Xserve RAID. Data is then backed up from the second disk to tape, which is taken offsite... thus tape is used for what it's best at (offsite archival). Restore can be from disk in most cases, which is 10-20x faster than restoring from tape. People use software packages like Netvault's Bakbone or Atempo's Time Navigator, which can handle the whole process, and it works quite well. The backup disks (e.g. the RAID) can be onsite, or can be at a backup site a couple KM away, attached via optical (this is preferable, for DR reasons).
For cases where a second Xserve RAID is prohibitively expensive, cheaper (and slower) RAID 5 enclosures like Wiebetech's RAIDtech can provide a large (say, 1.6 TB) RAID 5 volume, accessible over FW800 or SATA (not sure if they have a SATA-based one yet).

Similar Messages

  • Easiest solution for adding Fibre Channel Tape Backup to Xserve RAID setup

    I'm interested in getting a Fibre Channel LTO-3 tape library such as the Exabyte 221L for my Xserve RAID/Xserve G5 setup. I realize there are SCSI LTO-3 solutions that are less expensive than FC, but I'd prefer not to have to add a SCSI card to my Xserve, mainly because I'd have to pull the video card and run the server headless (horrors!). However, I understand that I must get a Fibre Channel switch to allow the LTO library, the Xserve, and the Xserve RAID to communicate... you can't just daisy chain FC devices. The least expensive switch I can find is the new QLogtic SANbox 3050 for about $1800. For my situation, in which these will be the only FC devices I'll probably ever use, does this switch sound appropriate? The specs on the switch can be found here: http://www.qlogic.com/products/sanbox/sanbox_3050.asp.
    Xserve RAID & Xserve G5   Mac OS X (10.4.5)  

    For simple environments like yours, it's trivially easy. You must plug everything in, and you're good to go... as simple as a network switch.
    Now if you start adding multiple hosts (i.e. plug in a second Xserve or G5), you need to be careful, because in the default configuration everything is "wide open," so every device can see every storage LUN. This would actually be problematic, as systems could (actually, would) corrupt each other's storage. When you get to this point, you'll need to look at either zoning the ports on the switch, or using LUN masking on the Xserve RAID to allocate specific pieces of storage to specific hosts.
    But for now, just get the switch, plug everything in, and you're off.
    BTW if you mark "answered" for me, versus for the thread overall, it helps me out a bit in this forum ranking system, whatever it is.
    Cheers.

  • Looking for some ideas for setting up and xServe RAID

    Everyone,
    Here is what I would to do. I have a new xServe and 7TB RAID. I would like to set all of my end users up with Portable Home Directories. They all have laptops and I would like to use their PHD as my backup source. I would set them to sync in the background a couple of times per day and then write to tape at night.I have about 60 end users. I would also like to use the same xServe and RAID as my Kerio mail server and mail store. What I am looking for is some ideas of how to go about setting up the RAID. I was orginially thinking of setting up as one big RAID 5 using all 14 drives. What I would like to know is what is the number of drives that would need to fail that would render the RAID unrebuildable? I am now thinking about splitting the RAID into two 7 drives in RAID set up as RAID 1+0.
    I am not sure if I phrased a lot of this currently, but here is quick recap of what I would like to know. What would be the best way to set up a 7TB RAID to store PHD and my Kerio mail store that provides me the most redudant and fastest acccess.
    Thanks in advance.
    Sincerely,
    Daniel Krajc

    Daniel,
    I'd suggest a 6 disk RAID 5 plus a hot spare for each side. It will give you about 2.4 TB capacity per side (4.8 total), and it can tolerate 2 drive failures per side without losing data, provided there is sufficient time between failures for the RAID set to automatically rebuild on the hot spare. This window is 8-12 hours.
    Note with Xserve RAID the two sides are totally independent in the data path -- it will look like 2 separate LUNs. If you want to combine these at the host level, as RAID 0 or RAID 1 to look like a single volume, you can. But the Xserve RAID will not combine them itself... the RAID controllers are independent... it might as well be two separate RAID volumes in the same chassis.
    I assume you'll plug this into an Xserve that is serving as an Open Directory server and a file server?

  • Proper procedure for replacing drive in Xserve RAID RAID5 set

    I've got a five-drive RAID-5 set (with a sixth hot spare) in an Xserve RAID running the 1.5/1.50f firmware. One of the drives in the RAID-5 set has an amber/orange status light on and has been getting occasional errors like to following:
    Timestamp: 11/10/10 10:34:53 AM
    Priority: Warning
    Controller: Upper Controller
    Type: 112
    Event ID: 1000
    Event: Disk 5 Reported An Error. COMMAND:0x35 ERROR:0x10 STATUS:0x51 LBA:0x19B80
    Description: The drive reported an ATA error. This is a failure in the communication from the RAID Controller to the drive.
    I have double checked the drives in RAID Admin and, as the drive is only in a warning state, the hot spare has not been pulled into the RAID set yet. As this is an old drive, I'd like to replace that particular drive first. I have a current, full backup of the data, but want to make sure I understand the process correctly.
    I understand the "Installing or Replacing an Apple Drive Module" section of http://manuals.info.apple.com/en/XserveRAID_UserGuide.PDF, but it and RAID Admin's built-in help don't describe what will happen when replacing a drive in a RAID set that has a hot spare. When I pull out the drive and replace it, will it correctly use the newly inserted drive or will it use the hot spare? If it uses the hot spare, will the hot spare revert back to a hot spare once the new drive is inserted or will it permanently become a member of the RAID set and need to be moved to the original drive's slot? Or, should I just pull out the hot spare, pull out the failing drive, and pop the hot spare into the failing drive's slot?

    Hello, makkintosshu, and welcome to the AppleBoards,
    If you pull out the drive the RAID should/will immediately start rebuilding using the hot spare. The hot spare will become a new permanent member of the RAID and the new replacement drive will become the new hot spare. The physical slot locations of the drives don't matter you can build a RAID from any combination of drives as long as they are on the same side.
    If you pull the hot spare and then the failing drive the RAID will wait for a new drive before taking action. I find it hard to recommend this course of action unless there is a really good reason for you not wanting the hot spare to become part of the RAID. Rebuilding is going to take a good long while and you want it to start as soon as possible - as long as the RAID is not rebuilt your data is at risk. Letting the RAID rebuild hang as you physically swap out the failed the drive strikes me as bad idea that needs a really good justification.
    HTH,
    =Tod

  • Any recommendations for selling some old Xserve RAID parts?

    I have 6 unopened SFP to SFP cable kits and an original Xserve RAID that's missing drive modules.
    eBay seems like a ghost town for this stuff, any suggestions? Not looking to make a ton, I just want to get it out of the conference room corner...

    You can still find some interest on ebay. It seems less and less as the RAID's get older.
    I am also interested let me know if you are looking to sell I may be interested too!

  • Suggested method for creating flash video?

    I've searched through the forums and see that Apple seems to want to make things difficult for creating flash video for some reason. Regardless of why, does anyone have a suggestion for a simple solution to take a QuickTime movie file and convert/export it to flash video? I don't need a lot of bells and whistles, just the ability to end up with a flash file of my video. Thanks.

    Thanks, but I'm really trying to find something for use on my Mac. Or perhaps I'm trying to do something that isn't even necessary... What's the recommended method for creating good-quality video from my Mac to be used on the web? Flash stuff seems to have a great quality for smaller file sizes. Is there a comparable format I could use on my Mac to get similar results which most web users could open without installing some additional software to read it?

  • Script cleanup for full backup

    I'd like to clean up some old scripts on the DB server (Oracle 10gR2).
    There is a backup script for a full backup. I would like to remove the command "backup archivelog all" as "backup incremental level 0 database plus archivelog" already contains the archive logs. I would also like to remove the second "backup current controlfile" (the one just before "backup archivelog all") as I think it is redundant.
    Or do I oversee anything?
    rman target / <<EOF
    configure channel device type disk format = '$BACKUP_DIR/back_%d_%s_%p_%t';
    sql "alter system checkpoint";
    sql "alter system switch logfile";
    crosscheck archivelog all;
    backup current controlfile;
    backup incremental level 0 database plus archivelog;
    backup current controlfile;
    backup archivelog all;
    ###########

    What is really easier than controlfile autobackup ? Except maybe the case when you are not using a recovery catalog and you have lost all you current control files, you have to retrieve DBID before restoring control file from autobackup...
    Oracle recommends that CONFIGURE CONTROLFILE AUTOBACKUP be set to ON from Control File and Server Parameter File Autobackups.
    It's even listed as number 8 in following Metalink note:
    Subject:      Top 10 Backup and Recovery best practices.
         Doc ID:      Note:388422.1      Type:      FAQ
         Last Revision Date:      05-DEC-2007      Status:      PUBLISHED
    Message was edited by:
    Pierre Forstmann

  • Syntax for full backup thru RMAN

    hi all ..
    i have oracle 11g installed on M5000, Solaris 10
    i want to take full backup of my database thru RMAN
    i have enter following on backup server
    . .db/env
    connect catalog rrkas/rr345
    (connected)
    connect target sys/root123@grid1
    (connected)
    RMAN> run {
    allocat channel dev1 type disk;
    backup database
    format '/export/home/oracle/dumps/grid3_%t_%sp%p';
    release channel dev1;
    it started the job.On my dbserver file is created as per the format.
    just want to ask, is it the right way to take full/physical backup? Is this backup enough to fully recover the files, in case a new RAC is added to the cluster?
    thanks in advance.

    If your database is running in ARCHIVELOG mode, this is not enough: you must backup archived redo logs for example with
    backup database plus archivelog:Read about consistent and inconsistent backups in http://download.oracle.com/docs/cd/B28359_01/backup.111/b28270/rcmcncpt.htm#BABIHBBE and about archived redo logs backups in http://download.oracle.com/docs/cd/B28359_01/backup.111/b28270/rcmbckba.htm#i1006454
    Edited by: P. Forstmann on 20 nov. 2009 07:42

  • LSMW Method for VD51 Customer-Material Info master data conversion

    Hi,
    I am using LSMW for VD51 Customer-Material Info master data creation but can't able to find any standard BAPI, IDOC or Direct input program.
    Can anybody tell me any standard way to do it or only the recording method possible for this.
    Thanks
    Dhirendra

    Hi,
    I have done this once and used recording method in LSMW. Do the recording from LSMW itself.
    Thanks,
    Jyothi

  • Record count is different for Full load and Init with data transfer

    Hi all,
    We have a data source for which delta is enabled on Calendar Day.
    If I run the full load record count is 2670.But If I run the delta record count is 2665.5 records are missing.
    Would you please help on this.Why those records are missing.

    Hi,
    Actually for Full Load say you have 50 records. When you run it will upload 50 records.
    Now if you run delta if there is no records changes it wouldnt update because there is no update in the existing records.
    only delta is done when there is changes in the records.

  • Recommendations for Full Backups

    I need to backup my MacBookPro HD which has 2 partitions... 50% MacOSX and the other 50% WinXP.
    I was going to use Acronis TrueImage for the WinXP partition but their tech support said it doesn't work on Mac hardware which is a real bummer. Ideally I want a full ghost of my entire C:\ drive under WinXP with all the apps and data if possible.
    Suggestions would be very appreciated.

    TI 11 didn't but 2009 might. Had to do with support for GPT.
    Paragon has NTFS for OS X; CampTune; and Drive Manager 2009 which lists Boot Camp support.
    Vista Ultimate and W7 of course have built in backup files and PC support of their own.
    Norton 360 has backup feature.
    WinClone runs in OS X and useful to take single full snapshots.
    Microsoft SyncToy 2.0 is handy for folder synchronizing.

  • How to check for archivelog backup on a particular date or time?

    Dear All,
    We have RMAN full database, cumulative and archivelog backup(eg location: Diskgroup A) scheduled on a regular period basis. Assume archivelog location is Diskgroup B. The diskgroup B became full and unable to archive further, since no space. Unable to connect to database, connect internal only until freed error. alert log also shows that archiver error. So the solution for this to clear some space in diskgroup B by removing some old archive logs. In our environment, everyday the archive logs are stored in a separated folder arranged in date wise.  I can do that . But before clearing some space, i need to make sure that the folder( or any date folder what im going to delete) is backed up or not. How to check that? Any idea please?
    eg: i have archivelogs like this in folders
    01_11_2013/
    02_11_2013/
    03_11_2013/
    04_11_2013/
    05_11_2013/
    06_11_2013/
    If i want to remove the folder 01_11_2013/( and its contents ie archivelogs) , how to check whether the archivelogs in this folder 01_11_2013/ is backed up or not?
    Regards,

    Pradeepcmst wrote:
    Dear All,
    We have RMAN full database, cumulative and archivelog backup(eg location: Diskgroup A) scheduled on a regular period basis. Assume archivelog location is Diskgroup B. The diskgroup B became full and unable to archive further, since no space. Unable to connect to database, connect internal only until freed error. alert log also shows that archiver error. So the solution for this to clear some space in diskgroup B by removing some old archive logs. In our environment, everyday the archive logs are stored in a separated folder arranged in date wise.  I can do that . But before clearing some space, i need to make sure that the folder( or any date folder what im going to delete) is backed up or not. How to check that? Any idea please?
    eg: i have archivelogs like this in folders
    01_11_2013/
    02_11_2013/
    03_11_2013/
    04_11_2013/
    05_11_2013/
    06_11_2013/
    If i want to remove the folder 01_11_2013/( and its contents ie archivelogs) , how to check whether the archivelogs in this folder 01_11_2013/ is backed up or not?
    Regards,
    rman> list backup;
    Which begs the question .. why is the FRA getting filled in the first place?  Is it seriously undersized?  Are you not doing regular housekeeping with rman 'delete obsolete' and 'backup archivelog delete input'

  • XServe-RAID Offsite Backup

    I was hoping to use the left controller of the RAID to backup all my clients using TimeMachine and then have the right controller mirror that on the fly (so that would be RAID 50). I was then hoping that I could swap out ALL the right controller drives to store them off-site each week.
    Would that plan be possible do you think? OK to take out all drives from the right controller at the same time, leaving the left RAID5 running on its own until the new set is put into the right controller to rebuild the RAID50 again? Make sense? Possible?
    Thank you, Grant

    However there just doesn’t appear to be any failsafe easy solution to backup the XServe RAID for offsite storage is there. Is is quite unfortunate and surprising and I would have thought there would have been a methodology worked out for this somewhere. But from what I am hearing, there isn’t.
    Xserve RAID is a storage array box, and (somewhat confusingly) it's exceedingly uncommon to back up "just a storage box." I do know a few storage controllers that offer replication capabilities, but I'm extremely suspect that the tools work reliably. Storage controllers don't have all of the context on the processing that they need to perform reliable data replication; to ensure consistency.
    It's common to perform remote replication via network and tools are available to do that. You almost certainly will end up with local customizations here, too.
    The tools are specific to particular application storage involved; there's no Server Time Machine here, as you need use (for instance) mysqldump or you need MySQL replication for a MySQL database, and a different tool for another database. Or you need quiesce the databases.
    Which leads various folks to punt on the process, to shut down down the server, and block-clone the disks involved. To quiesce the server. That too can likely be automated, with some scripting and a controlling host.
    As for the remote storage (when not using a network), getting the data off-site then depends on what removable media is available. Ultrium tape has decent capacity and good physical reliability and speed, but tends to have poor support on Mac OS X Server, and Ultrium drives and loaders tend to be expensive. Removable disks do reasonably well here, and various options are available, but they're less physically reliable than tapes. For tens of gigabytes, flash media is a potential option, though it's not the speediest of storage.
    Networking can be an option here for remote storage, depending on how small your delta (churn) and how good your compression is and how big your network pipe might be; your network pipe has to be big enough to manage your maximum available window.
    If you're looking for turn-key, there are commercial products which claim to deal with this stuff. And unless they're using mysqldump or such for databases, I'm professionally skeptical at the integrity of the archives they create on an active server. (I've watched the storage and data archive folks claim to have solved this for thirty years now. They can mostly solve it, too, for some values of mostly.)
    [Here is a MySQL mysqldump|http://labs.hoffmanlabs.com/node/1336] procedure, which can serve to show how to do daily, weekly or monthly archives, and how to run mysqldump tool from bash.
    (I am aware of one operating system that can mirror active disk data across a data link and across hosts and across storage controllers and can operate with fully distributed shared write, and that OS obviously and specifically targets high-uptime environments, but that OS environment is not cheap. And it's not Mac OS X Server. And even that environment can't correctly capture an active database for an offline archive; even there, you need to quiesce the database or use database-specific tools.)
    It'd be feasible for somebody to create a (big, hairy) tool to catch all the usual suspects on a Mac OS X Server box. But then you have to maintain it across all of the slightly-weird installations, and you also have to deal with restorations. (I'd love to write a generic one of these; this would necessarily be a superset of Time Machine. This is a big and complex project, and one that would require extensive testing.)
    Server boxes are not client boxes. Servers require real work and real thought and real configuration. And as production requirements increase, they also tend to require some knowledge of the shell and of scripting and writing (or acquiring) some site-management tools.

  • Co-location for daily backup

    I have created a protection group for file server and taking backup of a share on tape drive.
    under protection method--> I chose I want short-term protection using : tape
    retention range: 1 week
    frequency of backup: daily
    backup mode: full and incremental
    so full backup on Saturday and other days incremental backup.
    I have around 700 GB data size.
    I have shortages of tape. from recovery option: I saw in this month on 12thOct, on Saturday it run full backup. It took one tape [say tape 1]
    on the next 6 days it run incremental backup on another tape.[say tape 2]
    again on Saturday for full backup it took tape 3 [tape 3]
    again to run incremental backup it is asking for free tape. and back up failed.
    in this way I am wasting space on tape. data size is 700 GB, tape size is around 3 TB.
    I can see there is option in 'optimize usage' where I can mention under advanced. write period and expiry tolerance.
    i believe I need to modify these settings.  please suggest if i want daily incremental backup and full backup on Saturday with 1 week retention and reuse the same tape or second tape instead of waiting for more tapes

    Hi,
    It is currently working as designed for tape library.
    See the following TechNet page:
    How DPM Uses Tape Libraries
    http://technet.microsoft.com/en-us/library/hh757885.aspx
    Short-term tape "full and incremental" option
    The full backup will require a free tape for each scheduled job, and the incremental backup for all data sources will be appended to a single separate tape.
    As tapes fill up, new free tapes will be allocated.
    When the next full backup occurs, it will require another free tape, and subsequent incremental backups will be appended to another free tape.
    So basically, you will need three sets of tapes for a 1 week retention range.
    Please remember to click “Mark as Answer” on the post that helps you, and to click “Unmark as Answer” if a marked post does not actually answer your question. This can be beneficial to other community members reading the thread. Regards, Mike J. [MSFT]
    This posting is provided "AS IS" with no warranties, and confers no rights.

  • Best method for archiving .mpp files on a separate server or location?

    We want to be able to run a program or job on Project Server 2013 that will export all current published project .mpp files to a separate server or location on our network. What is the best, or suggested, method for something like this? Our managers want
    to have this job run on a weekly or bi-monthly basis in order to have backup files of each active project schedule. This would be beyond the Project Server archive database. This would be for Business Continuity purposes of having those schedules available
    should our servers ever crash. 
    Any help would be much appreciated. I am not a developer, but if there is code available for something like this we have developers in-house that can perform the work. 
    Thank you,
    Travis
    Travis Long IT Project Manager Entry Idaho Power Co. Project Server Admin

    Project server already has an archiving mechanism which backs up project plans based on schedule and maitains versions of it which can be restored at any point ? check administrative backup in central Admin under PWA settings
    However I wouldn't say this is the best method, but you can run a macro which would export all projects and save it at a location(could be network file share), Something like this (havent tested it recently with 2013 but i believe should work
    Sub Archiving()
    Dim Conn As New ADODB.Connection
    Dim Cmd As New ADODB.Command
    Dim Recs As New ADODB.Recordset
    'Connect to Project Server Reporting DB, Get Project Names
    Conn.ConnectionString = "Provider=SQLOLEDB;Data Source=servername;Initial Catalog=ProjectServer_Reporting;User ID=; Password=; Trusted_Connection=yes"
    Conn.Open
    With Cmd
        .ActiveConnection = Conn
        .CommandText = "Select ProjectName From MSP_EpmProject_UserView"
        .CommandType = adCmdText
    End With
     With Recs
        .CursorType = adOpenStatic
        .CursorLocation = adUseClient
        .LockType = adLockOptimistic
        .Open Cmd
      End With
    Dim prjName As String
    Dim ArchivePrjName As String
    Application.Alerts (False)
    If Recs.EOF = False Then
       Recs.MoveFirst
       For x = 1 To CInt(Recs.RecordCount)
        prjName = "<>\" + Recs.Fields(0)
        FileOpenEx Name:=prjName, ReadOnly:=True
        ArchivePrjName = "C:\Temp\" & prjName & "4Sep2014_9PM"
        FileSaveAs Name:=ArchivePrjName, FormatID:="MSProject.MPP"
        FileCloseEx
        prjName = ""
        Recs.MoveNext
       Next x
    End If
       Recs.Close
       Conn.Close
    End Sub
     Let us know if this helps
    Thanks | epmXperts | http://epmxperts.wordpress.com

Maybe you are looking for

  • Absolute/Relative Path for elements in xml to rtf template.

    Hi all, I have a small doubt, can anyone help me come out of this issue. I developed a BI Publisher Report using RTF Template and I am addressing XML elements which are out of the group in the XML file inside the for loop in the RTF template. I am ab

  • Run video on two monitors....

    I have a 2010 Macbook Pro and I'm preparing a video for an upcoming trade show. Is it possible to show this video on two 20" monitors full screen from my Macbook? If so, how do I do this? Thanks for your help.

  • F-48 and Withholding Tax

    Hello, I'm trying to setup Withholding tax so that it post when an AP Down payment is created in F-48. I had the Withholding tax to apply at time of Invoice, thinking that this might be the problem.  Now I've changed it so that it's applied at time o

  • How to retrieve email using Original Message ID #

    I accidentally deleted a sent message on my Blackberry Bold 9000.  I have the delivery receipt that I received in my Outlook that contains the Original Message ID #.  However, this email does not have the text of the email that I sent.  How can I ret

  • IMP-00098 / INTERNAL ERROR / illegal lob length marker

    Hi all, i've been working for too long in the last 2 days and maybe don't think straight anymore. I'm having some strange import problem. Here the facts: Error: . . importing table "TAB" illegal lob length marker 55011 bytesread = 00000000000 TABLE =