Homeserver Storage considerations - Suggestions please
Hi all,
I'm currently upgrading my homeserver from an old Via-C7 with 1 HDD to a new system. The new one is a Atom D510 in the nice Chenbro ES34069 Case (Mini-ITX with 4x Sata Hotswap). Hardware-wise all is working out nicely so far, and Arch runs perfectly on the box. Now here is my Problem: How to layout the storage software-wise (lvm/raid/whatever).
What I have:
1x 2TB HDD holding the data from the old server
3x 1.5TB HDD free
all attatched to the server
What I want:
The drives should be assembled in an array that provides the following:
- Accessible as one single "drive"
- encrypted at block level (dm-crypt / luks)
- provides redundancy (array survives failing of at least one drive)
- array is extensible (Disks can be swapped for bigger ones / new disks can be added later [doing this online would be optimal])
- be as performant as possible
- it must be possible to first build the array out of 3 Disks, copy the data from the 4th to the array and then add the 4th Disk to the array
The System has to be linux/arch, since I use software that only runs on linux (VDR), so no switching to solaris/BSD... possible
The encryption is a must for me, I'm not here to debate if its neccessary or not
What I tried/considered so far:
- Linux Software RAID 5
Pros:
- extensible, one can reshape the array online
- redundant
- encryption layer on top is possible
- good usage of the aviable space
Cons:
- questionable reliability (raid 5 write hole problem, silent data/parity corruption)
- weak write/rewrite performance
- Linux Software Raid 10
Pros:
- faster than RAID 5
- excryption on top possible
- redundant (up to 2 disks can fail, depending on which)
Cons:
- loosing half of the HDD-space for redundancy
- not extensible (raid10 driver doesn't support reshaping)
- ZFS (through ZFS-Fuse)
Pros:
- raidz does RAID 5 but right (no write hole or silent data corruption problems)
- extensible, even online
Cons:
- stability of zfs-fuse is questionable, dont know how stable it is
- no encryption layer on top is possible
- writes are quite slow from my tests (this is partly cause of the point above, every disk is encrypted seperately -> to much to handle for the Atom)
- 2x Software RAID 1 with LVM on top
Pros:
- extensible, even online
- should be quite fast
- encryption layer on top is possible
Cons:
- loosing half of HDD-space for redundancy
So thats What I have considered so far. What is the arch community using for similar setups? Any suggestions of other methods (BTRFS??) that coud statisfy my needs? Which of the above would you / have you choosen?
I'm thankfull for any constructive suggestions
seiichiro0185
Bronxal:
There are several options. Since you are looking to be able to retrieve them with iPhoto at a later date you might give this a try.
1 - select multiple rolls until iPhoto says you've got maybe 550MB (if you're using CDs) or 6G (for DVDs).
2 - go to the Share->Burn Disk menu option and follow the instructions.
This will create a disk that can be mounted in iPhoto at a later time (See example) so you can view them, copy back to the library in case you need to print, etc. Once assured they are on the disk and OK you can delete the rolls from the library. One warning, currently iPhoto 5 has a bug that loses the keywords on these disks. It's a minor issue but just be forewarned.
That method seems to fit what you want to do. Now regarding your aging G4. Like me it could crash at any time. If the budget permits get an external Firewire HD for backup purposes. I've got one that is much bigger than my boot drive so I've cloned my system to it as well as backup my library and other important document on a daily or routine basis with Synk. If my boot drive gives up the ghost I can boot off the external until I get the boot drive fixed or replaced. FW drives are pretty affordable these days and are excellent insurance. I prefer the self powered so I can easily turn them off when I don't need it. It doesn't run all the time.
There are other methods of backing up just the jpg files. If that's what you're really interested in post back and we can discuss that. Good luck.
Similar Messages
-
Photo Storage - any suggestions please?
My G4 is nearly five years old and going strong. I take a lot of photos. However, I can't store my photos on iPhoto because it slows up so much, so I have been saving them to CD, but that isn't satisfactory for a number of reasons - I lose or can't locate the relevant CD and even when I can access it, I can never find the photo I want.
There must be a better way of storing and archiving large quanities of photos, any suggestions please?Bronxal:
There are several options. Since you are looking to be able to retrieve them with iPhoto at a later date you might give this a try.
1 - select multiple rolls until iPhoto says you've got maybe 550MB (if you're using CDs) or 6G (for DVDs).
2 - go to the Share->Burn Disk menu option and follow the instructions.
This will create a disk that can be mounted in iPhoto at a later time (See example) so you can view them, copy back to the library in case you need to print, etc. Once assured they are on the disk and OK you can delete the rolls from the library. One warning, currently iPhoto 5 has a bug that loses the keywords on these disks. It's a minor issue but just be forewarned.
That method seems to fit what you want to do. Now regarding your aging G4. Like me it could crash at any time. If the budget permits get an external Firewire HD for backup purposes. I've got one that is much bigger than my boot drive so I've cloned my system to it as well as backup my library and other important document on a daily or routine basis with Synk. If my boot drive gives up the ghost I can boot off the external until I get the boot drive fixed or replaced. FW drives are pretty affordable these days and are excellent insurance. I prefer the self powered so I can easily turn them off when I don't need it. It doesn't run all the time.
There are other methods of backing up just the jpg files. If that's what you're really interested in post back and we can discuss that. Good luck. -
Low level Hex disk edit & search util needed- suggestions please?
low level Hex disk edit & search util needed- suggestions please?
Maybe It's just late & I've had a bad day.... but I haven't needed a low level Hex disk edit & search utility suitable for an Intel 10.4.x Mac until now and can't seem to locate one.
There should be plenty of free/shareware options (because they're handy and not particularly hard to write ... and every tech head needs one some time)...
Any suggestions please?
[I haven't bothered with the commercial stuff - like tech tool/Norton/*insert name here* Recover/repair, Something Genius etc. etc. because they are all without exception either unnecessary (just pretty shells for the underlying UNIX/X utils) useless AND greedy $-gougers, just useless, or just money gougers so I couldn't even say whether any still have a 'feature' like the old Norton Disk editor app had - but a quick look about suggest not...]
grumble
Any specific suggestions/links, please?
TIAthey are all without exception either unnecessary (just pretty shells for the underlying UNIX/X utils) useless AND greedy $-gougers, just
useless, or just money gougers
Such a high-esteem for fellow human beings - and
programmers...
You know, there are some good decent nice people
behind those names?
You'd be amazed at how much testing goes into a product.
[SNIP]
g'day Hatter...
Yes, I know there are some good decent nice people behind those names..fellow human beings - and fellow programmers (so yes, I do know...) In previous incarnations I have 'thunk up' and developed, Marketed & supported considerably more complex Apps & systems myself - I even know some of the people you mention personally - and they are usually decent Blokes/women but normally, it isn't the programmers who make the decisions on pricing/features/support/performance/upgrade costs & cycles etc...
My only error was, I agree, the phrase 'without exception' - but (mainly) only because I haven't bought/tested & used all of them very very recently. So I offer my apologies to those to whom my remarks should not apply (long, late night/early morning frustration...)
However, I also offer a few simple pertinent examples:
One 'top name' Utility company had a 'save your Mac HD' product on the market for some time that was almost guaranteed to TRASH it irretrievably but did NOT say so - nor did they help or compensate those they harmed.
Several are selling what amount to simple, pretty, GUI shells for 'free' or OS-included command line tools - no more, no less but do NOT say so and are asking good money for the 'software'.
Many are asking ridiculous prices for "regular upgrades" so you can keep their tool current with your Mac OS - one wants US$100/year for it, another, $15 per u/g, others, US$25 or $40 per u/g; one asks 'only' $10 - and these 'upgrades' are happening 3,4,5,6 times per year and are necessary for the Marketing company to keep their product Saleable to new purchasers and new Macs (as well as for important Bug Fixes - and only co-incidentally to keep it performing with your current Mac and OS - which is what you paid them for in the first place).
I won't pay for a product 3, 6 or 9 times and I won't advise my clients to: It's not unreasonable for a person to expect a 'sensible lifetime/currency' of Product X for Computer Y - say 3 years (e.g. AppleCare). I wouldn't object to paying for an "upgrade" at that point - IF it's worth the money.
Software is Waaay too expensive in many cases and is simply inviting 'piracy' - from people who have already PAID for the product: sadly, they are killing their own Gooses.
Seriously, one product costs ca. US$100 to Buy in the first place
To keep it actually working for you costs about the same again Per Year - a 3 year 'sensible lifetime' or 'currency' cost of US$300 or $400! [That'll buy a lot of 'bare drives' to put in a handy Firewire case for automatic backups in Background, differential backups etc. and other simple practices which render this product type largely unnecessary ].
For what? A relatively simple set of utilities which would actually cost the company involved less than $5 total each - over 3 years - to make available to existing ( or 'current') owners. [Applecare 'complete' Hardware and Software warranty & support on a US$2000 iMac - which includes Tech Tools Pro Deluxe or somesuch costs about US$165 for 3 years. Total.]
Having designed, developed, Marketed, supported & maintained more complex Applications to/for a sizeable user-base (in US terms) over multiple complete Series of Product 'life-cycles' - regular Updates and all, I think I know where the pirates are.
These practices have been rampant in the MSWindows™ market for a longtime. It's a real shame to see it in the Mac world.
I have all the esteem in the world for those fellow human beings who deserve such - and programmers who are 'good decent nice people'.
I have none to spare for monopolists, 'exploitationists' or any of those who take unfair/unreasonable advantage of their fellow human beings - AND of programmers who are 'good decent nice people' (like, say, ME... .
In any event, as I said: they are "killing their Gooses": I know of at least 6 software companies which went this route a while back. All are dead or dying.
Thank you for your help - and the opportunity to apologise for 'mis-speaking'.
all the best,
orig g4 733, many others thru (the luvly) Macintels New & old Macs, Wintels, MacIntels, other systems... -
New PC Build Comments and Suggestions please :)
I am going to build a new PC for Video editing etc.
Adobe Premiere, After Effects, the Whole CS6 package amoung others.
I want the best bang for the buck
Currently I have a tower case, and a corsair 650 powersupply.
This is what I was considering to build.
MY Max Budget is 1500, THAT IS MAX I really want around $1000-$1300
I7 3770 or 3770K (3770K is $229, 3770 $260) Not sure which is best is it worth $30
more for 3770 over 3770K
Cooler Master Hyper 212 EVO12 evo $30
Motherboard
Gigabyte GA-Z77X-UP4 TH LGA 1155 $185
http://www.microcenter.com/product/396870/GA-Z77X-UP4_TH_LGA_1155_Intel_Z77_ATX_Intel_Moth erboard
I like this board because it has thunderbolt. I have no use for thunderbolt yet, but may later
RAM 32 GB Hyper X Red 16GB DDR3-1600 $170 for 2 sets
http://www.microcenter.com/product/401554/Hyper_X_Red_16GB_DDR3-1600_%28PC3-
12800%29_CL_10_Desktop_Memory_Kit_%28Two_8GB_Memory_Modules%29
MSI NVIDIA GeForce GTX 660 Twin Frozr III $209 After Rebate
http://www.microcenter.com/product/403002/N660_TF_2GD5-
OC_NVIDIA_GeForce_GTX_660_Twin_Frozr_III_Overclocked_2048MB_GDDR5_PCIe_30_x16_Video_Card
SSD 256 GB Crucial M4 $199
I am debating getting
2 - 2 TB
Seagate Barracuda 2TB 7,200 RPM SATA 6.0Gb/s
Or 2 Western Digital Caviar Black 1 TB
They both cost the same ($90) I get double storage from
Seagate of course
Seems like Western Digital Black may be more reliable
My plan would be to put whichever of these drives I get into
a Raid 0 Array.
Not sure what would be best purpose for the Raid 0 would be I have seen
a few different ideas as to the best use for Raid 0
That can be debated later
Western Digital 750GB 3.5" SATA 7,200RPM $48
Just for storage of Other files etc etc or whatever the best use may be for it.
If it can be used with Adobe apps as well great.
LG 14X Blu Ray Burner $60
perhaps a couple corsair case fans if needed $30 for 2
May not need them. I know my case already has at least one fan.
Total for all of this is about $1310
Comments, Suggestions please???
If I cut the costs some I may put that towards another monitor, or perhaps
An editing keyboard specific to adobe. I also don't want to sacrafice much performance either.There is something mysterious in people's behaviour. If they bought something and they never experienced any problem with it, they tend to stay with that brand, but if they encountered difficulties and especially if that happened more than once, they tend to steer away from that brand. If you buy a certain brand of car and it is at the dealer for repairs more often than you like, your next car will probably be another brand.
I have had my share of problems with Seagate disks (7200.11 series that were notoriously bad and had a failure rate of more than 100% after several were replaced under warranty), so my natural tendency was to steer away from Seagate and look for other options. However, when I considered the price of their 7200.14 series, I was tempted again, but at the same time turned off by their meager 1 year warranty and the reviews on for instance NewEgg. Those reviews are generally rather meaningless, because you never know how people have handled and installed their stuff, but nevertheless it was a mark on the wall for me. In my specific case I needed 25 identical disks to start with and based on price, warranty and reputation I selected Seagate Constellation ES (the Enterprise editions) drives, which up to now have performed flawlessly for 6 months. I have to admit I have never used WD drives at all apart from the Velociraptor which is still going strong in my old system, but they seem to have a good reputation, have a nice warranty period and are somewhat reasonable priced.
I have no idea how much space you need, what future plans you have (do you need to get a parity raid in the future) and stuff like that, but WD Caviar Blacks have a solid reputation for single disk use or in striped arrays. OTOH in parity arrays they are lousy, so if you may consider a parity array on a dedicated controller, the Blacks are out.
For setting up your disks, have a look at http://forums.adobe.com/thread/662972 -
I cannot send email over 3G. receiving email over 3G is ok. Using wifi from my landline (glass) is ok. No idea where to find the solution. Suggestions please. Thanks i.a.
TheOneYou need a DATA service enabled by your carrier to be able to send e-mail via thier network. Do you have a data plan with your carrier ? If so - is it enabled ?
Can you access internet thru your network (not wifi) ? -
Hi, I reecntly purchased a Mac and the Pages App. But now I find that I cant open a document I have been working on. It has previously been saved without a problem now all I get is a box stating that the file cannot be opened. It is visible in both the Pages Windows and under Recent Items but just will not open. Any suggestions please?
Hi Colourdoodles,
Maybe the document is corrupted. Can you open other Pages documents? Preview may open it. Right click (or control click) on the document in Finder and Open With > Preview.
If that works, Edit > Select All, Edit > Copy. Then paste into a blank Pages document. Formatting may be messed up, but you will have editable text. Then Save (with a different name), close and see if you can open the new document.
Regards,
Ian -
* Open Firefox
* Use Google search
* Visit one or more sites
* Exit sites[s]
* Close Google
* Firefox appears to be closed - icon normal
* Attempt to re-open Firefox - nothing happens most times
* Can only re-open Firefox after doing a re-start
* I am no computer expert so simple to understand suggestions please!HI Noah:
Thanks for your answer. I'm working my way through the blog, and trying to take all of the steps. Hitman Pro did find 5 trojans, and many remnants of other malware, so hopefully that will help. I'll post again when I've finished trying everything else.
I had already run Malware Bytes, It did not find/remove the sweetim toolbar, but found a different trojan. Something is up with my antivirus I think. -
My o2 email account does not work when sending from my MAC it will accept incoming mail but not send it gives me a message that o2 account (offline) my mac I have no problem with my iPhone or mac laptop. any suggestions please.
Sorry for the delay...
I did what you've told me, new account and manually copied my files from Time Machine. I had lots of permissions problems, but at the end, almost everything is in order... It seems it had to be with some of the Apple Preferences, but I can't be sure, as most of them were dumped to the trash can.
I still don't have my Mail Rules back, unfortunately, although I did goggled some. It is a pity, as I had around 30 or 40 of them, getting my mail in order to each of its mailboxes, but it is a small price as the rest doesn't show the before syntoms.
Thanks for the help, anyway!! -
I have copied my iTunes library onto a new computer, but when I play back the songs using the new computer, there seems to be random "miss" or "drop out" during play back, similar to a small scratch on a vinyl record. Although when I play the same song over again, the "miss" occurs in a different location during the song. No probs with old computer, just the new one. I'm onto my third new computer - same problem. Any suggestions please?
You don't say which version of iTunes you are using, but the symptoms you describe have been encountered by some users with the 64-bit version of iTunes 12.1.
There is an alternative version for 64-bit editions of Windows here:
iTunes 12.1 for Windows (64-bit — for older video cards)
that seems to address the most of the playback issues that some users have been reporting with the full 64-bit version of 12.1.0.77 - including problems with Bluetooth speakers where either sound is degraded or completely absent. The alternative installer here is the same architecture as most previous "64-bit" versions of iTunes, i.e., a 32-bit application with a 64-bit installer. The "for older video cards" label appears to be something of a misnomer as some people have reported that this corrects problems found on current / high-spec systems.
Some users have reported that after installing this alternative version it is necessary to adjust the "Play audio using" selection (normally to "Direct Sound" rather than "Windows Audio Session", though this may vary based on your audio hardware/drivers) in Edit > Preferences > Playback to restore glitch-free audio (one part of the reported symptoms is that the "Direct Sound" choice isn't available, usually in Windows 8). It may also be necessary to ensure that your Bluetooth speakers are active and selected as the default audio device before you run iTunes.
If this doesn't address the issue, you may want to think about reverting to iTunes 12.0 - see Turingtest2's notes on Troubleshooting issues with iTunes for Windows updates for steps needed to completely remove all installed iTunes components, and for links to the 12.0 installers. -
Where can I see the downloads LIST when downloading podcasts,
like in the older version of iTunes? I find it frustrating that I see only one
download at a time now ! Any suggestions please?Thanks for taking a stab at it: that didn't prove to be the problem. That option in the settings for tabbed browsing was not checked.
I may be a bit behind the times: I am used to tabbed browsing showing all the tabs it possibly can, instead of just the last one. Sometimes it won't even show the last tab: I can have 15 tabs open, and not see a single tab. I've been confused by this into closing a window with lots of tabs open, because it looks like a single page-window.
My main problem with the tab-bar flashing to the end of the row is that it means a great deal more mouse-clicking around to browse.
I haven't tried installing the latest beta. Maybe that would fix the problem.
Toddo -
i Tunes will not let me play purchased songs from a computer that is broken, and which has a previous e-mail address. I am at my wits end, as whenever I try to play the songs I receive a message to authorise the computer I am using with my dead e-mail address. I end up in a mess, changing I-Ds, etc. I have paid an IT company to sort things out, with some success, but still I keep getting thiese messages. Surely iTunes should be less complex than this. I am not brilliant with IT, but not at all stupid. Any suggestions please?
1. The forum suggestions and feedback section is not the proper section of this forum, as you question/issue is not an idea or feedback about this forum.
2. Reason : You have installed Desktop Manager using the 'Desktop Redirector' option.
Step 1: If you're not using Redirector, you should uninstall Desktop Manager and then reinstall it using the BlackBerry Internet Service option.
Step 2: On your device, go to: Options > Advanced > Service Book, and delete all service books for [Desktop]
1. If any post helps you please click the below the post(s) that helped you.
2. Please resolve your thread by marking the post "Solution?" which solved it for you!
3. Install free BlackBerry Protect today for backups of contacts and data.
4. Guide to Unlocking your BlackBerry & Unlock Codes
Join our BBM Channels (Beta)
BlackBerry Support Forums Channel
PIN: C0001B7B4 Display/Scan Bar Code
Knowledge Base Updates
PIN: C0005A9AA Display/Scan Bar Code -
Hello, hope someone can please help. I've had my iPhone 18 months, not had any problems with using it. Trying to update the software to 4.0 on iTunes but it's just not recognizing it at all. It's not there under devices (infact, even the heading "devices" isn't shown), Tried a different USB port but that didn't solve it.
Have changed my startup (using msconfig) as Apple suggested, but again still nothing. Have downloaded the latest iTunes and *again* not working!!!!
Any suggestions please?Perhaps you have already done this, but I'd be sure to verify that it's not your cable...try a different cable and that will eliminate that as a source of the error.
-
I can't burn a cd of my own created music. I either get the error 4261, or after "Checking media" the process stops and nothing further happens. Have tried different burn speeds and cds. Have re-installed iTunes.Any suggestions please?
wm0203Sounds like the CD drive died. Luckily they cost next to nothing to replace. Or get an external LaCie instead. I have a dual G4 1.25 and the CD drive was always so anemic I use a LaCie Porsche with it.
-
After updating my iPad recently, I can no longer use it to present PPTs using a TV monitor that always previously worked. The display mentions something about using AirPlay which I am not using or trying to. Suggestions please? I am currently using iOs 7.0 on this iPad and I never had a lick of trouble until aetr this update. Anything would help. Thanks.
I'm adding screen shots taken from this afternoon showing connection that varied from non-existent to 1X.
-
Hi, my iphone 5 encountered an unknown error while updating to iOS 7 via itunes and is now stuck in recovery mode and prompts me to restore the phone when I connect it to itunes but then I would lose all my data. I DO NOT have any back ups on itunes. Is there anyway to get out of recovery mode without restoring or recover data after a restore?
Or any other suggestions please? ThanksAs pdroth said, you should have gotten a backup made when you started the update of iOS. If you cannot find a backup, and the phone is in recovery mode, there are no futher suggestions to make. To get the phone working again you have to restore. You cannot force a backup at this time since it is already in recovery mode. It will not allow anything else but a restore at this point.
Maybe you are looking for
-
Help with error message: Expected end of line but got identifier
The following is a calculated applescript step in a Filemaker script. It tells iCal to go to the date of an iCal event that the script has previously created from Filemaker. The code below keeps generating an error message: "Expected end of line but
-
Change logs for tcode WE20 and MN04
Hi Gurus, Good day. Please help. does WE20 and MN04 generates change logs? If yes, please advice on how to check change logs of both transactions. Thanks in advance.
-
Problem opening a web based PDF
Group, I would appreciate anyone's help with this. I run windows XP and just downloaded Adobe 9.1 I have no issues when trying to open a pdf file. However when I click on a web based document in a web browser I am unable to open, and receive the f
-
Hi, When i tried LOADing Business Group using 'Product Foundation' selection set, I am getting the below error in Log file. Name: HR_BusinessGroup Type: BC4J Path: oracle.apps.per.isetup.schema.server.BusinessGroupAM Time Taken(seconds): 4.0 oracle.a
-
Has anyone experience the "cricket" sound on an iMac pro ?
Has anyone experienced the "cricket" sound that seems to come when connected to the internet? It is disquieting ....