ZFS - Can't make raidz pool available. Please Help

Question

Hi All,
Several months ago I created a raidz pool on a 6 disk external sun array. It was working fine until the other day when I lost a drive. I took out the old drive, and put in the new drive, and am unable to bring the pool back up. It wont let me issue a zpool replace, or an online, or anything. Here is hopefully all the info you need to see what's going on: (If you need more info, let me know)
Piece of dmesg from after the reboot.
Dec 19 14:17:14 stzehlsun fmd: [ID 441519 daemon.error] SUNW-MSG-ID: ZFS-8000-CS, TYPE: Fault, VER: 1, SEVERITY: Major
Dec 19 14:17:14 stzehlsun EVENT-TIME: Tue Dec 19 14:17:14 EST 2006
Dec 19 14:17:14 stzehlsun PLATFORM: SUNW,Ultra-2, CSN: -, HOSTNAME: stzehlsun
Dec 19 14:17:14 stzehlsun SOURCE: zfs-diagnosis, REV: 1.0
Dec 19 14:17:14 stzehlsun EVENT-ID: 644874cf-084d-413d-88c6-c195db617041
Dec 19 14:17:14 stzehlsun DESC: A ZFS pool failed to open. Refer to http://sun.com/msg/ZFS-8000-CS for more information.
Dec 19 14:17:14 stzehlsun AUTO-RESPONSE: No automated response will occur.
Dec 19 14:17:14 stzehlsun IMPACT: The pool data is unavailable
Dec 19 14:17:14 stzehlsun REC-ACTION: Run 'zpool status -x' and either attach the missing device or
Dec 19 14:17:14 stzehlsun restore from backup.
# zpool status
pool: array
state: FAULTED
status: One or more devices could not be opened. There are insufficient
replicas for the pool to continue functioning.
action: Attach the missing device and online it using 'zpool online'.
see: http://www.sun.com/msg/ZFS-8000-D3
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
array UNAVAIL 0 0 0 insufficient replicas
c0t9d0 ONLINE 0 0 0
c0t10d0 ONLINE 0 0 0
c0t11d0 ONLINE 0 0 0
c0t12d0 ONLINE 0 0 0
c0t13d0 UNAVAIL 0 0 0 cannot open
c0t14d0 ONLINE 0 0 0
# zpool online array c0t13d0
cannot open 'array': pool is currently unavailable
run 'zpool status array' for detailed information
# zpool replace array c0t13d0
cannot open 'array': pool is currently unavailable
run 'zpool status array' for detailed information
As you can see, I've replaced c0t13d0 with the new drive, format sees it just fine, and it apprears to be up and running. What do I need to do to get this new drive into the raidz pool and get my pool back on-line? I just don't see what Im missing here. Thanks!
Steve

Answer 1

Sadly, I never received an answer on this forum, So I opened a ticket with Sun, and they got right back to me. For anyone following this thread, I'll pass along what they told me.
Basically, I THOUGHT I had created a raidz pool, apparently I did not, and only created a RAID0 pool. so with the one disk gone, there was no parity disk to re-build the array, so it remained faulted, no way to fix it, only solution is to destroy the pool and start again. I really thought I had created a raidz, but now that I have created a raidz pool, I can see the difference in the zpool status command.
Before: (MUST have been RAID0)
NAME STATE READ WRITE CKSUM
array UNAVAIL 0 0 0 insufficient replicas
c0t9d0 ONLINE 0 0 0
c0t10d0 ONLINE 0 0 0
c0t11d0 ONLINE 0 0 0
c0t12d0 ONLINE 0 0 0
c0t13d0 UNAVAIL 0 0 0 cannot open
c0t14d0 ONLINE 0 0 0
After creating a REAL raidz pool:
NAME STATE READ WRITE CKSUM
array ONLINE 0 0 0
raidz ONLINE 0 0 0
c0t9d0 ONLINE 0 0 0
c0t10d0 ONLINE 0 0 0
c0t11d0 ONLINE 0 0 0
c0t12d0 ONLINE 0 0 0
c0t13d0 ONLINE 0 0 0
c0t14d0 ONLINE 0 0 0
Note the added raidz line.
I asked the tech support guy if it was possible that I HAD created a raidz, but due to the disk loss and reboots it was a bug that was only showing it as a RAID0, and he said there are no reported cases of such an incident, and he really didn't think so. So, I guess I just messed up when I created it in the first place, and since I didn't know what a raidz pool would look like, I had no way of knowing I hadn't created one (Yes, I know I could have added up the disk space and realized no disk was being used for parity, but I didn't)
So moral here is to make sure you created what you thought you had created, and then it will do what you expect.