Account Options

  1. Sign in
The old Google Groups will be going away soon, but your browser is incompatible with the new version.
Google Groups Home
« Groups Home
problem booting to multi-vdev root pool [Was: kern/150503: [zfs]
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  14 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
Andriy Gapon  
View profile  
 More options Nov 16 2012, 10:45 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Andriy Gapon <a...@FreeBSD.org>
Date: Fri, 16 Nov 2012 17:45:07 +0200
Local: Fri, Nov 16 2012 10:45 am
Subject: problem booting to multi-vdev root pool [Was: kern/150503: [zfs]
on 13/11/2012 18:16 Guido Falsi said the following:

> My idea, but is just a speculation, i could be very wrong, is that the geom
> tasting code has some problem with multiple vdev root pools.

Guido,

you are absolutely correct.  The code for reconstructing/tasting a root pool
configuration is a modified upstream code, so it inherited a limitation from it:
the support for only a single top-level vdev in a root pool.
I have an idea how to add the missing support, but it turned out not to be
something that I can hack together in couple of hours.

So, instead I wrote the following patch that should fall back to using a root pool
configuration from zpool.cache (if it's present there) for a multi-vdev root pool:
http://people.freebsd.org/~avg/zfs-spa-multi_vdev_root_fallback.diff

The patch also fixes a minor (single-time) memory leak.

Guido, Bartosz,
could you please test the patch?

Apologies for the breakage.

--
Andriy Gapon
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Guido Falsi  
View profile  
 More options Nov 16 2012, 11:17 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Guido Falsi <m...@madpilot.net>
Date: Fri, 16 Nov 2012 17:17:05 +0100
Local: Fri, Nov 16 2012 11:17 am
Subject: Re: problem booting to multi-vdev root pool [Was: kern/150503: [zfs]
On 11/16/12 16:45, Andriy Gapon wrote:

> on 13/11/2012 18:16 Guido Falsi said the following:
>> My idea, but is just a speculation, i could be very wrong, is that the geom
>> tasting code has some problem with multiple vdev root pools.

> Guido,

> you are absolutely correct.  The code for reconstructing/tasting a root pool
> configuration is a modified upstream code, so it inherited a limitation from it:
> the support for only a single top-level vdev in a root pool.
> I have an idea how to add the missing support, but it turned out not to be
> something that I can hack together in couple of hours.

I can imagine, it does not look simple in any way!

> So, instead I wrote the following patch that should fall back to using a root pool
> configuration from zpool.cache (if it's present there) for a multi-vdev root pool:
> http://people.freebsd.org/~avg/zfs-spa-multi_vdev_root_fallback.diff

> The patch also fixes a minor (single-time) memory leak.

> Guido, Bartosz,
> could you please test the patch?

I have just compiler an r242910 kernel with this patch (and just this
one) applied.

System booted so it seems to work fine! :)

> Apologies for the breakage.

No worries, and thanks for this fix.

Also thanks for all the work on ZFS!

--
Guido Falsi <m...@madpilot.net>
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Guido Falsi  
View profile  
 More options Nov 16 2012, 11:33 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Guido Falsi <m...@madpilot.net>
Date: Fri, 16 Nov 2012 17:33:02 +0100
Local: Fri, Nov 16 2012 11:33 am
Subject: Re: problem booting to multi-vdev root pool [Was: kern/150503: [zfs]
On 11/16/12 17:13, Niclas Zeising wrote:

> Just to confirm, since I am holding back an update pending on this.
> If I have a raidz root pool, with three disks, like this:
>          NAME           STATE     READ WRITE CKSUM
>          zroot          ONLINE       0     0     0
>            raidz1-0     ONLINE       0     0     0
>              gpt/disk0  ONLINE       0     0     0
>              gpt/disk1  ONLINE       0     0     0
>              gpt/disk2  ONLINE       0     0     0

> Then I'm fine to update without issues. the problem is only if, as an
> example, you have a mirror with striped disks, or a stripe with mirrored
> disks, which it seems to me the original poster had.
> Am I correct, and therefore ok to update?

Yes, looks like that. The affected system pool looks like this:

         NAME           STATE     READ WRITE CKSUM
         tank           ONLINE       0     0     0
           mirror-0     ONLINE       0     0     0
             gpt/disk0  ONLINE       0     0     0
             gpt/disk1  ONLINE       0     0     0
           mirror-1     ONLINE       0     0     0
             ada2p2     ONLINE       0     0     0
             gpt/disk3  ONLINE       0     0     0

other systems I have with simple mirror pools or single disks have shown
no problems.

BTW I don't know why the system insists on identifying the third disk as
ada2p2, it has a gpt label defined just like the others.

--
Guido Falsi <m...@madpilot.net>
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Bartosz Stec  
View profile  
 More options Nov 17 2012, 7:27 pm
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Bartosz Stec <bartosz.s...@it4pro.pl>
Date: Sun, 18 Nov 2012 01:26:34 +0100
Local: Sat, Nov 17 2012 7:26 pm
Subject: Re: problem booting to multi-vdev root pool [Was: kern/150503: [zfs]
W dniu 2012-11-16 17:17, Guido Falsi pisze:

I've just compiled and installed fresh kernel with your patch, system
booted without any problems, so apparently patch works as intended.
Good job Andriy!

>> Apologies for the breakage.

> No worries, and thanks for this fix.

> Also thanks for all the work on ZFS!

Make it twice :)

Regards,

--
Bartosz Stec

_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Discussion subject changed to "problem booting to multi-vdev root pool" by Andriy Gapon
Andriy Gapon  
View profile  
 More options Nov 18 2012, 6:49 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Andriy Gapon <a...@FreeBSD.org>
Date: Sun, 18 Nov 2012 13:48:44 +0200
Local: Sun, Nov 18 2012 6:48 am
Subject: Re: problem booting to multi-vdev root pool
on 18/11/2012 02:26 Bartosz Stec said the following:

> W dniu 2012-11-16 17:17, Guido Falsi pisze:
>> On 11/16/12 16:45, Andriy Gapon wrote:
>>> Guido, Bartosz,
>>> could you please test the patch?

>> I have just compiler an r242910 kernel with this patch (and just this one)
>> applied.

>> System booted so it seems to work fine! :)
> I've just compiled and installed fresh kernel with your patch, system booted
> without any problems, so apparently patch works as intended.

Thank you both very much for testing!
Committed as r243213.

--
Andriy Gapon
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Andriy Gapon  
View profile  
 More options Nov 19 2012, 8:00 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Andriy Gapon <a...@FreeBSD.org>
Date: Mon, 19 Nov 2012 15:00:13 +0200
Local: Mon, Nov 19 2012 8:00 am
Subject: Re: problem booting to multi-vdev root pool
on 18/11/2012 13:48 Andriy Gapon said the following:

BTW, if you have some spare time and a desire to do some more testing, you can
try the following patch:
http://people.freebsd.org/~avg/zfs-spa-multi_vdev_root_support.diff

It adds support for multi-vdev root pool probing in kernel.
The best way to test is to remove zpool.cache before rebooting (but make sure to
keep a copy somewhere and be able to recover).  I'd use a boot environment (a
root filesystem clone) for this.

Thank you.
--
Andriy Gapon
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Andrei Lavreniyuk  
View profile  
 More options Nov 20 2012, 3:57 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Andrei Lavreniyuk <andy.l...@gmail.com>
Date: Tue, 20 Nov 2012 10:57:02 +0200
Local: Tues, Nov 20 2012 3:57 am
Subject: Re: problem booting to multi-vdev root pool
Hi!

My system:

# uname -a
FreeBSD open.technica-03.local 10.0-CURRENT FreeBSD 10.0-CURRENT #0:
Tue Oct 30 14:13:01 EET 2012
r...@open.technica-03.local:/usr/obj/usr/src/sys/SMP64R  amd64

# zpool status -v
  pool: zsolar
 state: ONLINE
  scan: resilvered 2,56M in 0h0m with 0 errors on Tue Nov 20 10:26:35 2012
config:

        NAME           STATE     READ WRITE CKSUM
        zsolar         ONLINE       0     0     0
          raidz2-0     ONLINE       0     0     0
            gpt/disk0  ONLINE       0     0     0
            gpt/disk2  ONLINE       0     0     0
            gpt/disk3  ONLINE       0     0     0

errors: No known data errors

Update source:

# svn info
Path: .
Working Copy Root Path: /usr/src
URL: svn://svn.freebsd.org/base/head
Repository Root: svn://svn.freebsd.org/base
Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f
Revision: 243278
Node Kind: directory
Schedule: normal
Last Changed Author: avg
Last Changed Rev: 243272
Last Changed Date: 2012-11-19 13:35:56 +0200

I used http://people.freebsd.org/~avg/zfs-spa-multi_vdev_root_support.diff

buildworld + kernel

rm /boot/zfs/zpool.cache

Reboot....

Mounting from zfs:zsolar failed with error 45

---
Best regards, Andrei Lavreniyuk.
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Andriy Gapon  
View profile  
 More options Nov 20 2012, 4:49 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Andriy Gapon <a...@FreeBSD.org>
Date: Tue, 20 Nov 2012 11:48:50 +0200
Local: Tues, Nov 20 2012 4:48 am
Subject: Re: problem booting to multi-vdev root pool
on 20/11/2012 10:57 Andrei Lavreniyuk said the following:

Are there any other unusual messages before this line?
Could you please try adding vfs.zfs.debug=1 to loader.conf and check again?

Could you also provide 'zdb -CC zsolar' output and 'zdb -l /dev/gpt/diskX' for
each of the disks.  These could be uploaded somewhere as they can be quite lengthy.

--
Andriy Gapon
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Andriy Gapon  
View profile  
 More options Nov 20 2012, 7:04 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Andriy Gapon <a...@FreeBSD.org>
Date: Tue, 20 Nov 2012 14:03:51 +0200
Local: Tues, Nov 20 2012 7:03 am
Subject: Re: problem booting to multi-vdev root pool
on 20/11/2012 12:45 Andrei Lavreniyuk said the following:

> Hi!

>> Are there any other unusual messages before this line?
>> Could you please try adding vfs.zfs.debug=1 to loader.conf and check again?

>> Could you also provide 'zdb -CC zsolar' output and 'zdb -l /dev/gpt/diskX' for
>> each of the disks.  These could be uploaded somewhere as they can be quite lengthy.

> Please view attached files.

Thank you.
"Can not parse the config for pool" message explains what happens but not why...

Could you please apply the following patch, "un-ifdef" the DEBUG sections of it
and try again?
http://people.freebsd.org/~avg/spa_generate_rootconf.debug.diff

--
Andriy Gapon
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Andrei Lavreniyuk  
View profile  
 More options Nov 20 2012, 7:35 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Andrei Lavreniyuk <andy.l...@gmail.com>
Date: Tue, 20 Nov 2012 14:35:00 +0200
Subject: Re: problem booting to multi-vdev root pool
 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Andriy Gapon  
View profile  
 More options Nov 20 2012, 8:08 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Andriy Gapon <a...@FreeBSD.org>
Date: Tue, 20 Nov 2012 15:08:22 +0200
Local: Tues, Nov 20 2012 8:08 am
Subject: Re: problem booting to multi-vdev root pool
on 20/11/2012 14:41 Andrei Lavreniyuk said the following:

> Hi!

>> "Can not parse the config for pool" message explains what happens but not why...

>> Could you please apply the following patch, "un-ifdef" the DEBUG sections of it
>> and try again?
>> http://people.freebsd.org/~avg/spa_generate_rootconf.debug.diff

> I use spa_generate_rootconf.debug.diff.

What about the " "un-ifdef" the DEBUG sections of it" part?

> make kernel && reboot

> No new debug messages. Pool cannot mount.

--
Andriy Gapon
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Andrei Lavreniyuk  
View profile  
 More options Nov 20 2012, 8:35 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Andrei Lavreniyuk <andy.l...@gmail.com>
Date: Tue, 20 Nov 2012 15:34:19 +0200
Local: Tues, Nov 20 2012 8:34 am
Subject: Re: problem booting to multi-vdev root pool

> What about the " "un-ifdef" the DEBUG sections of it" part?

http://tor.reactor-xg.kiev.ua/files/zfs/20121120_000.jpeg
http://tor.reactor-xg.kiev.ua/files/zfs/20121120_001.jpeg
http://tor.reactor-xg.kiev.ua/files/zfs/20121120_002.jpeg
http://tor.reactor-xg.kiev.ua/files/zfs/20121120_003.jpeg
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"

 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Andrei Lavreniyuk  
View profile  
 More options Nov 21 2012, 2:51 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Andrei Lavreniyuk <andy.l...@gmail.com>
Date: Wed, 21 Nov 2012 09:51:23 +0200
Local: Wed, Nov 21 2012 2:51 am
Subject: Re: problem booting to multi-vdev root pool
2012/11/20 Andriy Gapon <a...@freebsd.org>:

Problem solved. Raidz pool mount without zpool.cache.

# zpool status -v
  pool: zsolar
 state: ONLINE
  scan: resilvered 2,56M in 0h0m with 0 errors on Tue Nov 20 10:26:35 2012
config:

        NAME           STATE     READ WRITE CKSUM
        zsolar         ONLINE       0     0     0
          raidz2-0     ONLINE       0     0     0
            gpt/disk0  ONLINE       0     0     0
            gpt/disk2  ONLINE       0     0     0
            gpt/disk3  ONLINE       0     0     0

errors: No known data errors

# uname -a
FreeBSD opensolaris.technica-03.local 10.0-CURRENT FreeBSD
10.0-CURRENT #6 r243278M: Wed Nov 21 09:28:51 EET 2012
r...@opensolaris.technica-03.local:/usr/obj/usr/src/sys/SMP64R  amd64

Thanks!
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Andriy Gapon  
View profile  
 More options Nov 21 2012, 11:49 am
Newsgroups: mpc.lists.freebsd.current, muc.lists.freebsd.current
From: Andriy Gapon <a...@FreeBSD.org>
Date: Wed, 21 Nov 2012 18:49:20 +0200
Local: Wed, Nov 21 2012 11:49 am
Subject: Re: problem booting to multi-vdev root pool
on 21/11/2012 09:51 Andrei Lavreniyuk said the following:

Thank you for testing!

--
Andriy Gapon
_______________________________________________
freebsd-curr...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-current
To unsubscribe, send any mail to "freebsd-current-unsubscr...@freebsd.org"


 
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »