Stateful provisioning not working

367 views
Skip to first unread message

Wissam

unread,
Jan 28, 2015, 6:17:59 AM1/28/15
to ware...@lbl.gov
Hi,
I have followed the recipe in http://warewulf.lbl.gov/trac/wiki/Recipes/StatefulProvisioning to provision centos 6 to disk. I got a message on screen:
"chroot to NEW_ROOT, delete all in /, move NEW_ROOT to /, execute NEW_INIT, PID must be 1. NEW_ROOT must be a mount point."

I have edited the fstab file on the chroot image to state the root partition to be mounted on /dev/sda1 and i get the same result. Here is the output of object print warewulf2 -p :all

#### node warewulf2 ###########################################################
      10: NAME       = warewulf2
      10: BOOTLOADER = sda
      10: BOOTSTRAPID = 6
      10: DISKFORMAT = sda1
      10: DISKPARTITION = sda
      10: FILEIDS    = 2
      10: FILESYSTEMS = mountpoint=/:dev=sda1:type=ext4:size=10000
      10: NETDEVS    = ObjectSet
            NETDEVS.eth0.NAME         = eth0
            NETDEVS.eth0.GATEWAY      = 192.168.124.2
            NETDEVS.eth0.HWADDR       = 52:54:00:44:bc:55
            NETDEVS.eth0.IPADDR       = 192.168.124.4
            NETDEVS.eth0.NETMASK      = 255.255.255.0
            NETDEVS.eth0.NETWORK      = 192.168.124.0
      10: NODENAME   = warewulf2
      10: VNFSID     = 8

Any help would be appreciated.
Regards,
Wissam

john.m...@tpac.org.au

unread,
Sep 1, 2017, 1:25:41 AM9/1/17
to Warewulf
Hi Wissam,

Did you solve this issue?  I am seeing the same error when provisioning a static node on a newly installed OpenHPC cluster.

Cheers.
--JohnM

itoufique

unread,
Sep 13, 2017, 1:34:38 AM9/13/17
to Warewulf
Hi Guys, 

I am in the same process of setting up stateful installs with warewulf.  If you don't mind, can you share the steps you took to setup stateful provisioning?  in the WiKi page, all i see is this : http://warewulf.lbl.gov/trac/wiki/Recipes/StatefulProvisioning . I was not sure exactly how to follow the document with the steps provided.  If you can share an example, it would be very helpful. 

thanks a lot

Meij, Henk

unread,
Sep 13, 2017, 8:14:14 AM9/13/17
to Warewulf

If you want to do stateful it's much handier to go the golden image route. Build a node up the way you want it, then grab the image using rsync, create vnfs/bootstrap, define the node object in warewulf and off you go. My progress is detailed at


https://dokuwiki.wesleyan.edu/doku.php?id=cluster:144



-Henk


From: itoufique <tech...@gmail.com>
Sent: Wednesday, September 13, 2017 1:34:38 AM
To: Warewulf
Subject: [Warewulf] Re: Stateful provisioning not working
 
--
You received this message because you are subscribed to the Google Groups "Warewulf" group.
To unsubscribe from this group and stop receiving emails from it, send an email to warewulf+u...@lbl.gov.
To post to this group, send email to ware...@lbl.gov.
To view this discussion on the web visit https://groups.google.com/a/lbl.gov/d/msgid/warewulf/dbda2b83-f6dd-4eaa-8a5e-307ebe32ab78%40lbl.gov.
For more options, visit https://groups.google.com/a/lbl.gov/d/optout.

John Miezitis - TPAC

unread,
Sep 13, 2017, 7:10:58 PM9/13/17
to ware...@lbl.gov

Hello itoufique,

 

I was following the Centos-Warewulf-PBSPro recipe (https://github.com/openhpc/ohpc/releases/download/v1.3.2.GA/Install_guide-CentOS7-Warewulf-PBSPro-1.3.2-x86_64.pdf) from OpenHPC.  My issue turned out to be several typos introduced while setting up the node in warewulf.  It is working now and I have duplicated the steps for a statefull  client node as well.

 

Cheers.

--JohnM

 

 

 

From: itoufique [mailto:tech...@gmail.com]
Sent: Wednesday, 13 September 2017 15:35
To: Warewulf <ware...@lbl.gov>
Subject: [Warewulf] Re: Stateful provisioning not working

 

Hi Guys, 

--

itoufique

unread,
Sep 13, 2017, 8:54:28 PM9/13/17
to Warewulf
Hi John/Henk,

Thanks, you guys!  You guys are awesome!  :-) We made a bit more progress with Warewulf.  Still trying to figure out the golden image part.  I might ask a few more questions, I hope you guys don't mind.  

here is my problem list:

1.  It looks like Warewulf uses MBR, therefore, it cannot address drives bigger than 2TB.  is there a workaround or a fix for that?  I am using version 3.6 . Below is a example from 'fdisk -l' from the node that we just built:

[root@b0 ~]# fdisk -l

Disk /dev/sda: 80.0 GB, 80026361856 bytes
255 heads, 63 sectors/track, 9729 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0xcece6336

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          64      512000   83  Linux
Partition 1 does not end on cylinder boundary.
/dev/sda2              64         319     2048000   82  Linux swap / Solaris
Partition 2 does not end on cylinder boundary.
/dev/sda3


2.  Also, for some reason, I can't get swap mounted in the machine, I followed the exact syntax in this document, https://dokuwiki.wesleyan.edu/doku.php?id=cluster:144 .  the system boots, and no swap.  ;-( 

3.  also, is there a way modify boot options in grub.conf?  Warewulf seems to put in an option called "console=" in my nodes grub.conf, which hangs the machine on reboot.  I am trying to find out what appends that boot option in the grub.conf file.

If you can take a few mins off your busy schedule to help me get through this, I would for sure appreciate it!

Thanks again!

Meij, Henk

unread,
Sep 14, 2017, 8:16:46 AM9/14/17
to Warewulf

#1 I'd try to keep my OS disks tiny and use the large disks for /scratch, helps with reimaging speeds


#2 Are you sure it's not there? Commands like df/mount will not show it, try 'free -m' on the node

You may also want to try swapon /dev/sda2, if that works stick it in /etc/rc.local


-Henk


From: itoufique <tech...@gmail.com>
Sent: Wednesday, September 13, 2017 8:54:28 PM
To: Warewulf
Subject: Re: [Warewulf] Re: Stateful provisioning not working
 

itoufique

unread,
Sep 14, 2017, 12:37:52 PM9/14/17
to Warewulf
Hi Henk, 

Thanks for your continuous support!  very much appreciated sir!  

on your #1, Does warewulf has a hard dependency on 'fdisk' ?  I was looking for the script/program that does this part, I could not find it yet.  I guess for now I can try to use a OS disk 2tb or smaller, but I am looking to see if there is a way to enable this by a post install hook or with the tool while the node is being provisioned(?)

On your  #2, it looks like provision process does not run "mkswap /dev/sda3" .  it puts the line in /etc/fstab OK.  therefore, it does not work.  Can you point me to the script that run the provisioning process?  the filesystems.log is created by this tool.

Thanks again for your help!
Message has been deleted

Imam Toufique

unread,
Sep 22, 2017, 7:22:32 PM9/22/17
to ware...@lbl.gov
i was able to get the build going, I have a lot more to test.  It looks like you guys are way ahead of me ;-).  But, at least I am happy that my stateful build is running.  

--imam

On Wed, Sep 20, 2017 at 9:17 AM, Rajil Saraswat <raj...@gmail.com> wrote:
Hi John,

I used the same recipe to build the cluster. Unfortunately, i am getting the same error. Please can you post what typos did you find?

Thanks



--
Regards,
Imam Toufique
Reply all
Reply to author
Forward
0 new messages