Trying to create an instance of MS-Windows Server 2008 R2

[Jeffrey Silverman]

I am trying to build an instance that runs Windows Server 2008 R2, and I have run into an error message I don't understand.

root@kir02gans002:~# gnt-instance add -t drbd -s 25G -B memory=4GB,vcpus=2 -o fullvirt+win2k8 --net 0:link=br2 \

> -H boot_order=cd,cdrom_image_path=en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso \

> kir02back015.widevine.net

Failure: prerequisites not met for this operation:

error type: wrong_state, error details:

Selected hypervisor (boot_order=cd,cdrom_image_path=en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso) not enabled in the cluster (xen-pvm,xen-hvm)

root@kir02gans002:~# 

I've been googling this error message and I've seen several cases where people have gotten it, but none of them quite match what I am trying to do.

root@kir02gans002:~# gnt-cluster verify
Fri Aug 30 00:41:23 2013 * Verifying global settings
Fri Aug 30 00:41:23 2013 * Gathering data (4 nodes)
Fri Aug 30 00:41:25 2013 * Gathering disk information (4 nodes)
Fri Aug 30 00:41:26 2013 * Verifying node status
Fri Aug 30 00:41:26 2013 * Verifying instance status
Fri Aug 30 00:41:26 2013 * Verifying orphan volumes
Fri Aug 30 00:41:26 2013 * Verifying orphan instances
Fri Aug 30 00:41:26 2013 * Verifying N+1 Memory redundancy
Fri Aug 30 00:41:26 2013 * Other Notes
Fri Aug 30 00:41:26 2013   - NOTICE: 1 non-redundant instance(s) found.
Fri Aug 30 00:41:26 2013 * Hooks Results
root@kir02gans002:~# gnt-cluster info
Cluster name: kir02ganc001.widevine.net
Cluster UUID: 401079b5-dcc0-42c6-bfd0-f93907fb016a
Creation time: 2011-12-07 23:33:02
Modification time: 2012-01-13 02:57:43
Master node: kir02gans002.widevine.net
Architecture (this node): 64bit (x86_64)
Tags: (none)
Default hypervisor: xen-pvm
Enabled hypervisors: xen-pvm, xen-hvm
Hypervisor parameters:
  - xen-hvm:
      acpi: True
      blockdev_prefix: hd
      boot_order: cd
      cdrom_image_path: 
      device_model: /usr/lib/xen-4.0/bin/qemu-dm
      disk_type: paravirtual
      kernel_path: /usr/lib/xen-4.0/boot/hvmloader
      migration_mode: live
      migration_port: 8002
      nic_type: paravirtual
      pae: True
      use_localtime: False
      vnc_bind_address: 0.0.0.0
      vnc_password_file: /etc/ganeti/vnc-cluster-password
  - xen-pvm:
      blockdev_prefix: xvd
      bootloader_args: 
      bootloader_path: /usr/lib/xen-4.0/bin/pygrub
      initrd_path: /srv/ganeti/rhel5_install/i386/initrd.img
      kernel_args: ro ks=http://kir02repo006.widevine.net/mrepo/widevineOS-5.7-20120112-i386/kickstart/cypherG6xen.ks ip=10.50.101.2 netmask=255.255.0.0 gateway=10.50.255.254 dns=10.50.100.1
      kernel_path: /srv/ganeti/rhel5_install/i386/vmlinuz
      migration_mode: live
      migration_port: 8002
      root_path: /dev/xvda1
      use_bootloader: False
OS-specific hypervisor parameters:
OS parameters:
Hidden OSes: 
Blacklisted OSes: 
Cluster parameters:
  - candidate pool size: 10
  - master netdev: br0
  - lvm volume group: xenvg
  - lvm reserved volumes: (none)
  - drbd usermode helper: /bin/true
  - file storage path: /srv/ganeti/file-storage
  - maintenance of node health: False
  - uid pool: 
  - default instance allocator: hail
  - primary ip version: 4
  - preallocation wipe disks: False
  - OS search path: /srv/ganeti/os
Default node parameters:
    oob_program: None
Default instance parameters:
  - default:
      auto_balance: True
      memory: 128
      vcpus: 1
Default nic parameters:
  - default:
      link: br0
      mode: bridged
root@kir02gans002:~# 

I have this vague feeling that there is an issue with the hypervisor for the cluster, which suggests that I can't install Windows on this cluster.  Or is there something I am missing?

Thank you in advance

Jeff Silverman

[Jorge Manuel B. S. Vicetto]

Hi.

On Fri, Aug 30, 2013 at 12:48 AM, Jeffrey Silverman <jeffsi...@google.com> wrote:

I am trying to build an instance that runs Windows Server 2008 R2, and I have run into an error message I don't understand.

root@kir02gans002:~# gnt-instance add -t drbd -s 25G -B memory=4GB,vcpus=2 -o fullvirt+win2k8 --net 0:link=br2 \

> -H boot_order=cd,cdrom_image_path=en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso \

> kir02back015.widevine.net

Failure: prerequisites not met for this operation:

error type: wrong_state, error details:

Selected hypervisor (boot_order=cd,cdrom_image_path=en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso) not enabled in the cluster (xen-pvm,xen-hvm)

root@kir02gans002:~# 

I've been googling this error message and I've seen several cases where people have gotten it, but none of them quite match what I am trying to do.

Reading the above error and after checking gnt-instance man page, have you tried specifying which of the hypervisors (xen-pvm or xen-hvm) you want to use? Try using the following command (picking xen-pvm or xen-hvm as you prefer):

gnt-instance add -t drbd -s 25G -B memory=4GB,vcpus=2 -o fullvirt+win2k8 --net 0:link=br2 \

-H xen-pvm boot_order=cd,cdrom_image_path=en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso \
kir02back015.widevine.net

If that gives an error about the cdrom_image_path, try using the full path and ensuring you have that path on the nodes you're trying to create the instance.

 

I have this vague feeling that there is an issue with the hypervisor for the cluster, which suggests that I can't install Windows on this cluster. Or is there something I am missing?

Thank you in advance

Jeff Silverman

Regards,

Jorge Manuel B. S. Vicetto

[Jeffrey Silverman]

I tried specifying the file explicitly and I tried both hypervisor options.  Ganeti still thinks something is the wrong with the state.

root@kir02gans002:~# gnt-instance add -t drbd -s 25G -B memory=4GB,vcpus=2 -o fullvirt+win2k8 --net 0:link=br2 \

-H boot_order=cd,cdrom_image_path=~jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso,xen-hvm \

kir02back015.widevine.net

Failure: prerequisites not met for this operation:
error type: wrong_state, error details:

Selected hypervisor (boot_order=cd,cdrom_image_path=~jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso,xen-hvm) not enabled in the cluster (xen-pvm,xen-hvm)

root@kir02gans002:~# gnt-instance add -t drbd -s 25G -B memory=4GB,vcpus=2 -o fullvirt+win2k8 --net 0:link=br2 \

-H boot_order=cd,cdrom_image_path=~jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso,xen-pvm \

 kir02back015.widevine.net
Failure: prerequisites not met for this operation:
error type: wrong_state, error details:

Selected hypervisor (boot_order=cd,cdrom_image_path=~jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso,xen-pvm) not enabled in the cluster (xen-pvm,xen-hvm)

root@kir02gans002:~# 

Any suggestions?  I have another instance running Windows Server 2008 on this physical machine.

Thank you

Jeff

[Patrick Hahn]

I think you want -H xen-kvm:boot_order=cd,cdrom_image_path=~jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso

[Jeffrey Silverman]

Patrick,

I tried several variations on your theme.

root@kir02gans002:~# gnt-instance add -t drbd -s 25G -B memory=4GB,vcpus=2 -o fullvirt+win2k8 --net 0:link=br2 -H xen-kvm:boot_order=cd,cdrom_image_path=~jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso  kir02back015.widevine.net

Failure: prerequisites not met for this operation:
error type: wrong_state, error details:

Selected hypervisor (xen-kvm) not enabled in the cluster (xen-pvm,xen-hvm)
root@kir02gans002:~# gnt-instance add -t drbd -s 25G -B memory=4GB,vcpus=2 -o fullvirt+win2k8 --net 0:link=br2 -H xen-hvm:boot_order=cd,cdrom_image_path=~jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso  kir02back015.widevine.net

Unhandled Ganeti error: Parameter 'cdrom_image_path' fails syntax check: must be an absolute normalized path (current value: '~jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso')
root@kir02gans002:~# fgrep jsilverman /etc/passwd

jsilverman:x:1006:1006:Jeff Silverman,,(253) 459-2318,:/home/jsilverman:/bin/bash
root@kir02gans002:~# gnt-instance add -t drbd -s 25G -B memory=4GB,vcpus=2 -o fullvirt+win2k8 --net 0:link=br2 -H xen-hvm:boot_order=cd,cdrom_image_path=/home/jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso  kir02back015.widevine.net

Fri Aug 30 19:57:13 2013  - INFO: Selected nodes for instance kir02back015.widevine.net via iallocator hail: kir02gans004.widevine.net, kir02gans005.widevine.net

Failure: command execution error:
Hypervisor parameter validation failed on node kir02gans004.widevine.net: Parameter 'cdrom_image_path' fails validation: not found or not a file (current value: '/home/jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso')

root@kir02gans002:~# ls /home/jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso
/home/jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso
root@kir02gans002:~# 
root@kir02gans002:~# file /home/jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso

/home/jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso: ISO 9660 CD-ROM filesystem data 'GRMSXFRER_EN_DVD               ' (bootable)
root@kir02gans002:~# 

I think I am making progress.

I appreciate your kind assistance.

Jeff

[Patrick Hahn]

Ahh, yes the elusive xen-kvm hypervisor. Yeah I meant xen-hvm as you discovered.

As for the most recent error make sure that file exists on the instance's primary and secondary nodes. In practice you probably want it on every node in the cluster (gnt-cluster copyfile for example). 

[Jeffrey Silverman]

I'm getting there, I'm getting there.  Not quite out of the woods yet:

root@kir02gans002:~# gnt-instance add -t drbd -s 25G -B memory=4GB,vcpus=2 -o fullvirt+win2k8 --net 0:link=br0 -H xen-hvm:boot_order=cd,cdrom_image_path=/home/jsilverman/en_windows_server_2008_r2_with_sp1_x64_dvd_617601.iso  kir02back015.widevine.net

Fri Aug 30 20:56:19 2013  - INFO: Selected nodes for instance kir02back015.widevine.net via iallocator hail: kir02gans004.widevine.net, kir02gans005.widevine.net

Fri Aug 30 20:56:22 2013 * creating instance disks...

Fri Aug 30 20:56:33 2013 adding instance kir02back015.widevine.net to cluster config

Fri Aug 30 20:56:34 2013  - INFO: Waiting for instance kir02back015.widevine.net to sync disks.

Fri Aug 30 20:56:34 2013  - INFO: - device disk/0:  0.30% done, 6m 31s remaining (estimated)

...

Fri Aug 30 21:03:40 2013  - INFO: - device disk/0: 100.00% done, 0s remaining (estimated)

Fri Aug 30 21:03:41 2013  - INFO: Instance kir02back015.widevine.net's disks are in sync.

Fri Aug 30 21:03:41 2013 * running the instance OS create scripts...

Failure: command execution error:

Could not add os for instance kir02back015.widevine.net on node kir02gans004.widevine.net: Error while executing backend function: [Errno 8] Exec format error

root@kir02gans002:~# 

Any suggestions on what to do next?

Thank you

Jeff

[Jeffrey Silverman]

I tried booting my .ISO file in Oracle VirtualBox, and it won't boot there, either.  The problem is a missing driver.  It is considered impolite for linuxians to sneer at Microsoft, so I will refrain.  I am going to find another copy of win2k8 .iso and try again.

Thank you

Jeff

[Jorge Manuel B. S. Vicetto]

On Tue, Sep 3, 2013 at 10:53 PM, Jeffrey Silverman <jeffsi...@google.com> wrote:

I tried booting my .ISO file in Oracle VirtualBox, and it won't boot there, either.  The problem is a missing driver.  It is considered impolite for linuxians to sneer at Microsoft, so I will refrain.  I am going to find another copy of win2k8 .iso and try again.

If you're trying to use virtio devices for the install (which I believe you are), you'll need to get the RedHat binary drivers and add them during install. An alternative is to use the device as SCSI during the install, then adding a small disk set to virtio, install the drivers then and then switch your main disk to virtio during a reboot.

 

Thank you

Jeff

 

Regards,

Jorge

[Jeffrey Silverman]

Jorge,

Can you go into a little more detail about how to do that?  It isn't clear to me at all how to use RedHat binary drivers with a Windows 2008 install.

Many thanks,

Jeff

[Thomas Rieschl]

Hey!

Just set "cdrom_image_path" to your Windows .ISO file and
"cdrom2_image_path" to the VirtIO .ISO from Fedora [1].

When installing Windows, at the stage when you have to choose the
partition, there's an option to load additional disk drivers. You can
then select the driver path from the second cdrom, i.e. the VirtIO .ISO


Cheers,
Thomas


[1] http://alt.fedoraproject.org/pub/alt/virtio-win/latest/images/

[Jeffrey Silverman]

I am getting an error message:

root@kir02gans002:~# gnt-instance add -t drbd -s 25G -B memory=4GB,vcpus=2 -o fullvirt+win2k8 --net 0:link=br0 -H xen-hvm:boot_order=dc,cdrom_image_path=/srv/ganeti/win2k8_install/SW_DVD5_Windows_Svr_2008w_SP2_English__x64_DC_EE_SE_X15-41371.ISO  -H cdrom2_image_path=/home/jsilverman/virtio-win-0.1-65.iso --no-start kir02back015.widevine.net 

Failure: prerequisites not met for this operation:

error type: wrong_state, error details:

Selected hypervisor (cdrom2_image_path=/home/jsilverman/virtio-win-0.1-65.iso) not enabled in the cluster (xen-pvm,xen-hvm)

root@kir02gans002:~# 

I suspect that the problem is that the cdrom2_image_path option.  From the gnt-instance man page:

 cdrom2_image_path

              Valid for the KVM hypervisor.

              The  path  to a second CDROM image to attach to the instance.  NOTE: This image can't be used to boot the system. To do that you have to use the

              'cdrom_image_path' option.

I am using the HVM hypervisor.

Jeff

[Marco Casavecchia M.]

Hi Jeff, the patch that adds the support for a second cdrom is quite trivial.

It would be easy to add it to xen, but I don't have a xen cluster to test it.

I advice you to take a look at the kvm source code to see how to do it.

[Jake Anderson]

worst case you could do it the old fashioned way ;->
boot the instance
stop watcher from running (cron)
get the command line for the instance (ps -Af)
kill the instance (kill -9)
modify the command line to include the 2nd CD
run the command line
install windows
shut down the instance (from inside) normally
restart watcher
watcher will restart the instance

That's what I did in the old days with KVM before the 2nd cd worked.

[Thomas Rieschl]

On 05.09.2013 07:18, Jake Anderson wrote:
> worst case you could do it the old fashioned way ;->
> boot the instance
> stop watcher from running (cron)
> get the command line for the instance (ps -Af)
> kill the instance (kill -9)
> modify the command line to include the 2nd CD
> run the command line
> install windows
> shut down the instance (from inside) normally
> restart watcher
> watcher will restart the instance

haha, I remember these times. Didn't think, that would be necessary
anymore :)

But does that even work in XEN? A XEN VM isn't just a process like in
KVM, is it?


Regards,
Thomas

>
> That's what I did in the old days with KVM before the 2nd cd worked.
>
>
> On 05/09/13 15:12, Marco Casavecchia M. wrote:
>> Hi Jeff, the patch that adds the support for a second cdrom is quite
>> trivial.
>> It would be easy to add it to xen, but I don't have a xen cluster to
>> test it.
>>
>> I advice you to take a look at the kvm source code to see how to do it.
>>
>>
>> On 04/set/2013, at 19:50, Jeffrey Silverman <jeffsi...@google.com

>> <mailto:jeffsi...@google.com>> wrote:
>>
>>> I am getting an error message:
>>>
>>> root@kir02gans002:~# gnt-instance add -t drbd -s 25G -B
>>> memory=4GB,vcpus=2 -o fullvirt+win2k8 --net 0:link=br0 -H
>>> xen-hvm:boot_order=dc,cdrom_image_path=/srv/ganeti/win2k8_install/SW_DVD5_Windows_Svr_2008w_SP2_English__x64_DC_EE_SE_X15-41371.ISO
>>> -H cdrom2_image_path=/home/jsilverman/virtio-win-0.1-65.iso

>>> --no-start kir02back015.widevine.net <http://kir02back015.widevine.net>

>>> > <jmbsv...@gmail.com <javascript:> <mailto:jmbsv...@gmail.com

>>> <javascript:>>> wrote:
>>> >
>>> > On Tue, Sep 3, 2013 at 10:53 PM, Jeffrey Silverman

>>> > <jeffsi...@google.com <javascript:>

[Jake Anderson]

On 05/09/13 16:14, Thomas Rieschl wrote:
>
> haha, I remember these times. Didn't think, that would be necessary
> anymore :)
>
> But does that even work in XEN? A XEN VM isn't just a process like in
> KVM, is it?
>
>
> Regards,
> Thomas

That's a good point I forgot about xen being weird like that lol.