drbd0: can't setup network: exited with exit code 20 ?

Joe Shang

unread,

Oct 23, 2010, 5:54:32 PM10/23/10

to ganeti

I can't seem to figure out what is wrong, was wondering if anyone here
can guide me on where to look:

Sat Oct 23 14:52:27 2010 - INFO: No-installation mode selected,
disabling startup
Sat Oct 23 14:52:28 2010 * creating instance disks...
Sat Oct 23 14:52:28 2010 - WARNING: Device creation failed,
reverting...
Failure: command execution error:
Can't create block device <DRBD8(hosts=gnt-01.gnttest.com/0-
gnt-02.gnttest.com/0, port=11037, configured as 10.10.80.48:11037
10.10.80.49:11037, backend=<LogicalVolume(/dev/kvmvg/
ddc38e4b-98d4-45aa-80a1-eb420ff22f91.disk0_data, not visible,
size=204800m)>, metadev=<LogicalVolume(/dev/kvmvg/
ddc38e4b-98d4-45aa-80a1-eb420ff22f91.disk0_meta, not visible,
size=128m)>, visible as /dev/disk/0, size=204800m)> on node
gnt-01.owteam.com for instance cms.gnttest.com: Can't assemble device
after creation, unusual event: drbd0: can't setup network: exited with
exit code 20 - 10.10.80.48:11037 is not a valid number

Internal network seems fine:

gnt-01:~# gnt-cluster verify
Sat Oct 23 14:54:17 2010 * Verifying global settings
Sat Oct 23 14:54:17 2010 * Gathering data (2 nodes)
Sat Oct 23 14:54:17 2010 * Verifying node status
Sat Oct 23 14:54:17 2010 * Verifying instance status
Sat Oct 23 14:54:17 2010 * Verifying orphan volumes
Sat Oct 23 14:54:17 2010 * Verifying orphan instances
Sat Oct 23 14:54:17 2010 * Verifying N+1 Memory redundancy
Sat Oct 23 14:54:17 2010 * Other Notes
Sat Oct 23 14:54:17 2010 * Hooks Results
gnt-01:~#

I can't seem to create it, cause of the above error. Any ideas?

Iustin Pop

unread,

Oct 24, 2010, 6:59:25 AM10/24/10

to gan...@googlegroups.com

What version of DRBD do you have?

regards,
iustin

Joe Shang

unread,

Oct 24, 2010, 11:46:29 AM10/24/10

to ganeti

I am running

gnt-01:~# cat /proc/drbd
version: 8.0.14 (api:86/proto:86)
GIT-hash: bb447522fc9a87d0069b7e14f0234911ebdab0f7 build by phil@fat-
tyre, 2008-11-12 16:40:33

Iustin Pop

unread,

Oct 25, 2010, 5:33:22 AM10/25/10

to gan...@googlegroups.com

On Sun, Oct 24, 2010 at 08:46:29AM -0700, Joe Shang wrote:
> I am running
>
> gnt-01:~# cat /proc/drbd
> version: 8.0.14 (api:86/proto:86)
> GIT-hash: bb447522fc9a87d0069b7e14f0234911ebdab0f7 build by phil@fat-
> tyre, 2008-11-12 16:40:33

Hmm, this is a known working version. Can you find on node
gnt-01.owteam.com in /var/log/ganeti/node-daemon.log, the exact call to
drbdsetup /dev/drbd0 net … ?

Alternatively, can you confirm that gnt-01.gnttest.com is actually
gnt-01.owteam.com (just some mixup in copying the message), and that
gnt-01.owteam.com has the IP 10.10.80.48?

iustin

Joe Shang

unread,

Oct 25, 2010, 3:14:23 PM10/25/10

to ganeti

Can't see naything in node-deamon.log the exact call to drbdsetup, all
I see is:

2010-10-22 16:36:54,748: ganeti-noded pid=4512 ERROR Can't assemble

device after creation, unusual event: drbd0: can't setup network:

exited with exit code 20 - 10.10.80.48:11021 is not a valid number
2010-10-22 16:38:37,862: ganeti-noded pid=4607 ERROR drbd0: can't
setup network: exited with exit code 20 - 10.10.80.48:11023 is not a
valid number
2010-10-22 16:38:37,863: ganeti-noded pid=4607 ERROR Can't assemble

device after creation, unusual event: drbd0: can't setup network:

exited with exit code 20 - 10.10.80.48:11023 is not a valid number
2010-10-22 16:41:41,324: ganeti-noded pid=4728 ERROR drbd0: can't
setup network: exited with exit code 20 - 10.10.80.48:11025 is not a
valid number
2010-10-22 16:41:41,324: ganeti-noded pid=4728 ERROR Can't assemble

device after creation, unusual event: drbd0: can't setup network:

exited with exit code 20 - 10.10.80.48:11025 is not a valid number

Yeah it was a mixup from copying it over here.

Those two do have the proper IPs in their hosts file:

gnt-01:/etc# ping gnt-01.owteam.com
PING gnt-01.owteam.com (10.10.80.48) 56(84) bytes of data.
64 bytes from gnt-01.owteam.com (10.10.80.48): icmp_seq=1 ttl=64
time=0.017 ms
^C
--- gnt-01.owteam.com ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.017/0.017/0.017/0.000 ms
gnt-01:/etc# ping gnt-02.owteam.com
PING gnt-02.owteam.com (10.10.80.49) 56(84) bytes of data.
64 bytes from gnt-02.owteam.com (10.10.80.49): icmp_seq=1 ttl=64
time=0.139 ms
^C
--- gnt-02.owteam.com ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms

Any other ideas ?

Thanks!

mehdi

unread,

Nov 9, 2010, 12:21:34 PM11/9/10

to ganeti

i have the same problem with same errors and same configuration

Joe Shang

unread,

Nov 12, 2010, 2:59:34 PM11/12/10

to ganeti

I downgraded to 2.1.7 , and it works, something is wrong with 2.2.x

Iustin Pop

unread,

Nov 15, 2010, 1:47:27 AM11/15/10

to gan...@googlegroups.com

On Fri, Nov 12, 2010 at 11:59:34AM -0800, Joe Shang wrote:
> I downgraded to 2.1.7 , and it works, something is wrong with 2.2.x

Interesting. The difference in 2.2 is that we have some code for IPv6
compatibility, but this shouldn't break DRBD :(

Having the actual DRBD call would be useful, but at this point I
think the problem is that DRBD 8.0 is not compatible with the extended
setup syntax (where we pass the IP family too).

Indeed, commit d11a91e (Support for address families. Currently ipv4,
ipv6 and sci) was added in DRBD 8.2.7, so no earlier version works with
Ganeti 2.2.

Sorry for not documenting this and thanks a lot for debugging it!

iustin

Joe Shang

unread,

Nov 15, 2010, 2:31:27 PM11/15/10

to ganeti

I upgraded DRBD, and tried 2.2.1 again, and it failed:

Failure: command execution error:
Can't create block device <DRBD8(hosts=gnt-01.XXXXXX.com/0-
gnt-02.XXXXXX.com/0, port=11001, configured as 10.10.80.50:11001
10.10.80.51:11001, backend=<LogicalVolume(/dev/xenvg/
c4698afd-1dd4-4775-b201-7918d9c8b805.disk0_data, not visible,
size=102400m)>, metadev=<LogicalVolume(/dev/xenvg/c4698afd-1dd4-4775-
b201-7918d9c8b805.disk0_meta, not visible, size=128m)>, visible as /
dev/disk/0, size=102400m)> on node gnt-01.XXXXX.com for instance chd-
cms.XXXXX.com: Can't assemble device after creation, unusual event:

drbd0: can't setup network: exited with exit code 20 -

10.10.80.50:11001 is not a valid number
gnt-01:~# cat /proc/drbd
version: 8.3.7 (api:88/proto:86-91)
GIT-hash: ea9e28dbff98e331a62bcbcc63a6135808fe2917 build by
root@buildd, 2010-01-23 08:21:00
0: cs:Unconfigured
gnt-01:~#

Thanks

Joe

Joe Shang

unread,

Nov 15, 2010, 2:40:38 PM11/15/10

to ganeti

Tried the 2.3.x one for fun, same results:

gnt-01:/usr/local/lib/ganeti/tools# gnt-instance add -t drbd -n
gnt-01.xxxxxxx.com:gnt-02.xxxxxxx.com --disk 0:size=100G -B
memory=4096M,vcpus=2 -H kvm:cdrom_image_path=/os/CentOS-5.5-x86_64-
netinstall.iso,boot_order=cdrom,kernel_path=,initrd_path= -o
debootstrap+default --no-name-check --no-ip-check --no-wait-for-sync --
no-install chd-cms.xxxxxxx.com
Mon Nov 15 12:39:12 2010 - INFO: No-installation mode selected,
disabling startup
Mon Nov 15 12:39:13 2010 * creating instance disks...
Mon Nov 15 12:39:13 2010 - WARNING: Device creation failed,
reverting...
Failure: command execution error:
Can't create block device <DRBD8(hosts=gnt-01.xxxxxxx.com/0-
gnt-02.xxxxxxx.com/0, port=11003, configured as 10.10.80.50:11003
10.10.80.51:11003, backend=<LogicalVolume(/dev/xenvg/75cb233d-
eba4-4a18-b709-1110f5c3a743.disk0_data, not visible, size=102400m)>,
metadev=<LogicalVolume(/dev/xenvg/75cb233d-eba4-4a18-
b709-1110f5c3a743.disk0_meta, not visible, size=128m)>, visible as /
dev/disk/0, size=102400m)> on node gnt-01.xxxxxxx.com for instance chd-
cms.xxxxxxx.com: Can't assemble device after creation, unusual event:

drbd0: can't setup network: exited with exit code 20 -

10.10.80.50:11003 is not a valid number
gnt-01:/usr/local/lib/ganeti/tools# gnt-cluster version
Software version: 2.3.0~rc0
Internode protocol: 40
Configuration format: 2030000
OS api version: 20
Export interface: 0
gnt-01:/usr/local/lib/ganeti/tools# cat /proc/drbd

version: 8.3.7 (api:88/proto:86-91)
GIT-hash: ea9e28dbff98e331a62bcbcc63a6135808fe2917 build by
root@buildd, 2010-01-23 08:21:00
0: cs:Unconfigured

gnt-01:/usr/local/lib/ganeti/tools#

Seems it only works with 2.1.x

Joe

Iustin Pop

unread,

Nov 15, 2010, 3:05:14 PM11/15/10

to gan...@googlegroups.com

Then it must be something else, as (for example) we use only 2.2.x and
2.3.x..

How is ganeti configured? (the contents of _autoconf.py)

iustin

Joe Shang

unread,

Nov 15, 2010, 4:10:48 PM11/15/10

to ganeti

Here you go:

Well, I reloaded this box twice with Debian Lenny , same results :-/

Joe

# This file is automatically generated, do not edit!
#

"""Build-time configuration for Ganeti.

This file is autogenerated by the build process.
For any changes you need to re-run ./configure (and
not edit by hand).

"""

# pylint: disable-msg=C0301,C0324
# because this is autogenerated, we do not want
# style warnings

PACKAGE_VERSION = '2.3.0~rc0'
VERSION_MAJOR = '2'
VERSION_MINOR = '3'
VERSION_REVISION = '0'
VERSION_SUFFIX = '~rc0'
VERSION_FULL = '2.3.0~rc0'
LOCALSTATEDIR = '/var'
SYSCONFDIR = '/etc'
SSH_CONFIG_DIR = '/etc/ssh'
EXPORT_DIR = '/srv/ganeti/export'
OS_SEARCH_PATH = ['/srv/ganeti/os']
XEN_BOOTLOADER = ''
XEN_KERNEL = '/boot/vmlinuz-2.6-xenU'
XEN_INITRD = '/boot/initrd-2.6-xenU'
FILE_STORAGE_DIR = '/srv/ganeti/file-storage'
ENABLE_FILE_STORAGE = True
IALLOCATOR_SEARCH_PATH = ['/usr/local/lib/ganeti/iallocators']
KVM_PATH = '/usr/bin/kvm'
SOCAT_PATH = '/usr/bin/socat'
SOCAT_USE_ESCAPE = False
LVM_STRIPECOUNT = 1
TOOLSDIR = '/usr/local/lib/ganeti/tools'
GNT_SCRIPTS = ['gnt-backup', 'gnt-cluster', 'gnt-debug', 'gnt-
instance', 'gnt-job', 'gnt-node', 'gnt-os',]
PKGLIBDIR = '/usr/local/lib/ganeti'
DRBD_BARRIERS = True
SYSLOG_USAGE = 'no'
DAEMONS_GROUP = 'root'
ADMIN_GROUP = 'root'
MASTERD_USER = 'root'
MASTERD_GROUP = 'root'
RAPI_USER = 'root'
RAPI_GROUP = 'root'
CONFD_USER = 'root'
CONFD_GROUP = 'root'
NODED_USER = 'root'
VCS_VERSION = 'v2.3.0rc0'

Joe Shang

unread,

Nov 16, 2010, 11:35:41 AM11/16/10

to ganeti

Is there a debug mode we can enable to see what is the drbdsetup call?

I think I've hit a roadblock with this, I just can't see what else
could be the issue, I've setup many ganeti nodes before, never had an
issue like this, but seems it only happens with 2.2.x and above.

Joe

On Nov 15, 1:05 pm, Iustin Pop <iu...@k1024.org> wrote:

Iustin Pop

unread,

Nov 16, 2010, 11:38:09 AM11/16/10

to gan...@googlegroups.com

On Tue, Nov 16, 2010 at 08:35:41AM -0800, Joe Shang wrote:
> Is there a debug mode we can enable to see what is the drbdsetup call?
>
> I think I've hit a roadblock with this, I just can't see what else
> could be the issue, I've setup many ganeti nodes before, never had an
> issue like this, but seems it only happens with 2.2.x and above.

Ack. Sure, there is a debug mode: stop ganeti-noded, restart it with
"-d". This will log lots of things, among which the exact call for
external commands.

iustin

Joe Shang

unread,

Nov 16, 2010, 11:44:24 AM11/16/10

to ganeti

Thanks, that helped.

About to dig in further, but in the meantime, got me some good logs:

======================

2010-11-16 09:42:22,460: ganeti-noded pid=12154 utils:2211 DEBUG
Memory lock set
2010-11-16 09:42:22,461: ganeti-noded pid=12154 server:264 DEBUG
Connection from 10.10.80.46:45856
2010-11-16 09:42:22,538: ganeti-noded pid=12154 server:175 DEBUG HTTP
request: PUT /node_info HTTP/1.1
2010-11-16 09:42:22,539: ganeti-noded pid=12154 server:333 DEBUG
Handling request <ganeti.http.server._HttpServerRequest PUT /node_info
headers='User-Agent: Ganeti 2.3.0~rc0\r\nHost: 10.10.80.46:1811\r
\nAccept: */*\r\nContent-type: application/json\r\nContent-Length: 17\r
\n' body='["xenvg", "kvm"]\n' at 0x19a7e10>
2010-11-16 09:42:22,539: ganeti-noded pid=12154 utils:213 DEBUG RunCmd
vgs --noheadings --nosuffix --units=m --unbuffered '--separator=|' -
ovg_name,vg_free,vg_attr,vg_size
2010-11-16 09:42:22,562: ganeti-noded pid=12154 server:387 INFO
10.10.80.46:45856 PUT /node_info HTTP/1.1 200
2010-11-16 09:42:22,563: ganeti-noded pid=12154 server:305 DEBUG
Disconnected 10.10.80.46:45856
2010-11-16 09:42:22,644: ganeti-noded pid=12156 utils:2211 DEBUG
Memory lock set
2010-11-16 09:42:22,645: ganeti-noded pid=12156 server:264 DEBUG
Connection from 10.10.80.46:45858
2010-11-16 09:42:22,699: ganeti-noded pid=12156 server:175 DEBUG HTTP
request: PUT /hypervisor_validate_params HTTP/1.1
2010-11-16 09:42:22,700: ganeti-noded pid=12156 server:333 DEBUG
Handling request <ganeti.http.server._HttpServerRequest PUT /
hypervisor_validate_params headers='User-Agent: Ganeti 2.3.0~rc0\r
\nHost: 10.10.80.46:1811\r\nAccept: */*\r\nContent-type: application/
json\r\nContent-Length: 676\r\n' body='["kvm", {"acpi": true,
"boot_order": "cdrom", "cdrom_image_path": "/os/CentOS-5.5-x86_64-
netinstall.iso", "disk_cache": "default", "disk_type": "paravirtual",
"initrd_path": "", "kernel_args": "ro", "kernel_path": "", "kvm_flag":
"", "mem_path": "", "migration_bandwidth": 32, "migration_downtime":
30, "migration_mode": "live", "migration_port": 8102, "nic_type":
"paravirtual", "root_path": "/dev/vda1", "security_domain": "",
"security_model": "none", "serial_console": true, "usb_mouse": "",
"use_chroot": false, "use_localtime": false, "vhost_net": false,
"vnc_bind_address": "", "vnc_password_file": "", "vnc_tls": false,
"vnc_x509_path": "", "vnc_x509_verify": false}]\n' at 0x19a7d90>
2010-11-16 09:42:22,700: ganeti-noded pid=12156 server:387 INFO
10.10.80.46:45858 PUT /hypervisor_validate_params HTTP/1.1 200
2010-11-16 09:42:22,701: ganeti-noded pid=12156 server:305 DEBUG
Disconnected 10.10.80.46:45858
2010-11-16 09:42:22,766: ganeti-noded pid=12157 utils:2211 DEBUG
Memory lock set
2010-11-16 09:42:22,766: ganeti-noded pid=12157 server:264 DEBUG
Connection from 10.10.80.46:45860
2010-11-16 09:42:22,823: ganeti-noded pid=12157 server:175 DEBUG HTTP
request: PUT /os_get HTTP/1.1
2010-11-16 09:42:22,824: ganeti-noded pid=12157 server:333 DEBUG
Handling request <ganeti.http.server._HttpServerRequest PUT /os_get
headers='User-Agent: Ganeti 2.3.0~rc0\r\nHost: 10.10.80.46:1811\r
\nAccept: */*\r\nContent-type: application/json\r\nContent-Length: 24\r
\n' body='["debootstrap+default"]\n' at 0x19a7e10>
2010-11-16 09:42:22,824: ganeti-noded pid=12157 server:387 INFO
10.10.80.46:45860 PUT /os_get HTTP/1.1 200
2010-11-16 09:42:22,824: ganeti-noded pid=12157 server:305 DEBUG
Disconnected 10.10.80.46:45860
2010-11-16 09:42:22,837: ganeti-noded pid=12158 utils:2211 DEBUG
Memory lock set
2010-11-16 09:42:22,837: ganeti-noded pid=12158 server:264 DEBUG
Connection from 10.10.80.46:45861
2010-11-16 09:42:22,895: ganeti-noded pid=12158 server:175 DEBUG HTTP
request: PUT /os_validate HTTP/1.1
2010-11-16 09:42:22,896: ganeti-noded pid=12158 server:333 DEBUG
Handling request <ganeti.http.server._HttpServerRequest PUT /
os_validate headers='User-Agent: Ganeti 2.3.0~rc0\r\nHost:
10.10.80.46:1811\r\nAccept: */*\r\nContent-type: application/json\r
\nContent-Length: 50\r\n' body='[true, "debootstrap+default",
["parameters"], {}]\n' at 0x19a7d90>
2010-11-16 09:42:22,896: ganeti-noded pid=12158 server:387 INFO
10.10.80.46:45861 PUT /os_validate HTTP/1.1 200
2010-11-16 09:42:22,896: ganeti-noded pid=12158 server:305 DEBUG
Disconnected 10.10.80.46:45861
2010-11-16 09:42:22,961: ganeti-noded pid=12159 utils:2211 DEBUG
Memory lock set
2010-11-16 09:42:22,961: ganeti-noded pid=12159 server:264 DEBUG
Connection from 10.10.80.46:45863
2010-11-16 09:42:23,017: ganeti-noded pid=12159 server:175 DEBUG HTTP
request: PUT /bridges_exist HTTP/1.1
2010-11-16 09:42:23,017: ganeti-noded pid=12159 server:333 DEBUG
Handling request <ganeti.http.server._HttpServerRequest PUT /
bridges_exist headers='User-Agent: Ganeti 2.3.0~rc0\r\nHost:
10.10.80.46:1811\r\nAccept: */*\r\nContent-type: application/json\r
\nContent-Length: 14\r\n' body='[["xen-br0"]]\n' at 0x19a7d90>
2010-11-16 09:42:23,017: ganeti-noded pid=12159 server:387 INFO
10.10.80.46:45863 PUT /bridges_exist HTTP/1.1 200
2010-11-16 09:42:23,018: ganeti-noded pid=12159 server:305 DEBUG
Disconnected 10.10.80.46:45863
2010-11-16 09:42:23,030: ganeti-noded pid=12160 utils:2211 DEBUG
Memory lock set
2010-11-16 09:42:23,030: ganeti-noded pid=12160 server:264 DEBUG
Connection from 10.10.80.46:45864
2010-11-16 09:42:23,087: ganeti-noded pid=12160 server:175 DEBUG HTTP
request: PUT /hooks_runner HTTP/1.1
2010-11-16 09:42:23,088: ganeti-noded pid=12160 server:333 DEBUG
Handling request <ganeti.http.server._HttpServerRequest PUT /
hooks_runner headers='User-Agent: Ganeti 2.3.0~rc0\r\nHost:
10.10.80.46:1811\r\nAccept: */*\r\nContent-type: application/json\r
\nContent-Length: 2477\r\n' body='["instance-add", "pre",
{"GANETI_ADD_MODE": "create", "GANETI_CLUSTER": "gnt-
cluster.owtest.com", "GANETI_DATA_DIR": "/var/lib/ganeti",
"GANETI_HOOKS_PATH": "instance-add", "GANETI_HOOKS_PHASE": "pre",
"GANETI_HOOKS_VERSION": "2", "GANETI_INSTANCE_BE_auto_balance":
"True", "GANETI_INSTANCE_BE_memory": "4096",
"GANETI_INSTANCE_BE_vcpus": "2", "GANETI_INSTANCE_DISK0_MODE": "rw",
"GANETI_INSTANCE_DISK0_SIZE": "102400", "GANETI_INSTANCE_DISK_COUNT":
"1", "GANETI_INSTANCE_DISK_TEMPLATE": "drbd",
"GANETI_INSTANCE_HV_acpi": "True", "GANETI_INSTANCE_HV_boot_order":
"cdrom", "GANETI_INSTANCE_HV_cdrom_image_path": "/os/CentOS-5.5-x86_64-
netinstall.iso", "GANETI_INSTANCE_HV_disk_cache": "default",
"GANETI_INSTANCE_HV_disk_type": "paravirtual",
"GANETI_INSTANCE_HV_initrd_path": "",
"GANETI_INSTANCE_HV_kernel_args": "ro",
"GANETI_INSTANCE_HV_kernel_path": "", "GANETI_INSTANCE_HV_kvm_flag":
"", "GANETI_INSTANCE_HV_mem_path": "",
"GANETI_INSTANCE_HV_migration_bandwidth": "32",
"GANETI_INSTANCE_HV_migration_downtime": "30",
"GANETI_INSTANCE_HV_migration_mode": "live",
"GANETI_INSTANCE_HV_migration_port": "8102",
"GANETI_INSTANCE_HV_nic_type": "paravirtual",
"GANETI_INSTANCE_HV_root_path": "/dev/vda1",
"GANETI_INSTANCE_HV_security_domain": "",
"GANETI_INSTANCE_HV_security_model": "none",
"GANETI_INSTANCE_HV_serial_console": "True",
"GANETI_INSTANCE_HV_usb_mouse": "", "GANETI_INSTANCE_HV_use_chroot":
"False", "GANETI_INSTANCE_HV_use_localtime": "False",
"GANETI_INSTANCE_HV_vhost_net": "False",
"GANETI_INSTANCE_HV_vnc_bind_address": "",
"GANETI_INSTANCE_HV_vnc_password_file": "",
"GANETI_INSTANCE_HV_vnc_tls": "False",
"GANETI_INSTANCE_HV_vnc_x509_path": "",
"GANETI_INSTANCE_HV_vnc_x509_verify": "False",
"GANETI_INSTANCE_HYPERVISOR": "kvm", "GANETI_INSTANCE_MEMORY": "4096",
"GANETI_INSTANCE_NAME": "chd-cms.owtest.com",
"GANETI_INSTANCE_NIC0_BRIDGE": "xen-br0", "GANETI_INSTANCE_NIC0_IP":
"", "GANETI_INSTANCE_NIC0_LINK": "xen-br0",
"GANETI_INSTANCE_NIC0_MAC": "aa:00:00:7a:eb:a0",
"GANETI_INSTANCE_NIC0_MODE": "bridged", "GANETI_INSTANCE_NIC_COUNT":
"1", "GANETI_INSTANCE_OS_TYPE": "debootstrap+default",
"GANETI_INSTANCE_PRIMARY": "gnt-01.owtest.com",
"GANETI_INSTANCE_SECONDARIES": "gnt-02.owtest.com",
"GANETI_INSTANCE_STATUS": "down", "GANETI_INSTANCE_VCPUS": "2",
"GANETI_MASTER": "gnt-01.owtest.com", "GANETI_OBJECT_TYPE":
"INSTANCE", "GANETI_OP_CODE": "OP_INSTANCE_CREATE",
"GANETI_OP_TARGET": "chd-cms.owtest.com", "PATH": "/sbin:/bin:/usr/
sbin:/usr/bin"}]\n' at 0x19a7d90>
2010-11-16 09:42:23,089: ganeti-noded pid=12160 server:387 INFO
10.10.80.46:45864 PUT /hooks_runner HTTP/1.1 200
2010-11-16 09:42:23,089: ganeti-noded pid=12160 server:305 DEBUG
Disconnected 10.10.80.46:45864
2010-11-16 09:42:23,286: ganeti-noded pid=12161 utils:2211 DEBUG
Memory lock set
2010-11-16 09:42:23,286: ganeti-noded pid=12161 server:264 DEBUG
Connection from 10.10.80.46:45868
2010-11-16 09:42:23,344: ganeti-noded pid=12161 server:175 DEBUG HTTP
request: PUT /blockdev_create HTTP/1.1
2010-11-16 09:42:23,344: ganeti-noded pid=12161 server:333 DEBUG
Handling request <ganeti.http.server._HttpServerRequest PUT /
blockdev_create headers='User-Agent: Ganeti 2.3.0~rc0\r\nHost:
10.10.80.46:1811\r\nAccept: */*\r\nContent-type: application/json\r
\nContent-Length: 262\r\n' body='[{"dev_type": "lvm", "logical_id":
["xenvg", "fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data"],
"physical_id": ["xenvg",
"fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data"], "size": 102400},
102400, "chd-cms.owtest.com", true, "originstname+chd-cms.owtest.com"]
\n' at 0x19a7d90>
2010-11-16 09:42:23,344: ganeti-noded pid=12161 utils:213 DEBUG RunCmd
pvs --noheadings --nosuffix --units=m --unbuffered '--separator=|' -
opv_name,vg_name,pv_free,pv_attr
2010-11-16 09:42:23,364: ganeti-noded pid=12161 utils:213 DEBUG RunCmd
lvcreate -L102400m -nfbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data -
i1 xenvg /dev/sda4
2010-11-16 09:42:23,387: ganeti-noded pid=12161 utils:213 DEBUG RunCmd
lvs --noheadings --separator=, --units=m --nosuffix -
olv_attr,lv_kernel_major,lv_kernel_minor,vg_extent_size,stripes /dev/
xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data
2010-11-16 09:42:23,404: ganeti-noded pid=12161 utils:213 DEBUG RunCmd
lvchange -ay /dev/xenvg/
fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data
2010-11-16 09:42:23,426: ganeti-noded pid=12161 utils:213 DEBUG RunCmd
lvchange --addtag originstname+chd-cms.owtest.com /dev/xenvg/
fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data
2010-11-16 09:42:23,447: ganeti-noded pid=12161 server:387 INFO
10.10.80.46:45868 PUT /blockdev_create HTTP/1.1 200
2010-11-16 09:42:23,448: ganeti-noded pid=12161 server:305 DEBUG
Disconnected 10.10.80.46:45868
2010-11-16 09:42:23,460: ganeti-noded pid=12185 utils:2211 DEBUG
Memory lock set
2010-11-16 09:42:23,461: ganeti-noded pid=12185 server:264 DEBUG
Connection from 10.10.80.46:45869
2010-11-16 09:42:23,519: ganeti-noded pid=12185 server:175 DEBUG HTTP
request: PUT /blockdev_create HTTP/1.1
2010-11-16 09:42:23,520: ganeti-noded pid=12185 server:333 DEBUG
Handling request <ganeti.http.server._HttpServerRequest PUT /
blockdev_create headers='User-Agent: Ganeti 2.3.0~rc0\r\nHost:
10.10.80.46:1811\r\nAccept: */*\r\nContent-type: application/json\r
\nContent-Length: 256\r\n' body='[{"dev_type": "lvm", "logical_id":
["xenvg", "fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta"],
"physical_id": ["xenvg",
"fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta"], "size": 128}, 128,
"chd-cms.owtest.com", true, "originstname+chd-cms.owtest.com"]\n' at
0x19a7d90>
2010-11-16 09:42:23,520: ganeti-noded pid=12185 utils:213 DEBUG RunCmd
pvs --noheadings --nosuffix --units=m --unbuffered '--separator=|' -
opv_name,vg_name,pv_free,pv_attr
2010-11-16 09:42:23,540: ganeti-noded pid=12185 utils:213 DEBUG RunCmd
lvcreate -L128m -nfbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta -i1
xenvg /dev/sda4
2010-11-16 09:42:23,565: ganeti-noded pid=12185 utils:213 DEBUG RunCmd
lvs --noheadings --separator=, --units=m --nosuffix -
olv_attr,lv_kernel_major,lv_kernel_minor,vg_extent_size,stripes /dev/
xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta
2010-11-16 09:42:23,584: ganeti-noded pid=12185 utils:213 DEBUG RunCmd
lvchange -ay /dev/xenvg/
fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta
2010-11-16 09:42:23,595: ganeti-noded pid=12185 utils:213 DEBUG RunCmd
lvchange --addtag originstname+chd-cms.owtest.com /dev/xenvg/
fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta
2010-11-16 09:42:23,616: ganeti-noded pid=12185 server:387 INFO
10.10.80.46:45869 PUT /blockdev_create HTTP/1.1 200
2010-11-16 09:42:23,617: ganeti-noded pid=12185 server:305 DEBUG
Disconnected 10.10.80.46:45869
2010-11-16 09:42:23,632: ganeti-noded pid=12209 utils:2211 DEBUG
Memory lock set
2010-11-16 09:42:23,632: ganeti-noded pid=12209 server:264 DEBUG
Connection from 10.10.80.46:45870
2010-11-16 09:42:23,688: ganeti-noded pid=12209 server:175 DEBUG HTTP
request: PUT /blockdev_create HTTP/1.1
2010-11-16 09:42:23,688: ganeti-noded pid=12209 server:333 DEBUG
Handling request <ganeti.http.server._HttpServerRequest PUT /
blockdev_create headers='User-Agent: Ganeti 2.3.0~rc0\r\nHost:
10.10.80.46:1811\r\nAccept: */*\r\nContent-type: application/json\r
\nContent-Length: 760\r\n' body='[{"children": [{"dev_type": "lvm",
"logical_id": ["xenvg",
"fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data"], "physical_id":
["xenvg", "fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data"], "size":
102400}, {"dev_type": "lvm", "logical_id": ["xenvg",
"fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta"], "physical_id":
["xenvg", "fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta"], "size":
128}], "dev_type": "drbd8", "iv_name": "disk/0", "logical_id":
["gnt-01.owtest.com", "gnt-02.owtest.com", 11019, 0, 0,
"2e74091bdccd2afb15615ff3aec311aebdd1e3c5"], "mode": "rw",
"physical_id": ["10.10.80.50", 11019, "10.10.80.51", 11019, 0,
"2e74091bdccd2afb15615ff3aec311aebdd1e3c5"], "size": 102400}, 102400,
"chd-cms.owtest.com", true, "originstname+chd-cms.owtest.com"]\n' at
0x19a7d90>
2010-11-16 09:42:23,689: ganeti-noded pid=12209 utils:213 DEBUG RunCmd
lvs --noheadings --separator=, --units=m --nosuffix -
olv_attr,lv_kernel_major,lv_kernel_minor,vg_extent_size,stripes /dev/
xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data
2010-11-16 09:42:23,708: ganeti-noded pid=12209 utils:213 DEBUG RunCmd
lvchange -ay /dev/xenvg/
fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data
2010-11-16 09:42:23,720: ganeti-noded pid=12209 utils:213 DEBUG RunCmd
lvs --noheadings --separator=, --units=m --nosuffix -
olv_attr,lv_kernel_major,lv_kernel_minor,vg_extent_size,stripes /dev/
xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta
2010-11-16 09:42:23,736: ganeti-noded pid=12209 utils:213 DEBUG RunCmd
lvchange -ay /dev/xenvg/
fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta
2010-11-16 09:42:23,747: ganeti-noded pid=12209 utils:213 DEBUG RunCmd
lvchange -ay /dev/xenvg/
fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta
2010-11-16 09:42:23,763: ganeti-noded pid=12209 utils:213 DEBUG RunCmd
lvs --noheadings --separator=, --units=m --nosuffix -
olv_attr,lv_kernel_major,lv_kernel_minor,vg_extent_size,stripes /dev/
xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta
2010-11-16 09:42:23,773: ganeti-noded pid=12209 utils:213 DEBUG RunCmd
blockdev --getsize /dev/xenvg/
fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta
2010-11-16 09:42:23,777: ganeti-noded pid=12209 utils:213 DEBUG RunCmd
drbdmeta --force /dev/drbd0 v08 /dev/xenvg/
fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta 0 create-md
2010-11-16 09:42:23,783: ganeti-noded pid=12209 utils:213 DEBUG RunCmd
drbdsetup /dev/drbd0 disk /dev/xenvg/
fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data /dev/xenvg/
fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta 0 -e detach --create-
device -d 102400m
2010-11-16 09:42:23,803: ganeti-noded pid=12209 utils:213 DEBUG RunCmd
drbdsetup /dev/drbd0 syncer -r 61440 --create-device
2010-11-16 09:42:23,809: ganeti-noded pid=12209 utils:213 DEBUG RunCmd
drbdsetup /dev/drbd0 net ipv4:10.10.80.50:11019 ipv4:10.10.80.51:11019
C -A discard-zero-changes -B consensus --create-device -a md5 -x
2e74091bdccd2afb15615ff3aec311aebdd1e3c5
2010-11-16 09:42:23,813: ganeti-noded pid=12209 utils:140 DEBUG
Command 'drbdsetup /dev/drbd0 net ipv4:10.10.80.50:11019
ipv4:10.10.80.51:11019 C -A discard-zero-changes -B consensus --create-
device -a md5 -x 2e74091bdccd2afb15615ff3aec311aebdd1e3c5' failed
(exited with exit code 20); output: 10.10.80.50:11019 is not a valid
number

2010-11-16 09:42:23,814: ganeti-noded pid=12209 bdev:71 ERROR drbd0:
can't setup network: exited with exit code 20 - 10.10.80.50:11019 is
not a valid number

2010-11-16 09:42:23,814: ganeti-noded pid=12209 backend:107 ERROR

Can't assemble device after creation, unusual event: drbd0: can't

setup network: exited with exit code 20 - 10.10.80.50:11019 is not a
valid number

2010-11-16 09:42:23,814: ganeti-noded pid=12209 server:387 INFO
10.10.80.46:45870 PUT /blockdev_create HTTP/1.1 200
2010-11-16 09:42:23,814: ganeti-noded pid=12209 server:305 DEBUG
Disconnected 10.10.80.46:45870
2010-11-16 09:42:23,851: ganeti-noded pid=12230 utils:2211 DEBUG
Memory lock set
2010-11-16 09:42:23,851: ganeti-noded pid=12230 server:264 DEBUG
Connection from 10.10.80.46:45871
2010-11-16 09:42:23,908: ganeti-noded pid=12230 server:175 DEBUG HTTP
request: PUT /blockdev_remove HTTP/1.1
2010-11-16 09:42:23,908: ganeti-noded pid=12230 server:333 DEBUG
Handling request <ganeti.http.server._HttpServerRequest PUT /
blockdev_remove headers='User-Agent: Ganeti 2.3.0~rc0\r\nHost:
10.10.80.46:1811\r\nAccept: */*\r\nContent-type: application/json\r
\nContent-Length: 689\r\n' body='[{"children": [{"dev_type": "lvm",
"logical_id": ["xenvg",
"fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data"], "physical_id":
["xenvg", "fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data"], "size":
102400}, {"dev_type": "lvm", "logical_id": ["xenvg",
"fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta"], "physical_id":
["xenvg", "fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta"], "size":
128}], "dev_type": "drbd8", "iv_name": "disk/0", "logical_id":
["gnt-01.owtest.com", "gnt-02.owtest.com", 11019, 0, 0,
"2e74091bdccd2afb15615ff3aec311aebdd1e3c5"], "mode": "rw",
"physical_id": ["10.10.80.50", 11019, "10.10.80.51", 11019, 0,
"2e74091bdccd2afb15615ff3aec311aebdd1e3c5"], "size": 102400}]\n' at
0x19a7d90>
2010-11-16 09:42:23,909: ganeti-noded pid=12230 utils:213 DEBUG RunCmd
lvs --noheadings --separator=, --units=m --nosuffix -
olv_attr,lv_kernel_major,lv_kernel_minor,vg_extent_size,stripes /dev/
xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data
2010-11-16 09:42:23,984: ganeti-noded pid=12230 utils:213 DEBUG RunCmd
lvs --noheadings --separator=, --units=m --nosuffix -
olv_attr,lv_kernel_major,lv_kernel_minor,vg_extent_size,stripes /dev/
xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta
2010-11-16 09:42:23,995: ganeti-noded pid=12230 utils:213 DEBUG RunCmd
drbdsetup /dev/drbd0 down
2010-11-16 09:42:24,000: ganeti-noded pid=12230 utils:213 DEBUG RunCmd
lvs --noheadings --separator=, --units=m --nosuffix -
olv_attr,lv_kernel_major,lv_kernel_minor,vg_extent_size,stripes /dev/
xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data
2010-11-16 09:42:24,009: ganeti-noded pid=12230 utils:213 DEBUG RunCmd
lvs --noheadings --separator=, --units=m --nosuffix -
olv_attr,lv_kernel_major,lv_kernel_minor,vg_extent_size,stripes /dev/
xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data
2010-11-16 09:42:24,018: ganeti-noded pid=12230 utils:213 DEBUG RunCmd
lvremove -f xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data
2010-11-16 09:42:24,043: ganeti-noded pid=12230 utils:213 DEBUG RunCmd
lvs --noheadings --separator=, --units=m --nosuffix -
olv_attr,lv_kernel_major,lv_kernel_minor,vg_extent_size,stripes /dev/
xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta
2010-11-16 09:42:24,060: ganeti-noded pid=12230 utils:213 DEBUG RunCmd
lvremove -f xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_meta
2010-11-16 09:42:24,088: ganeti-noded pid=12230 server:387 INFO
10.10.80.46:45871 PUT /blockdev_remove HTTP/1.1 200
2010-11-16 09:42:24,089: ganeti-noded pid=12230 server:305 DEBUG
Disconnected 10.10.80.46:45871
2010-11-16 09:42:24,205: ganeti-noded pid=12243 utils:2211 DEBUG
Memory lock set
2010-11-16 09:42:24,205: ganeti-noded pid=12243 server:264 DEBUG
Connection from 10.10.80.46:45873
2010-11-16 09:42:24,259: ganeti-noded pid=12243 server:175 DEBUG HTTP
request: PUT /hooks_runner HTTP/1.1
2010-11-16 09:42:24,260: ganeti-noded pid=12243 server:333 DEBUG
Handling request <ganeti.http.server._HttpServerRequest PUT /
hooks_runner headers='User-Agent: Ganeti 2.3.0~rc0\r\nHost:
10.10.80.46:1811\r\nAccept: */*\r\nContent-type: application/json\r
\nContent-Length: 2481\r\n' body='["config-update", "post",
{"GANETI_ADD_MODE": "create", "GANETI_CLUSTER": "gnt-
cluster.owtest.com", "GANETI_DATA_DIR": "/var/lib/ganeti",
"GANETI_HOOKS_PATH": "config-update", "GANETI_HOOKS_PHASE": "post",
"GANETI_HOOKS_VERSION": "2", "GANETI_INSTANCE_BE_auto_balance":
"True", "GANETI_INSTANCE_BE_memory": "4096",
"GANETI_INSTANCE_BE_vcpus": "2", "GANETI_INSTANCE_DISK0_MODE": "rw",
"GANETI_INSTANCE_DISK0_SIZE": "102400", "GANETI_INSTANCE_DISK_COUNT":
"1", "GANETI_INSTANCE_DISK_TEMPLATE": "drbd",
"GANETI_INSTANCE_HV_acpi": "True", "GANETI_INSTANCE_HV_boot_order":
"cdrom", "GANETI_INSTANCE_HV_cdrom_image_path": "/os/CentOS-5.5-x86_64-
netinstall.iso", "GANETI_INSTANCE_HV_disk_cache": "default",
"GANETI_INSTANCE_HV_disk_type": "paravirtual",
"GANETI_INSTANCE_HV_initrd_path": "",
"GANETI_INSTANCE_HV_kernel_args": "ro",
"GANETI_INSTANCE_HV_kernel_path": "", "GANETI_INSTANCE_HV_kvm_flag":
"", "GANETI_INSTANCE_HV_mem_path": "",
"GANETI_INSTANCE_HV_migration_bandwidth": "32",
"GANETI_INSTANCE_HV_migration_downtime": "30",
"GANETI_INSTANCE_HV_migration_mode": "live",
"GANETI_INSTANCE_HV_migration_port": "8102",
"GANETI_INSTANCE_HV_nic_type": "paravirtual",
"GANETI_INSTANCE_HV_root_path": "/dev/vda1",
"GANETI_INSTANCE_HV_security_domain": "",
"GANETI_INSTANCE_HV_security_model": "none",
"GANETI_INSTANCE_HV_serial_console": "True",
"GANETI_INSTANCE_HV_usb_mouse": "", "GANETI_INSTANCE_HV_use_chroot":
"False", "GANETI_INSTANCE_HV_use_localtime": "False",
"GANETI_INSTANCE_HV_vhost_net": "False",
"GANETI_INSTANCE_HV_vnc_bind_address": "",
"GANETI_INSTANCE_HV_vnc_password_file": "",
"GANETI_INSTANCE_HV_vnc_tls": "False",
"GANETI_INSTANCE_HV_vnc_x509_path": "",
"GANETI_INSTANCE_HV_vnc_x509_verify": "False",
"GANETI_INSTANCE_HYPERVISOR": "kvm", "GANETI_INSTANCE_MEMORY": "4096",
"GANETI_INSTANCE_NAME": "chd-cms.owtest.com",
"GANETI_INSTANCE_NIC0_BRIDGE": "xen-br0", "GANETI_INSTANCE_NIC0_IP":
"", "GANETI_INSTANCE_NIC0_LINK": "xen-br0",
"GANETI_INSTANCE_NIC0_MAC": "aa:00:00:7a:eb:a0",
"GANETI_INSTANCE_NIC0_MODE": "bridged", "GANETI_INSTANCE_NIC_COUNT":
"1", "GANETI_INSTANCE_OS_TYPE": "debootstrap+default",
"GANETI_INSTANCE_PRIMARY": "gnt-01.owtest.com",
"GANETI_INSTANCE_SECONDARIES": "gnt-02.owtest.com",
"GANETI_INSTANCE_STATUS": "down", "GANETI_INSTANCE_VCPUS": "2",
"GANETI_MASTER": "gnt-01.owtest.com", "GANETI_OBJECT_TYPE":
"INSTANCE", "GANETI_OP_CODE": "OP_INSTANCE_CREATE",
"GANETI_OP_TARGET": "chd-cms.owtest.com", "PATH": "/sbin:/bin:/usr/
sbin:/usr/bin"}]\n' at 0x19a7d90>
2010-11-16 09:42:24,261: ganeti-noded pid=12243 server:387 INFO
10.10.80.46:45873 PUT /hooks_runner HTTP/1.1 200
2010-11-16 09:42:24,261: ganeti-noded pid=12243 server:305 DEBUG
Disconnected 10.10.80.46:45873

===============

Joe Shang

unread,

Nov 16, 2010, 11:48:28 AM11/16/10

to ganeti

I noticed that with ipv4: in drbdsetup, it fails, but if I manually
run without it, it works:

gnt-01:/etc/init.d# drbdsetup /dev/drbd0 net ipv4:10.10.80.50:11019

ipv4:10.10.80.51:11019 C -A discard-zero-changes -B consensus --create-
device -a md5 -x 2e74091bdccd2afb15615ff3aec311aebdd1e3c5

10.10.80.50:11019 is not a valid number

gnt-01:/etc/init.d# drbdsetup /dev/drbd0 net 10.10.80.50:11019

10.10.80.51:11019 C -A discard-zero-changes -B consensus --create-
device -a md5 -x 2e74091bdccd2afb15615ff3aec311aebdd1e3c5

gnt-01:/etc/init.d#

Is this the same behavior you guys are seeing? What is different I
wonder?

gnt-01:/etc/init.d# cat /proc/drbd

version: 8.3.7 (api:88/proto:86-91)
GIT-hash: ea9e28dbff98e331a62bcbcc63a6135808fe2917 build by
root@buildd, 2010-01-23 08:21:00

0: cs:WFConnection ro:Secondary/Unknown ds:Diskless/DUnknown C r----
ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
gnt-01:/etc/init.d#

Joe

> xenvg/fbbb7e2c-40e6-46d8-9948-9c8f71ace7f9.disk0_data ...
>
> read more »

Iustin Pop

unread,

Nov 16, 2010, 12:03:06 PM11/16/10

to gan...@googlegroups.com

On Tue, Nov 16, 2010 at 08:48:28AM -0800, Joe Shang wrote:
> I noticed that with ipv4: in drbdsetup, it fails, but if I manually
> run without it, it works:
>
> gnt-01:/etc/init.d# drbdsetup /dev/drbd0 net ipv4:10.10.80.50:11019
> ipv4:10.10.80.51:11019 C -A discard-zero-changes -B consensus --create-
> device -a md5 -x 2e74091bdccd2afb15615ff3aec311aebdd1e3c5
> 10.10.80.50:11019 is not a valid number
> gnt-01:/etc/init.d# drbdsetup /dev/drbd0 net 10.10.80.50:11019
> 10.10.80.51:11019 C -A discard-zero-changes -B consensus --create-
> device -a md5 -x 2e74091bdccd2afb15615ff3aec311aebdd1e3c5
> gnt-01:/etc/init.d#
>
> Is this the same behavior you guys are seeing? What is different I
> wonder?
>
>
> gnt-01:/etc/init.d# cat /proc/drbd
> version: 8.3.7 (api:88/proto:86-91)
> GIT-hash: ea9e28dbff98e331a62bcbcc63a6135808fe2917 build by
> root@buildd, 2010-01-23 08:21:00
> 0: cs:WFConnection ro:Secondary/Unknown ds:Diskless/DUnknown C r----
> ns:0 nr:0 dw:0 dr:0 al:0 bm:0 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:0
> gnt-01:/etc/init.d#

Hrmm. Are you sure you're using drbdsetup from the 8.3 distribution? In
the sense that you upgrade both the kernel module and the userland
tools.

For me, the above call works.

drbdsetup doesn't have a --version call, but what about:

strings `which drbdsetup`|grep GIT

and "drbsetup help net"? Does it mention "net [af:]local_addr[:port]"
(with af in there)?

thanks,
iustin

Joe Shang

unread,

Nov 16, 2010, 12:39:15 PM11/16/10

to ganeti

I am such a fool, that was it.

Thanks iustin , I got everything going now :)

Now we just need a pre-bundled external nagios event notificator for
auto-failover :)

Thanks

Joe

Reply all

Reply to author

Forward