Advice on upgrading vs fresh start?

61 views
Skip to first unread message

Brenton Walker

unread,
May 20, 2022, 9:36:12 AM5/20/22
to emulab-admins
Dear emulab-admins,
     We have a somewhat old Emulab installation (emulab-devel d28d8354d8e7031b4616cd482f059156e39c6087 Tue Nov 15 14:40:02 2016) with boss and ops running FreeBSD 10.2.  We have made some minor patches over the years, but it is generally not upgraded.

We are kind-of between generations of emulab users (people have been graduating) and it is a good time to either upgrade or do a fresh install.

Do we have any realistic chance of smoothly upgrading FreeBSD and the Emulab software to the current versions?  The main thing we regret loosing with a fresh install is all the custom images people have created.

With a new install, are we better off using the stable version (2 years old) or devel?

Is there anything major we should watch out for in the install instructions?  For example we noticed the git repo mentions FBSD 12.3, but the instructions still say 10.0.

Thanks for any advice!
Brenton



Mike Hibler

unread,
May 20, 2022, 10:03:24 AM5/20/22
to emulab...@googlegroups.com
That would be a very difficult upgrade. There are README* files in the
Emulab source install directory that cover all the way from 10.2 to 12.3,
but that process would take you through a couple of intermediate steps of
upgrading to obsolete versions of the OS and that path just doesn't work.

A fresh install is probably the only realistic option. Were you going to
do this on fresh server hardware? Or on the same machines? Having the old
system still around might enable importing some state from the old system
later.

We already have some mechanisms for "importing" an image from an image file
and an XML description, so you could probably craft the XML files and get
the images back into the system in new projects.

I don't think we any programatic support for adding users or projects.
I will have to defer to Leigh on this.

For a new install you would use emulab-devel and FreBSD 12.3. Which
instructions still say FreeBSD 10?
> --
> You received this message because you are subscribed to the Google Groups
> "emulab-admins" group.
> To unsubscribe from this group and stop receiving emails from it, send an email
> to emulab-admin...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/
> emulab-admins/e7d08ab0-7508-4dd7-9121-3abc3ac2879dn%40googlegroups.com.

Brenton Walker

unread,
May 23, 2022, 9:10:53 AM5/23/22
to emulab-admins
Thanks for the quick reply.

We need to use the same servers for boss and ops.  Of course we will back up the filesystems.  We are also planning to do a test-run of the installation on some spare machines while the current servers are still up, just to make sure.

Most of our users have moved on, and recreating projects and experiments is no problem.  It's mainly the images that are hard to replicate.  We will try to work out an import process during our test-run installation.

If you follow the link from the emulab-devel README (https://users.emulab.net/trac/emulab/wiki/InstallRoot) you get to https://wiki.emulab.net/Emulab/wiki/install/required_software.html, which points to FBSD 10.0.  

The "newinstall" documentation points to 10.3 (https://wiki.emulab.net/wiki/newinstall/required_software.html).  

The README-upgrade documents in the install/ directory make it clear that 12.3 is the version to be using, though.  Aside from the FBSD version and the latest ports tarball, the installation process is about the same as before?

Thanks,
Brenton

Leigh Stoller

unread,
May 23, 2022, 9:16:53 AM5/23/22
to emulab...@googlegroups.com


> On May 23, 2022, at 6:10 AM, Brenton Walker <brenton....@gmail.com> wrote:
>
> The "newinstall" documentation points to 10.3 (https://wiki.emulab.net/wiki/newinstall/required_software.html).

Just a heads up that the new current docs including the install
instructions are at: https://gitlab.flux.utah.edu/emulab/emulab-devel/-/wikis/home

Leigh

Chuck Cranor

unread,
May 23, 2022, 1:55:44 PM5/23/22
to emulab...@googlegroups.com
hi-

On Mon, May 23, 2022 at 06:10:53AM -0700, Brenton Walker wrote:
> We already have some mechanisms for "importing" an image from an image
> file
> and an XML description, so you could probably craft the XML files and
> get
> the images back into the system in new projects.


we did this on our last upgrade of our "narwhal" emulab cluster.
we didn't do it automatically for all images (since the files are
big and it is a good excuse to clean up).

I am attaching my notes on the procedure as 20200316.txt ... we
have "boss" on a VM, so for our setup we kept the old boss VM up
and switched to a new "boss" VM.

the high level idea is that you:

[1] get the XML descriptor for the image you want to copy from the old boss
using the "dumpdescriptor" command. if you don't have the old boss
handy to run "dumpdescriptor" on, you can generate a new xml file
by hand or with a script (the format is pretty easy to figure out).

[2] copy the XML and ndz image file to the new boss in the correct place
on the new emulab install

[3] run "load-descriptors" on the new boss to load the new image into
the emulab database

[4] run "imagerelease" on the new boss to relase the image for use

[5] update the emulab so that the "creator" of the new image is who
every requested it.

i wrote a perl script "ios-ownership" to do this (didn't see a
way to do it with the current tools). i'll attach that too.


full details (with example output) in the attached 20200316.txt.
will also attach ios-ownership script.


chuck

20200316.txt
ios-ownership

Chuck Cranor

unread,
May 23, 2022, 4:27:59 PM5/23/22
to emulab...@googlegroups.com
On Mon, May 23, 2022 at 06:10:53AM -0700, Brenton Walker wrote:
> I don't think we any programatic support for adding users or projects.
> I will have to defer to Leigh on this.

FWIW, we have successfully migrated users (preserving unix_uid values),
projects, ssh-keys from an old emulab to a new one. the unix_uid
preservation is imporant for us, since we share netapp NFS filers
between emulab and non-emulab systems and want the unix_uids to
match across platforms.

my general strategy for this is to dump the data from the old boss into
a text file, manually edit the file to taste, and then run a perl script
on the new boss that will load the data into emulab.

I migrate data in this order:

[1] users
[2] ssh-keys
[3] project metadata
[4] project group membership
[5] subgroups
[6] subgroup membership

i can share my notes and relevant perl scripts with anyone who wants
the details...

chuck

Mike Hibler

unread,
May 23, 2022, 11:57:12 PM5/23/22
to emulab...@googlegroups.com
I have updated the wiki that Leigh references below. Hopefully, it uniformly
talks about FreeBSD 12.3 now with all the appropriate links.
> --
> You received this message because you are subscribed to the Google Groups "emulab-admins" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to emulab-admin...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/emulab-admins/B51C4F13-9E73-4810-AE97-6CE2942D36A3%40gmail.com.

Brenton Walker

unread,
May 24, 2022, 12:12:19 PM5/24/22
to emulab-admins
Thanks for all the feedback!

We are going through the trial run.  One discrepancy we ran across was the instructions for Installing Emulab on ops ( https://gitlab.flux.utah.edu/emulab/emulab-devel/-/wikis/install/Installing%20Emulab%20on%20ops) reference the package emulab-ops-8.3.txz, but the current tarball seems to contain emulab-ops-8.2.pkg.  Similarly for fs, boss and emulab-extras.

Then the 8.3 packages get installed when we do the update 'pkg upgrade -r Emulab'.

We also noticed that the configure script looks for several 2.x python versions and then "python3", but the installed version is python3.8.  We resolved that by symlinking python3 to point to the python3.8 binary.

The point where we got stuck is the final step of installing on ops.  A log of the gmake output is attached.  It is failing to find http.tcl.  The file exists in /usr/local/lib/tcl8.6/http1.0/http.tcl.  This seemed like not something to try fixing with a symlink.

Thanks,
Brenton


ops-gmake-tcl-error.log

Mike Hibler

unread,
May 24, 2022, 12:35:40 PM5/24/22
to emulab...@googlegroups.com
I will fix that, you want 8.3.
> emulab-admins/16e77c23-880c-4fc4-ab70-d28eda33f946n%40googlegroups.com.

> root@ops:/usr/testbed/obj/testbed # gmake opsfs-install
> mkdir -p /usr/testbed/log
> mkdir -p /usr/testbed/log/mysql
> chmod 770 /usr/testbed/log/mysql
> chown mysql /usr/testbed/log/mysql
> chgrp mysql /usr/testbed/log/mysql
> mkdir -p /usr/testbed/log/logfiles
> chmod 777 /usr/testbed/log/logfiles
> gmake[1]: Entering directory '/usr/testbed/obj/testbed/rc.d'
> gmake[1]: Nothing to be done for 'control-install'.
> gmake[1]: Leaving directory '/usr/testbed/obj/testbed/rc.d'
> gmake[1]: Entering directory '/usr/testbed/obj/testbed/tbsetup'
> Installing console_setup.proxy
> mkdir -p /usr/testbed/sbin
> /usr/bin/install -c -m 755 console_setup.proxy /usr/testbed/sbin/console_setup.proxy
> Installing sfskey_update.proxy
> mkdir -p /usr/testbed/sbin
> /usr/bin/install -c -m 755 sfskey_update.proxy /usr/testbed/sbin/sfskey_update.proxy
> Installing savelogs.proxy
> mkdir -p /usr/testbed/sbin
> /usr/bin/install -c -m 755 savelogs.proxy /usr/testbed/sbin/savelogs.proxy
> Installing eventsys.proxy
> mkdir -p /usr/testbed/sbin
> /usr/bin/install -c -m 755 eventsys.proxy /usr/testbed/sbin/eventsys.proxy
> Installing fetchtar.proxy
> mkdir -p /usr/testbed/bin
> /usr/bin/install -c -m 755 fetchtar.proxy /usr/testbed/bin/fetchtar.proxy
> Installing libtestbed.pm
> mkdir -p /usr/testbed/lib
> /usr/bin/install -c -m 755 libtestbed.pm /usr/testbed/lib/libtestbed.pm
> Regenerating libSignedURL.pm
> cd .. && CONFIG_FILES=tbsetup/libSignedURL.pm ./config.status
> config.status: creating tbsetup/libSignedURL.pm
> config.status: creating config.h
> config.status: config.h is unchanged
> Installing libSignedURL.pm
> mkdir -p /usr/testbed/lib
> /usr/bin/install -c -m 755 libSignedURL.pm /usr/testbed/lib/libSignedURL.pm
> gmake[2]: Entering directory '/usr/testbed/obj/testbed/tbsetup/ns2ir'
> Installing sim.tcl
> mkdir -p /usr/testbed/lib/ns2ir
> /usr/bin/install -c sim.tcl /usr/testbed/lib/ns2ir/sim.tcl
> Installing tb_compat.tcl
> mkdir -p /usr/testbed/lib/ns2ir
> /usr/bin/install -c tb_compat.tcl /usr/testbed/lib/ns2ir/tb_compat.tcl
> Installing parse.tcl
> mkdir -p /usr/testbed/lib/ns2ir
> /usr/bin/install -c parse.tcl /usr/testbed/lib/ns2ir/parse.tcl
> Installing parse.proxy
> mkdir -p /usr/testbed/libexec/ns2ir
> /usr/bin/install -c parse.proxy /usr/testbed/libexec/ns2ir/parse.proxy
> gmake[2]: Leaving directory '/usr/testbed/obj/testbed/tbsetup/ns2ir'
> gmake[2]: Entering directory '/usr/testbed/obj/testbed/tbsetup/nsverify'
> /usr/testbed/src/testbed/tbsetup/nsverify/ns-fetch.sh /usr/testbed/src/testbed/tbsetup/nsverify ns-allinone-2.34.tar.gz
> Downloading ns source from www.emulab.net to /usr/testbed/obj/testbed/tbsetup/nsverify ...
> ns-allinone-2.34.tar.gz 54 MB 4420 kBps 13s
> Unpacking/patching ns-2.34 source ...
> Hmm... Looks like a unified diff to me...
> The text leading up to this was:
> --------------------------
> |diff -ur ../../ns-allinone-2.34.orig/ns-2.34/aomdv/aomdv.cc ./aomdv/aomdv.cc
> |--- ../../ns-allinone-2.34.orig/ns-2.34/aomdv/aomdv.cc 2009-06-14 11:35:44.000000000 -0600
> |+++ ./aomdv/aomdv.cc 2012-03-30 10:58:10.000000000 -0600
> --------------------------
> Patching file ./aomdv/aomdv.cc using Plan A...
> Hunk #1 succeeded at 86.
> Hmm... The next patch looks like a unified diff to me...
> The text leading up to this was:
> --------------------------
> |diff -ur ../../ns-allinone-2.34.orig/ns-2.34/emulate/net-pcap.cc ./emulate/net-pcap.cc
> |--- ../../ns-allinone-2.34.orig/ns-2.34/emulate/net-pcap.cc 2009-06-14 11:35:45.000000000 -0600
> |+++ ./emulate/net-pcap.cc 2012-03-30 11:01:19.000000000 -0600
> --------------------------
> Patching file ./emulate/net-pcap.cc using Plan A...
> Hunk #1 succeeded at 55.
> Hmm... The next patch looks like a unified diff to me...
> The text leading up to this was:
> --------------------------
> |diff -ur ../../ns-allinone-2.34.orig/ns-2.34/tcl/lan/vlan.tcl ./tcl/lan/vlan.tcl
> |--- ../../ns-allinone-2.34.orig/ns-2.34/tcl/lan/vlan.tcl 2009-06-14 11:35:40.000000000 -0600
> |+++ ./tcl/lan/vlan.tcl 2012-03-30 10:58:10.000000000 -0600
> --------------------------
> Patching file ./tcl/lan/vlan.tcl using Plan A...
> Hunk #1 succeeded at 143.
> Hunk #2 succeeded at 524.
> Hmm... The next patch looks like a unified diff to me...
> The text leading up to this was:
> --------------------------
> |diff -ur ../../ns-allinone-2.34.orig/ns-2.34/tcl/lib/ns-lib.tcl ./tcl/lib/ns-lib.tcl
> |--- ../../ns-allinone-2.34.orig/ns-2.34/tcl/lib/ns-lib.tcl 2009-06-14 11:35:41.000000000 -0600
> |+++ ./tcl/lib/ns-lib.tcl 2012-03-30 10:58:10.000000000 -0600
> --------------------------
> Patching file ./tcl/lib/ns-lib.tcl using Plan A...
> Hunk #1 succeeded at 261.
> Hunk #2 succeeded at 592.
> Hunk #3 succeeded at 1244.
> done
> Patching tclcl-1.19 ...
> Hmm... Looks like a unified diff to me...
> The text leading up to this was:
> --------------------------
> |diff -ur ../../ns-allinone-2.34.orig/tclcl-1.19/conf/configure.in.tcl ./conf/configure.in.tcl
> |--- ../../ns-allinone-2.34.orig/tclcl-1.19/conf/configure.in.tcl 2009-06-14 11:35:03.000000000 -0600
> |+++ ./conf/configure.in.tcl 2012-03-30 10:58:10.000000000 -0600
> --------------------------
> Patching file ./conf/configure.in.tcl using Plan A...
> Hunk #1 succeeded at 99.
> Hmm... The next patch looks like a unified diff to me...
> The text leading up to this was:
> --------------------------
> |diff -ur ../../ns-allinone-2.34.orig/tclcl-1.19/configure ./configure
> |--- ../../ns-allinone-2.34.orig/tclcl-1.19/configure 2009-06-14 11:35:03.000000000 -0600
> |+++ ./configure 2012-03-30 10:58:10.000000000 -0600
> --------------------------
> Patching file configure using Plan A...
> Hunk #1 succeeded at 6014.
> done
> No .configure file found in current directory
> Continuing with default options...
> checking build system type... x86_64-unknown-freebsd12.3
> checking host system type... x86_64-unknown-freebsd12.3
> checking target system type... x86_64-unknown-freebsd12.3
> checking for gcc... cc
> checking for C compiler default output file name... a.out
> checking whether the C compiler works... yes
> checking whether we are cross compiling... no
> checking for suffix of executables...
> checking for suffix of object files... o
> checking whether we are using the GNU C compiler... yes
> checking whether cc accepts -g... yes
> checking for cc option to accept ISO C89... none needed
> checking whether we are using the GNU C++ compiler... yes
> checking whether c++ accepts -g... yes
> checking how to run the C preprocessor... cc -E
> checking for grep that handles long lines and -e... /usr/bin/grep
> checking for egrep... /usr/bin/grep -E
> checking for ANSI C header files... yes
> checking for sys/types.h... yes
> checking for sys/stat.h... yes
> checking for stdlib.h... yes
> checking for string.h... yes
> checking for memory.h... yes
> checking for strings.h... yes
> checking for inttypes.h... yes
> checking for stdint.h... yes
> checking for unistd.h... yes
> checking for string.h... (cached) yes
> checking for main in -lXbsd... no
> checking for socket in -lsocket... no
> checking for gethostbyname in -lnsl... no
> checking for dcgettext in -lintl... no
> checking for getnodebyname in -ldnet_stub... no
> checking standard STL is available... no
> checking for ranlib... ranlib
> checking for snprintf... yes
> checking for ANSI C header files... (cached) yes
> checking for strtoq... yes
> checking for strtoll... yes
> checking size of long... 8
> checking for strtol... yes
> checking for __int64_t... no
> checking for long long... yes
> checking for int64_t... yes
> checking which kind of 64-bit int to use... int64_t
> checking for tcl.h... no
> checking for tclInt.h... no
> checking for libtcl8.4... no
> checking for init.tcl... no
> checking for http.tcl... no
> checking Tcl http.tcl library... configure: error: Couldn't find http.tcl in /http /http2.4 /http2.3 /http2.1 /http2.0 /http1.0
> gmake[3]: Entering directory '/usr/testbed/obj/testbed/tbsetup/nsverify/ns-allinone-2.34/tclcl-1.19'
> gmake[3]: *** No targets specified and no makefile found. Stop.
> gmake[3]: Leaving directory '/usr/testbed/obj/testbed/tbsetup/nsverify/ns-allinone-2.34/tclcl-1.19'
> gmake[2]: *** [GNUmakefile:69: nstb] Error 2
> gmake[2]: Leaving directory '/usr/testbed/obj/testbed/tbsetup/nsverify'
> gmake[1]: *** [GNUmakefile:337: control-install] Error 2
> gmake[1]: Leaving directory '/usr/testbed/obj/testbed/tbsetup'
> gmake: *** [GNUmakefile:154: ops-install] Error 2
>
>
> root@ops:/usr/testbed/obj/testbed # locate http.tcl
> /usr/local/lib/tcl8.6/http1.0/http.tcl
> /usr/local/man/mann/http.tcl86.n.gz
>
>
>
>
>
>

Mike Hibler

unread,
May 24, 2022, 12:44:12 PM5/24/22
to emulab...@googlegroups.com
Done, reload the tarball. I also changed the documentation to say load
packages by "foo.pkg" instead of "foo.txz" since they have changed the
package suffix.
> To view this discussion on the web visit https://groups.google.com/d/msgid/emulab-admins/20220524163538.GX94311%40flux.utah.edu.

Mike Hibler

unread,
May 24, 2022, 12:53:21 PM5/24/22
to emulab...@googlegroups.com
And of course I ignored your most important question...

I will look into the python and tcl problems after my 11am meeting.
> To view this discussion on the web visit https://groups.google.com/d/msgid/emulab-admins/20220524164409.GY94311%40flux.utah.edu.

Brenton Walker

unread,
Jun 3, 2022, 10:48:16 AM6/3/22
to emulab-admins
Thanks for all the responses.  Yesterday and today we got back to this trial install.  

We got around the previous issue of http.tcl not being found during the configure of tclcl by adding more options to the configure command.
In /usr/testbed/obj/testbed/tbsetup/nsverify/GNUmakefile we edited the following:
------------------------
nstb: ns-allinone-$(NS_VERSION)
        @cd $</tclcl-$(TCLCL_VERSION); \
                ./configure --with-tcl=/usr/local --with-tcl-ver=8.6 --with-tk=/usr/local --with-tk-ver=8.6; \
                $(MAKE)
------------------------

Now the configure works, but the build fails.  The log is attached.  Searching around for solutions, it sounds like tclcl should nt be compatible with tcl 8.6.  Trying to fix this is leading to a series of other problems with the ns-allinone build.  We didn't install any software or ports besides the three emulab ones.  We've also tried deleting (relocating) the entire /usr/testbed/ directory and starting fresh, but with the same results.  Any idea where we went wrong?
tclcl-build-error.log

Leigh Stoller

unread,
Jun 3, 2022, 11:20:45 AM6/3/22
to emulab...@googlegroups.com
Can we see your defs file please. And this is on 12.3 using the 12.3 packages?

Thanks
Leigh

Brenton Walker

unread,
Jun 7, 2022, 4:24:08 AM6/7/22
to emulab-admins
Our defs file is attached.  I replaced the IP addresses with placeholders.  We took the current template and copied the values from our old defs file to it.  Thanks for looking at it.

Yes, it's FreeBSD 12.3.  When we first started the install, the 12.2 packages were in the tarball, so we installed those, but they upgraded to 12.3 when we ran 'pkg upgrade -r Emulab'.  Since having this problem we tried removing the packages and reinstalling the 12.3 packages directly, but same results.

Thanks,
Brenton
defs-trial-install.txt

Leigh Stoller

unread,
Jun 7, 2022, 10:31:29 AM6/7/22
to emulab...@googlegroups.com

> Our defs file is attached. I replaced the IP addresses with placeholders. We took the current template and copied the values from our old defs file to it. Thanks for looking at it.

Hi. We no longer have NSVERIFY set on our clusters. Try turning
that off and reconfig/rebuild.

Leigh

Brenton Walker

unread,
Jun 14, 2022, 9:37:17 AM6/14/22
to emulab-admins
This did fix the problem - thank you.  We were able to get the system installed and running, add nodes, etc.  

We were also able to import images from the old emulab, following Chuck's advice.  Thank you for posting that.

We have spent some time getting familiar with the new interface and creating profiles with python scripts, and I had some remaining questions.

I understand the old "modify traffic shaping" feature is not available in the portal interface right now.  Is that a design decision, or just something no one has done yet?  I could not change link properties using the tevc commands either.  They run with no error, but nothing happens.  I know we can always log into the delay nodes to manually change link properties, but I wondered if the event system for link configuration has gone away.

Are Xen VMs supported on DIY emulabs like ours?  We never used them before, but I tried swapping in ... I mean instantiating the OneVM profile, and got an error that seems to be related to the OS Image.  Full log attached.  I tried toggling the Xen_capable" flag on the XEN49-64-STD image and importing the XEN411-64-STD image, but that did not change anything.
"*** ERROR: mapper:
***   Can't call method &quot;DefaultParent&quot; on an undefined value at
***   /usr/testbed/lib/libvtop_stable.pm line 1455, &lt;DATA&gt; line 2786."

Thanks again for all the help.
Brenton
spewlogfile.txt

Leigh Stoller

unread,
Jun 14, 2022, 10:36:32 AM6/14/22
to emulab...@googlegroups.com

> I understand the old "modify traffic shaping" feature is not available in the portal interface right now. Is that a design decision, or just something no one has done yet? I could not change link properties using the tevc commands either. They run with no error, but nothing happens. I know we can always log into the delay nodes to manually change link properties, but I wondered if the event system for link configuration has gone away.

Hi. Using tevc should still work. Is the event scheduler for the experiment
running on ops? That part of the system has not changed. Check the
event scheduler log in /proj/PID/exp/EID/logs to see if it failed for some
reason.

> Are Xen VMs supported on DIY emulabs like ours? We never used them before, but I tried swapping in ... I mean instantiating the OneVM profile, and got an error that seems to be related to the OS Image. Full log attached. I tried toggling the Xen_capable" flag on the XEN49-64-STD image and importing the XEN411-64-STD image, but that did not change anything.

Yes, XEN VMs should work. Although if you were not using them before, might
be a few issues to resolve.

So you want to use XEN411. Also, do not set XEN capable on the XEN image, you
want to set that on the images you want to use as a XEN guest (say, your UBUNTU
std image).

In the admin dropdown menu (of the new UI) click on edit site variables and
make sure that general/default_xen_parentosid is set to emulab-ops,XEN411-64-STD

Then on boss:

boss> wap runsonxen emulab-ops,UBUNTU18-64-STD

if that is one of the image you want to run as a XEN guest.

If you are running a flat network topology, and you are not already routing
the jail network, you might need IP aliases on boss and ops. Something like
in /etc/rc.conf:

ifconfig_xn0_alias0="inet 172.17.254.254 netmask 255.240.0.0”

“xn0” would need to change for your boss. Ditto ops, but use 172.17.253.254

Leigh


Mike Hibler

unread,
Jun 14, 2022, 10:45:41 AM6/14/22
to emulab...@googlegroups.com
With the shift of focus from a "network" testbed to a "cloud" testbed,
there is less user demand for traffic shaping, though all that should
still work as Leigh says in his message. Be aware that the current shaping
mechanism (older Dummynet), will not handle shaped links of greater than
1Gbps with any acceptable fidelity. This is something that has long been on
our TODO list.

What image are you using for the delay node?
> --
> You received this message because you are subscribed to the Google Groups
> "emulab-admins" group.
> To unsubscribe from this group and stop receiving emails from it, send an email
> to emulab-admin...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/
> emulab-admins/7efb8e8e-4305-48a8-98e1-c942681c3045n%40googlegroups.com.

> Created: 2022-06-14 13:09:04
> URN: urn:publicid:IDN+filab.uni-hannover.de+authority+sa
> Module: cm
> Method: CreateSliver
> Version: 2.0
> StartTime: 13:09:04:074697
> PID: 26571
> speakfor_urn: urn:publicid:IDN+filab.uni-hannover.de+user+brenton
> speakfor_uuid: ba79057f-e711-11ec-aa59-ac1f6bb14bf8
> speaking_urn: urn:publicid:IDN+filab.uni-hannover.de+authority+sa
> speaking_uuid: 517806d6-e70b-11ec-bf71-ac1f6bb14bf8
> slice_urn: urn:publicid:IDN+filab.uni-hannover.de:testbed+slice+vmtest2
> slice_idx: 63
> slice_uuid: 5db82ea6-ebd2-11ec-a0f3-ac1f6bb14bf8
> EndTime: 13:09:09:314935
> Elapsed: 5.24
> LogURN: urn:publicid:IDN+filab.uni-hannover.de+log+846025d2c1290ac80138b2c30e84b756494df32b
> LogURL: https://www.filab.uni-hannover.de/spewlogfile.php3?logfile=846025d2c1290ac80138b2c30e84b756494df32b
> Return: 28
>
> ----------------------------------
> GeniSlice->SetSpeaksFor([GeniSlice: XXX.testbed.vmtest2, IDX: 63], [GeniCredential: ba79057f-e711-11ec-aa59-ac1f6bb14bf8, 517806d6-e70b-11ec-bf71-ac1f6bb14bf8])
> <rspec xmlns:client="http://www.protogeni.net/resources/rspec/ext/client/1" xmlns:emulab="http://www.protogeni.net/resources/rspec/ext/emulab/1" xmlns:jacks="http://www.protogeni.net/resources/rspec/ext/jacks/1" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.geni.net/resources/rspec/3" xsi:schemaLocation="http://www.geni.net/resources/rspec/3 http://www.geni.net/resources/rspec/3/request.xsd" type="request">
> <rspec_tour xmlns="http://www.protogeni.net/resources/rspec/ext/apt-tour/1">
> <description type="markdown">One small virtual machine running Ubuntu 14.04 LTS.</description>
> <instructions type="markdown">Log into your VM and poke around. You have root access via `sudo`. Any work you do in the VM will be lost when it terminates.</instructions>
> </rspec_tour>
> <node client_id="node1" exclusive="false" component_manager_id="urn:publicid:IDN+filab.uni-hannover.de+authority+cm">
> <sliver_type name="emulab-xen">
> </sliver_type>
> </node>
> <emulab:portal name="emulab" url="https://www.filab.uni-hannover.de/portal/status.php?uuid=5d1b7154-ebd2-11ec-a0f3-ac1f6bb14bf8" project="testbed" experiment="vmtest2"/></rspec>TIMESTAMP: 13:09:07:367013 Processing nodes
> TIMESTAMP: 13:09:07:370567 Processing nodes done
> TIMESTAMP: 13:09:07:370654 Dumping topo
> [VirtExperiment: testbed/vmtest2/64]
> modelnet_edges : 0
> skipvlans : 0
> wa_bw_solverweight : 0
> delay_osname : NULL
> cpu_usage : 0
> elab_in_elab : 0
> uselinkdelays : 0
> multiplex_factor : 10
> elabinelab_cvstag : NULL
> use_ipassign : 0
> packing_strategy : NULL
> modelnet_cores : 0
> dpdb : 0
> nonfsmounts : 0
> usemodelnet : 0
> wa_delay_solverweight : 0
> usewatunnels : 1
> sync_server : node1
> delay_capacity : NULL
> elabinelab_singlenet : 0
> mem_usage : 0
> security_level : 0
> wa_plr_solverweight : 0
> elabinelab_eid : NULL
> ipassign_args : NULL
> encap_style : default
> uselatestwadata : 0
> allowfixnode : 0
> nfsmounts : emulabdefault
> forcelinkdelays : 0
> jail_osname : NULL
> [virt_node_desires: testbed/vmtest2/64 node1,pcshared]
> desire : pcshared
> weight : 0.95
> vname : node1
> [virt_programs: testbed/vmtest2/64 node1-program,node1]
> vname : node1-program
> timeout : 0
> command :
> vnode : node1
> expected_exit_code : 0
> dir :
> [virt_nodes: testbed/vmtest2/64 node1]
> fixed :
> routertype : static-ddijk
> vname : node1
> osname :
> cmd_line :
> rootkey_public : -1
> rootkey_private : -1
> ips :
> type : pcvm
> [virt_agents: testbed/vmtest2/64 ns,ns,*]
> vnode : *
> objecttype : 6
> vname : ns
> [virt_agents: testbed/vmtest2/64 linktest,linktest,*]
> vname : linktest
> vnode : *
> objecttype : 7
> TIMESTAMP: 13:09:07:371101 Dumping topo done
> TIMESTAMP: 13:09:07:371142 Storing topo
> TIMESTAMP: 13:09:07:388246 Storing topo done
>
> -------------- Output -----------------
> In Progress
> -------------- Request -----------------
> $VAR1 = '<?xml version="1.0"?>
> <methodCall>
> <methodName>CreateSliver</methodName>
> <params>
> <param><value><struct>
> <member><name>certificate</name><value><string>-----BEGIN CERTIFICATE-----
> MIIFEjCCA/qgAwIBAgICBCIwDQYJKoZIhvcNAQEFBQAwgc0xCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMREwDwYDVQQHEwhIYW5ub3ZlcjEcMBoG
> A1UEChMTRnV0dXJlIEludGVybmV0IExhYjEeMBwGA1UECxMVQ2VydGlmaWNhdGUg
> QXV0aG9yaXR5MSMwIQYDVQQDExpib3NzLmZpbGFiLnVuaS1oYW5ub3Zlci5kZTEw
> MC4GCSqGSIb3DQEJARYhdGVzdGJlZC1vcHNAZmlsYWIudW5pLWhhbm5vdmVyLmRl
> MB4XDTIyMDYxNDEwMDg0OVoXDTI3MTEyNzExMDg0OVowgb4xCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMRwwGgYDVQQKExNGdXR1cmUgSW50ZXJu
> ZXQgTGFiMR8wHQYDVQQLExZhcHRsYWIudGVzdGJlZC52bXRlc3QyMS0wKwYDVQQD
> EyQ1ZGI4MmVhNi1lYmQyLTExZWMtYTBmMy1hYzFmNmJiMTRiZjgxKTAnBgkqhkiG
> 9w0BCQEWGmJyZW50b24uZC53YWxrZXJAZ21haWwuY29tMIIBIjANBgkqhkiG9w0B
> AQEFAAOCAQ8AMIIBCgKCAQEAzg4SENJTi6lOyjLiBRsT906GT/lYBlwUWTGFLhQI
> /QS1+GSlOVYVyZCEy3y0g+BLpd9etfN8+Ri1oqx/zXrOo2ZGrlSnnzZnRkRJhO6K
> ZUK72DmEx9NGD+mtjEda0336+2j6eLbU7JLCZ6w6QgXOFLrhz8y+X+aaUW0HAYi6
> GOk0tcDU0OxICKOl2ZQTQQYWX7NSrFuFHHlAuV9VJoA8sSQ8lOQOm8IIfrP8/dJy
> fNNLbKX5oF5IkHJznQLcUhDETgDuBEvHxG2+rqpO9HxPDli0qW+C1SWDlJSQevwS
> O65OYnSIkVVVzOxvcbtO6Snas0lULVCxk4dyM8NWVGvbiwIDAQABo4IBBzCCAQMw
> HQYDVR0OBBYEFBN4Z14oHfCyzbv7/k0zB6kmjDaJMGsGA1UdEQRkMGKGMXVybjpw
> dWJsaWNpZDpJRE4rYXB0bGFiLm5ldDp0ZXN0YmVkK3NsaWNlK3ZtdGVzdDKGLXVy
> bjp1dWlkOjVkYjgyZWE2LWViZDItMTFlYy1hMGYzLWFjMWY2YmIxNGJmODAMBgNV
> HRMBAf8EAjAAMGcGCCsGAQUFBwEBBFswWTBXBhRpg8yTgKiYzKjHvbGngICqrteK
> G4Y/aHR0cHM6Ly93d3cuZmlsYWIudW5pLWhhbm5vdmVyLmRlOjEyMzY5L3Byb3Rv
> Z2VuaS94bWxycGMvcG9ydGFsMA0GCSqGSIb3DQEBBQUAA4IBAQAGx4brhxnGbmng
> mNjTkBHcrM0RsVE410IaXGvmcXIZ5rT9eIB9ddAI6x0v2eOCtW4QMzi3nKOOBuoY
> BUgCXmNnM0R2g2mmPR8pdDT5Q7l1Lg45bPTbVAvFObuFncGpH3PgPc1F5x/54cpu
> 0seax33ZIWWbxCVLSdNFkgOjyBiYQThVnDJK8B5OXYACHO5sZLYRAqo22Q2y6ZKc
> 51u+Y8YWceSJMXRcIdrST+1KnpeT5yeFwU9YxYenuZ9/akYldMnUTOoBNVWEpilh
> Gjsjj95VMBJD4gCMAph1bwdPJeBBjz6UWUs5sVTKCbRHQH1ZY7RNMPjbicDHSDZX
> X5QjbYpn
> -----END CERTIFICATE-----
> </string></value></member>
> <member><name>key</name><value><string>-----BEGIN RSA PRIVATE KEY-----
> MIIEpAIBAAKCAQEAzg4SENJTi6lOyjLiBRsT906GT/lYBlwUWTGFLhQI/QS1+GSl
> OVYVyZCEy3y0g+BLpd9etfN8+Ri1oqx/zXrOo2ZGrlSnnzZnRkRJhO6KZUK72DmE
> x9NGD+mtjEda0336+2j6eLbU7JLCZ6w6QgXOFLrhz8y+X+aaUW0HAYi6GOk0tcDU
> 0OxICKOl2ZQTQQYWX7NSrFuFHHlAuV9VJoA8sSQ8lOQOm8IIfrP8/dJyfNNLbKX5
> oF5IkHJznQLcUhDETgDuBEvHxG2+rqpO9HxPDli0qW+C1SWDlJSQevwSO65OYnSI
> kVVVzOxvcbtO6Snas0lULVCxk4dyM8NWVGvbiwIDAQABAoIBAGhhildJJJdYMhiN
> xB9QA0JBXhq/Ng8qsAgq5MtdzNvXehMVcPllmW3dLtgiGRPBGLEzQTgs2z8YfFKm
> zasarfjqQ53mNm+Z0KEw0IltiWAYeS3knVXYueIvvwGT1/fRFsYq/M8P1zbsdVyt
> S2nMpQOtU9y/XCUanUvoTidByvv4pV7IFFNdRimmroxcTPMkvQfRhD0tTWGAJnLY
> ur+JOXx5GGK5mS7+lcOU4FMafbxCjJDWBs1/RV5KZcVCYuq8SSfPNGoSieEcpikl
> rtYVUAQt4U7KwAO80zGSjoSqUJIhF/XTxkNC9eKgLskrq1vW0f1xHg/bYqoiP/+v
> zoWq98ECgYEA+0yWQyHbld1C4B41iIOqlOOdKuzBQJ4mntGofq3d9SzlQd9CelfV
> cf7VtxSod4MbUTexXQfJC7FxiC6+IVp+kVOOcpyVYd8gI23xGRRGehtGhDUJ+nZ3
> Wr9BHmnq/KTb8BeCdrT/BlAb2FrfPqzfx+cIlsOp6ZzqK8r03DbJgaECgYEA0ejR
> 1j9PyqkP4bUWAGBdQT9F1RiFxmFdFNLFAZL3qfdaOzq9aL1MXH7Yb8BR4PPXM2uJ
> o4Q7nOx0GXnpNsR33dzbZbBII0JhJOuUOHX5QLsqoyjR5d7e1w3ldjiiMIVANEaV
> ShbukIalWdxSQy28tx5t0ppZ58Z1l8MBJxBWJasCgYB0B+TJknSFOeiK+ufU5JZ6
> sK39B9wjLeK/KicWdskpT1V7mM5lFvEi9XtQUWWH6S1PzttCDToy//df3dVEKTiP
> eXkoSkxfKFr6gOT1o3r3Hmjs2mCFGPX7HJvAoz8w8B3tOa2vidrG224/85VopwGc
> l3xLwIRPrXgiSE/O7i0UgQKBgQCSsLhLmA0D3Ge73NfWRYGGAlij1bJO82WgErcY
> JYOsJK7K637IPlmp3f8VAXp20RDX31PdkKA0Rs3Pq/F9k4kM47Xy92FCOrY2necE
> GfWo9eOTCAi/MqPZ990eY+98JvK6VYUotKPdHitZg+19Au55resjnTgtD/THrMAW
> c4UwZwKBgQDzAh5SHN2gdO4MbvBJN2Av83KvGhqH89GfxMsNMShid11rXhzjMxHR
> NSrscKw3QqVicYx6X6DJSzEJmlJHFRJ50k2e9h94TqpnMxmcXMuj4GaFUubtrXs0
> fG/Qt5ClxbBVYaRmUEDhEAfLBRJqwJMcz3AyAMEYN8MA3OEo8+Ii4A==
> -----END RSA PRIVATE KEY-----
> </string></value></member>
> <member><name>usetracker</name><value><i4>0</i4></value></member>
> <member><name>rspec</name><value><string>&lt;rspec xmlns:client=&quot;http://www.protogeni.net/resources/rspec/ext/client/1&quot; xmlns:emulab=&quot;http://www.protogeni.net/resources/rspec/ext/emulab/1&quot; xmlns:jacks=&quot;http://www.protogeni.net/resources/rspec/ext/jacks/1&quot; xmlns:xsi=&quot;http://www.w3.org/2001/XMLSchema-instance&quot; xmlns=&quot;http://www.geni.net/resources/rspec/3&quot; xsi:schemaLocation=&quot;http://www.geni.net/resources/rspec/3 http://www.geni.net/resources/rspec/3/request.xsd&quot; type=&quot;request&quot;&gt;
> &lt;rspec_tour xmlns=&quot;http://www.protogeni.net/resources/rspec/ext/apt-tour/1&quot;&gt;
> &lt;description type=&quot;markdown&quot;&gt;One small virtual machine running Ubuntu 14.04 LTS.&lt;/description&gt;
> &lt;instructions type=&quot;markdown&quot;&gt;Log into your VM and poke around. You have root access via `sudo`. Any work you do in the VM will be lost when it terminates.&lt;/instructions&gt;
> &lt;/rspec_tour&gt;
> &lt;node client_id=&quot;node1&quot; exclusive=&quot;false&quot; component_manager_id=&quot;urn:publicid:IDN+filab.uni-hannover.de+authority+cm&quot;&gt;
> &lt;sliver_type name=&quot;emulab-xen&quot;&gt;
> &lt;/sliver_type&gt;
> &lt;/node&gt;
> &lt;emulab:portal name=&quot;emulab&quot; url=&quot;https://www.filab.uni-hannover.de/portal/status.php?uuid=5d1b7154-ebd2-11ec-a0f3-ac1f6bb14bf8&quot; project=&quot;testbed&quot; experiment=&quot;vmtest2&quot;/&gt;&lt;/rspec&gt;</string></value></member>
> <member><name>credentials</name><value><array><data>
> <value><string>&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot; standalone=&quot;no&quot;?&gt;
> &lt;signed-credential xmlns:xsi=&quot;http://www.w3.org/2001/XMLSchema-instance&quot; xsi:noNamespaceSchemaLocation=&quot;http://www.protogeni.net/resources/credential/credential.xsd&quot; xsi:schemaLocation=&quot;http://www.protogeni.net/resources/credential/ext/policy/1 http://www.protogeni.net/resources/credential/ext/policy/1/policy.xsd&quot;&gt;
> &lt;credential xml:id=&quot;refEE53A8C5BA659E5E&quot;&gt;
> &lt;type&gt;privilege&lt;/type&gt;
> &lt;serial&gt;2186&lt;/serial&gt;
> &lt;owner_gid&gt;MIIFKjCCBBKgAwIBAgICA/owDQYJKoZIhvcNAQEFBQAwgc0xCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMREwDwYDVQQHEwhIYW5ub3ZlcjEcMBoG
> A1UEChMTRnV0dXJlIEludGVybmV0IExhYjEeMBwGA1UECxMVQ2VydGlmaWNhdGUg
> QXV0aG9yaXR5MSMwIQYDVQQDExpib3NzLmZpbGFiLnVuaS1oYW5ub3Zlci5kZTEw
> MC4GCSqGSIb3DQEJARYhdGVzdGJlZC1vcHNAZmlsYWIudW5pLWhhbm5vdmVyLmRl
> MB4XDTIyMDYwODEwMDAxM1oXDTI1MDMwNDEwMDAxM1owgbYxCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMRwwGgYDVQQKExNGdXR1cmUgSW50ZXJu
> ZXQgTGFiMRQwEgYDVQQLEwtYWFguYnJlbnRvbjEtMCsGA1UEAxMkYmE3OTA1N2Yt
> ZTcxMS0xMWVjLWFhNTktYWMxZjZiYjE0YmY4MSwwKgYJKoZIhvcNAQkBFh1icmVu
> dG9uQGZpbGFiLnVuaS1oYW5ub3Zlci5kZTCCASIwDQYJKoZIhvcNAQEBBQADggEP
> ADCCAQoCggEBAL6Lz4Q/F4bH1MTvANpKR4XnnP+hdXEKtiJT7aJcy/Cnaum2aksl
> hCyFr6BTyIqAQ7f4O6Cd9mC8bohNSNLS4xmeeDSBGLTuklUw9Eofgj1J9Jy3+EtY
> rr0aF5ob042ykYNs1wjR9lj3wy4xwkOIlxNtP3oCPK/DZtKZnI35PahxqCL6GgLQ
> f7RJRmGAmu0ZK1p6GEFAP5mXyzhJ3pqKCs3jxLlKOUzuepSgtQxDKyDwCMiYFKRJ
> OF4KomglmsGO9p1eqamPSKVc/TlmKg2R1/gi4WYckQC9EaCreaxrmuTfmEwGEhj5
> 9Ysyvr0uiZiAE78Uc3BJUfcRPCyWVqMCK4ECAwEAAaOCAScwggEjMAwGA1UdEwEB
> /wQCMAAwHQYDVR0OBBYEFIRImbz0BWi349dniAlKhurkHn/IMIGOBgNVHREEgYYw
> gYOGM3VybjpwdWJsaWNpZDpJRE4rZmlsYWIudW5pLWhhbm5vdmVyLmRlK3VzZXIr
> YnJlbnRvboEdYnJlbnRvbkBmaWxhYi51bmktaGFubm92ZXIuZGWGLXVybjp1dWlk
> OmJhNzkwNTdmLWU3MTEtMTFlYy1hYTU5LWFjMWY2YmIxNGJmODBjBggrBgEFBQcB
> AQRXMFUwUwYUaYPMk4ComMyox72xp4CAqq7XihuGO2h0dHBzOi8vd3d3LmZpbGFi
> LnVuaS1oYW5ub3Zlci5kZToxMjM2OS9wcm90b2dlbmkveG1scnBjL3NhMA0GCSqG
> SIb3DQEBBQUAA4IBAQA+jJrUno26FkqOqaayfusXjx/LM+jSFJWbowqWeeJxhaGY
> iJR47uG4Tmo+8CVjr9Pgjm84TsEcBWDitvnIHHsYCxCmURKQ/xABgcZoCZi4a0+Q
> px5aE9gB3IZR/IV4+r03Ig6CCqC5/XeY5sz5OeVZBatTG6jCCOxWC8nsKjahjvfn
> efe7nuF1xO60ObBjbKN5jn6Dq9GxdP6If8toTPa0aRz101s7m8E9P0He0lthVpvt
> 5rEvlPlyqzkkLwS6dWF5zgZbAX336Z4LXh3k1K9vPvmYMgiUm9ZSztAxH9N71x7n
> q3uLBDdoqiYy+DldWCDgWFTKDvRhwV5Pq8E5Elpz
> &lt;/owner_gid&gt;
> &lt;owner_urn&gt;urn:publicid:IDN+filab.uni-hannover.de+user+brenton&lt;/owner_urn&gt;
> &lt;target_gid&gt;-----BEGIN CERTIFICATE-----
> MIIErzCCA5egAwIBAgICBCEwDQYJKoZIhvcNAQEFBQAwgc0xCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMREwDwYDVQQHEwhIYW5ub3ZlcjEcMBoG
> A1UEChMTRnV0dXJlIEludGVybmV0IExhYjEeMBwGA1UECxMVQ2VydGlmaWNhdGUg
> QXV0aG9yaXR5MSMwIQYDVQQDExpib3NzLmZpbGFiLnVuaS1oYW5ub3Zlci5kZTEw
> MC4GCSqGSIb3DQEJARYhdGVzdGJlZC1vcHNAZmlsYWIudW5pLWhhbm5vdmVyLmRl
> MB4XDTIyMDYxNDEwMDg0OVoXDTI3MTEyNzExMDg0OVowgbsxCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMRwwGgYDVQQKExNGdXR1cmUgSW50ZXJu
> ZXQgTGFiMRwwGgYDVQQLExNYWFgudGVzdGJlZC52bXRlc3QyMS0wKwYDVQQDEyQ1
> ZGI4MmVhNi1lYmQyLTExZWMtYTBmMy1hYzFmNmJiMTRiZjgxKTAnBgkqhkiG9w0B
> CQEWGmJyZW50b24uZC53YWxrZXJAZ21haWwuY29tMIIBIjANBgkqhkiG9w0BAQEF
> AAOCAQ8AMIIBCgKCAQEAuVdwV4e3f465YsxPJwmX58gJRGjtaiBI9uvkg6nsOjd/
> 7+db1M6MfkS86DYmHvutCozQHnNSUy0/jGzwRESvLUE+PQqw8qCeEdJpGH74Bym7
> vMSRdpRzefISQub2GHBaVW6DgjV+HdcFzPfaMh2+mNFP0r6xrK2LUpfoR7pl5fhd
> vIz+/vuH0polBIK3uw4oO19pSUEbO/sfGJxIcUyjjKvApTJEDlJhEs/R7s/rCjXu
> cAdLwvU9tHoZMb/mVSIN9C8zSKQgD9cMGylzVfQS9Bt1ejtpN8Lh5JtptdxfmCUh
> OnyQ3dezfudJ1ChiuM2pL5cvcccMUGlnLMbuXEmWewIDAQABo4GoMIGlMB0GA1Ud
> DgQWBBQUyzaP+ncE9LIgh4V7a/ux1MdWpzB2BgNVHREEbzBthjx1cm46cHVibGlj
> aWQ6SUROK2ZpbGFiLnVuaS1oYW5ub3Zlci5kZTp0ZXN0YmVkK3NsaWNlK3ZtdGVz
> dDKGLXVybjp1dWlkOjVkYjgyZWE2LWViZDItMTFlYy1hMGYzLWFjMWY2YmIxNGJm
> ODAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBBQUAA4IBAQBLHsn5btN58reORdcN
> YH8KvHAyXs3GZgptdjEuCXkzMIA+SPZr9ZwnPCASE3CMK8W141DK8+bYmV1STV3y
> wRl6XAriOZuf7R7jG9L/L8ELooLHVA/KuT+B5eQgrVJLQEKXYkvQQI35P+tlgT5E
> POzqqS9Do+9PkqUsYXO42bSA0esrRhceCwEZIb6WAQVFWwmijxdFVVqGmoz22CHw
> sNsfKiWTRG8tbmczSGg7FTH2bo0nv9W2hVvGzMG5kYKkgIGh5OzMgAU5faXcXpyy
> 3xS+9FsyeuvQCbjNDJUGgSMQLLvf2xTdksayCSlGvAjMvHSSjQFarJ+rVxE/ob6V
> hsYB
> -----END CERTIFICATE-----
> &lt;/target_gid&gt;
> &lt;target_urn&gt;urn:publicid:IDN+filab.uni-hannover.de:testbed+slice+vmtest2&lt;/target_urn&gt;
> &lt;uuid&gt;60015fca-ebd2-11ec-a0f3-ac1f6bb14bf8&lt;/uuid&gt;
> &lt;expires&gt;2022-06-15T03:08:49Z&lt;/expires&gt;
> &lt;privileges&gt;
> &lt;privilege&gt;&lt;name&gt;*&lt;/name&gt;&lt;can_delegate&gt;1&lt;/can_delegate&gt;&lt;/privilege&gt;
> &lt;/privileges&gt;&lt;/credential&gt;
> &lt;signatures&gt;
> &lt;Signature xmlns=&quot;http://www.w3.org/2000/09/xmldsig#&quot; xml:id=&quot;Sig_refEE53A8C5BA659E5E&quot;&gt;
> &lt;SignedInfo&gt;
> &lt;CanonicalizationMethod Algorithm=&quot;http://www.w3.org/TR/2001/REC-xml-c14n-20010315&quot;/&gt;
> &lt;SignatureMethod Algorithm=&quot;http://www.w3.org/2000/09/xmldsig#rsa-sha1&quot;/&gt;
> &lt;Reference URI=&quot;#refEE53A8C5BA659E5E&quot;&gt;
> &lt;Transforms&gt;
> &lt;Transform Algorithm=&quot;http://www.w3.org/2000/09/xmldsig#enveloped-signature&quot;/&gt;
> &lt;/Transforms&gt;
> &lt;DigestMethod Algorithm=&quot;http://www.w3.org/2000/09/xmldsig#sha1&quot;/&gt;
> &lt;DigestValue&gt;bj6X1EXhZUPmuD2wCybIMZZBGOA=&lt;/DigestValue&gt;
> &lt;/Reference&gt;
> &lt;/SignedInfo&gt;
> &lt;SignatureValue&gt;gMfmJ4ARYUEIoJmZS/DozECJO7eaahg7BrkucABxk5XQrT4hnJ2N+dmIx/8Y0bvL
> FRS7wHXyAQMfC+Ce4pPeDD/SKg6eviydfnKR0nL5lMQGJ5WpCJN1+82dapZVfxUc
> 72Hn0Qcpb6R8ezgHVEQ++73ODfok6q7L87gNS4xsjESyh7JRhjg61dz686N3GjdA
> dIHWlbthogQhyqKzB57IlAOQiSOqG/OF+zcoRjvElohskZp7ZmbQeiAFMX1+aDpK
> Qczgp3u84l7stqNJsbDIrylAdouslZ+eTRsHu2NoyNRywaWYCgu2eCweX+dbJj5P
> QtSsXiqSWnXeuCUq6LjzPg==&lt;/SignatureValue&gt;
> &lt;KeyInfo&gt;
> &lt;X509Data&gt;
> &lt;X509SubjectName&gt;emailAddress=testb...@filab.uni-hannover.de,CN=517806d6-e70b-11ec-bf71-ac1f6bb14bf8,OU=XXX.sa,O=Future Internet Lab,ST=Niedersachsen,C=DE&lt;/X509SubjectName&gt;
> &lt;X509IssuerSerial&gt;
> &lt;X509IssuerName&gt;emailAddress=testb...@filab.uni-hannover.de,CN=boss.filab.uni-hannover.de,OU=Certificate Authority,O=Future Internet Lab,L=Hannover,ST=Niedersachsen,C=DE&lt;/X509IssuerName&gt;
> &lt;X509SerialNumber&gt;1010&lt;/X509SerialNumber&gt;
> &lt;/X509IssuerSerial&gt;
> &lt;X509Certificate&gt;MIIE2TCCA8GgAwIBAgICA/IwDQYJKoZIhvcNAQEFBQAwgc0xCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMREwDwYDVQQHEwhIYW5ub3ZlcjEcMBoG
> A1UEChMTRnV0dXJlIEludGVybmV0IExhYjEeMBwGA1UECxMVQ2VydGlmaWNhdGUg
> QXV0aG9yaXR5MSMwIQYDVQQDExpib3NzLmZpbGFiLnVuaS1oYW5ub3Zlci5kZTEw
> MC4GCSqGSIb3DQEJARYhdGVzdGJlZC1vcHNAZmlsYWIudW5pLWhhbm5vdmVyLmRl
> MB4XDTIyMDYwODA4MTM1NFoXDTI3MTEyNzA5MTM1NFowgbUxCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMRwwGgYDVQQKExNGdXR1cmUgSW50ZXJu
> ZXQgTGFiMQ8wDQYDVQQLEwZYWFguc2ExLTArBgNVBAMTJDUxNzgwNmQ2LWU3MGIt
> MTFlYy1iZjcxLWFjMWY2YmIxNGJmODEwMC4GCSqGSIb3DQEJARYhdGVzdGJlZC1v
> cHNAZmlsYWIudW5pLWhhbm5vdmVyLmRlMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8A
> MIIBCgKCAQEAwvzqj+A7g3VNPe5zdxbbf/6IMtcRf+V0fSb46MBVPBrpfGUUQK2Q
> L2aNbRSZxrIuuprzSaQXV43m95sisWlUXKzpstiP/teys5+7sR301c2j/tKNL5tP
> JE14UD3gN4XGwh5foqVXwmaX3TTYgBm21+yFiqwEFZV2jbpKZdPHm4MjllaU7QYf
> ebDtiAthJVuE1GZ304kLyo2ckV91Ee+s7T/9GBGPE5BiquJVovuv9f6370ivo7t7
> 44F7ldMeXtJJZWJ3BjgHSoCLi8apUaA7HAAiZq6KqtN0Q8gt2XiomGdGKanUMHbP
> T3E5hdKgExcgTPJftOX2JtSdFuq3wwE8KwIDAQABo4HYMIHVMB0GA1UdDgQWBBTc
> 8XfLYpuBFX1syAVA4do/0BlEwDA+BgNVHREENzA1hjN1cm46cHVibGljaWQ6SURO
> K2ZpbGFiLnVuaS1oYW5ub3Zlci5kZSthdXRob3JpdHkrc2EwDwYDVR0TAQH/BAUw
> AwEB/zBjBggrBgEFBQcBAQRXMFUwUwYUaYPMk4ComMyox72xp4CAqq7XihuGO2h0
> dHBzOi8vd3d3LmZpbGFiLnVuaS1oYW5ub3Zlci5kZToxMjM2OS9wcm90b2dlbmkv
> eG1scnBjL3NhMA0GCSqGSIb3DQEBBQUAA4IBAQCRspps9DBrx4hL7w/3+b23KafK
> azXW2ihUhKTcDCeclXr4LBoebJ7DJ8c2SBHRLWMDstemE+TzitFoVjBmE9u0y+XU
> /zGZ6iLdqZ6E7l74tMtZOqLgIN4RxGsfgtttOjGIsCwHEATDYOily0YRfyqI4CLt
> pxP7Bq59/R1kpG1ih7vKeFWwVpmnkcSB1Vf1UQTGIkLywJEYai0QX+upv/dXCH8t
> kCMQropiUqflluLqtSkhTrpLbtknXZf4RH7oSA+we8B2rnZ+So5//JlKj4E3WPIT
> EkLZMrGX/4qJTlkmZTr7BqrrZ/2PJKz1aF1X70VAKvk3DjViB6kmK+MRMoVr&lt;/X509Certificate&gt;
> &lt;/X509Data&gt;
> &lt;KeyValue&gt;
> &lt;RSAKeyValue&gt;
> &lt;Modulus&gt;
> wvzqj+A7g3VNPe5zdxbbf/6IMtcRf+V0fSb46MBVPBrpfGUUQK2QL2aNbRSZxrIu
> uprzSaQXV43m95sisWlUXKzpstiP/teys5+7sR301c2j/tKNL5tPJE14UD3gN4XG
> wh5foqVXwmaX3TTYgBm21+yFiqwEFZV2jbpKZdPHm4MjllaU7QYfebDtiAthJVuE
> 1GZ304kLyo2ckV91Ee+s7T/9GBGPE5BiquJVovuv9f6370ivo7t744F7ldMeXtJJ
> ZWJ3BjgHSoCLi8apUaA7HAAiZq6KqtN0Q8gt2XiomGdGKanUMHbPT3E5hdKgExcg
> TPJftOX2JtSdFuq3wwE8Kw==
> &lt;/Modulus&gt;
> &lt;Exponent&gt;
> AQAB
> &lt;/Exponent&gt;
> &lt;/RSAKeyValue&gt;
> &lt;/KeyValue&gt;
> &lt;/KeyInfo&gt;
> &lt;/Signature&gt;
> &lt;/signatures&gt;
> &lt;/signed-credential&gt;
> </string></value><value><string>&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot; standalone=&quot;no&quot;?&gt;
> &lt;signed-credential xmlns:xsi=&quot;http://www.w3.org/2001/XMLSchema-instance&quot; xsi:noNamespaceSchemaLocation=&quot;http://www.protogeni.net/resources/credential/credential.xsd&quot; xsi:schemaLocation=&quot;http://www.protogeni.net/resources/credential/ext/policy/1 http://www.protogeni.net/resources/credential/ext/policy/1/policy.xsd&quot;&gt;
> &lt;credential xml:id=&quot;ref0C7014AA4AFECBB6&quot;&gt;
> &lt;type&gt;speaksfor&lt;/type&gt;
> &lt;serial&gt;2185&lt;/serial&gt;
> &lt;owner_gid&gt;-----BEGIN CERTIFICATE-----
> MIIE2TCCA8GgAwIBAgICA/IwDQYJKoZIhvcNAQEFBQAwgc0xCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMREwDwYDVQQHEwhIYW5ub3ZlcjEcMBoG
> A1UEChMTRnV0dXJlIEludGVybmV0IExhYjEeMBwGA1UECxMVQ2VydGlmaWNhdGUg
> QXV0aG9yaXR5MSMwIQYDVQQDExpib3NzLmZpbGFiLnVuaS1oYW5ub3Zlci5kZTEw
> MC4GCSqGSIb3DQEJARYhdGVzdGJlZC1vcHNAZmlsYWIudW5pLWhhbm5vdmVyLmRl
> MB4XDTIyMDYwODA4MTM1NFoXDTI3MTEyNzA5MTM1NFowgbUxCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMRwwGgYDVQQKExNGdXR1cmUgSW50ZXJu
> ZXQgTGFiMQ8wDQYDVQQLEwZYWFguc2ExLTArBgNVBAMTJDUxNzgwNmQ2LWU3MGIt
> MTFlYy1iZjcxLWFjMWY2YmIxNGJmODEwMC4GCSqGSIb3DQEJARYhdGVzdGJlZC1v
> cHNAZmlsYWIudW5pLWhhbm5vdmVyLmRlMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8A
> MIIBCgKCAQEAwvzqj+A7g3VNPe5zdxbbf/6IMtcRf+V0fSb46MBVPBrpfGUUQK2Q
> L2aNbRSZxrIuuprzSaQXV43m95sisWlUXKzpstiP/teys5+7sR301c2j/tKNL5tP
> JE14UD3gN4XGwh5foqVXwmaX3TTYgBm21+yFiqwEFZV2jbpKZdPHm4MjllaU7QYf
> ebDtiAthJVuE1GZ304kLyo2ckV91Ee+s7T/9GBGPE5BiquJVovuv9f6370ivo7t7
> 44F7ldMeXtJJZWJ3BjgHSoCLi8apUaA7HAAiZq6KqtN0Q8gt2XiomGdGKanUMHbP
> T3E5hdKgExcgTPJftOX2JtSdFuq3wwE8KwIDAQABo4HYMIHVMB0GA1UdDgQWBBTc
> 8XfLYpuBFX1syAVA4do/0BlEwDA+BgNVHREENzA1hjN1cm46cHVibGljaWQ6SURO
> K2ZpbGFiLnVuaS1oYW5ub3Zlci5kZSthdXRob3JpdHkrc2EwDwYDVR0TAQH/BAUw
> AwEB/zBjBggrBgEFBQcBAQRXMFUwUwYUaYPMk4ComMyox72xp4CAqq7XihuGO2h0
> dHBzOi8vd3d3LmZpbGFiLnVuaS1oYW5ub3Zlci5kZToxMjM2OS9wcm90b2dlbmkv
> eG1scnBjL3NhMA0GCSqGSIb3DQEBBQUAA4IBAQCRspps9DBrx4hL7w/3+b23KafK
> azXW2ihUhKTcDCeclXr4LBoebJ7DJ8c2SBHRLWMDstemE+TzitFoVjBmE9u0y+XU
> /zGZ6iLdqZ6E7l74tMtZOqLgIN4RxGsfgtttOjGIsCwHEATDYOily0YRfyqI4CLt
> pxP7Bq59/R1kpG1ih7vKeFWwVpmnkcSB1Vf1UQTGIkLywJEYai0QX+upv/dXCH8t
> kCMQropiUqflluLqtSkhTrpLbtknXZf4RH7oSA+we8B2rnZ+So5//JlKj4E3WPIT
> EkLZMrGX/4qJTlkmZTr7BqrrZ/2PJKz1aF1X70VAKvk3DjViB6kmK+MRMoVr
> -----END CERTIFICATE-----
> &lt;/owner_gid&gt;
> &lt;owner_urn&gt;urn:publicid:IDN+filab.uni-hannover.de+authority+sa&lt;/owner_urn&gt;
> &lt;target_gid&gt;MIIFKjCCBBKgAwIBAgICA/owDQYJKoZIhvcNAQEFBQAwgc0xCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMREwDwYDVQQHEwhIYW5ub3ZlcjEcMBoG
> A1UEChMTRnV0dXJlIEludGVybmV0IExhYjEeMBwGA1UECxMVQ2VydGlmaWNhdGUg
> QXV0aG9yaXR5MSMwIQYDVQQDExpib3NzLmZpbGFiLnVuaS1oYW5ub3Zlci5kZTEw
> MC4GCSqGSIb3DQEJARYhdGVzdGJlZC1vcHNAZmlsYWIudW5pLWhhbm5vdmVyLmRl
> MB4XDTIyMDYwODEwMDAxM1oXDTI1MDMwNDEwMDAxM1owgbYxCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMRwwGgYDVQQKExNGdXR1cmUgSW50ZXJu
> ZXQgTGFiMRQwEgYDVQQLEwtYWFguYnJlbnRvbjEtMCsGA1UEAxMkYmE3OTA1N2Yt
> ZTcxMS0xMWVjLWFhNTktYWMxZjZiYjE0YmY4MSwwKgYJKoZIhvcNAQkBFh1icmVu
> dG9uQGZpbGFiLnVuaS1oYW5ub3Zlci5kZTCCASIwDQYJKoZIhvcNAQEBBQADggEP
> ADCCAQoCggEBAL6Lz4Q/F4bH1MTvANpKR4XnnP+hdXEKtiJT7aJcy/Cnaum2aksl
> hCyFr6BTyIqAQ7f4O6Cd9mC8bohNSNLS4xmeeDSBGLTuklUw9Eofgj1J9Jy3+EtY
> rr0aF5ob042ykYNs1wjR9lj3wy4xwkOIlxNtP3oCPK/DZtKZnI35PahxqCL6GgLQ
> f7RJRmGAmu0ZK1p6GEFAP5mXyzhJ3pqKCs3jxLlKOUzuepSgtQxDKyDwCMiYFKRJ
> OF4KomglmsGO9p1eqamPSKVc/TlmKg2R1/gi4WYckQC9EaCreaxrmuTfmEwGEhj5
> 9Ysyvr0uiZiAE78Uc3BJUfcRPCyWVqMCK4ECAwEAAaOCAScwggEjMAwGA1UdEwEB
> /wQCMAAwHQYDVR0OBBYEFIRImbz0BWi349dniAlKhurkHn/IMIGOBgNVHREEgYYw
> gYOGM3VybjpwdWJsaWNpZDpJRE4rZmlsYWIudW5pLWhhbm5vdmVyLmRlK3VzZXIr
> YnJlbnRvboEdYnJlbnRvbkBmaWxhYi51bmktaGFubm92ZXIuZGWGLXVybjp1dWlk
> OmJhNzkwNTdmLWU3MTEtMTFlYy1hYTU5LWFjMWY2YmIxNGJmODBjBggrBgEFBQcB
> AQRXMFUwUwYUaYPMk4ComMyox72xp4CAqq7XihuGO2h0dHBzOi8vd3d3LmZpbGFi
> LnVuaS1oYW5ub3Zlci5kZToxMjM2OS9wcm90b2dlbmkveG1scnBjL3NhMA0GCSqG
> SIb3DQEBBQUAA4IBAQA+jJrUno26FkqOqaayfusXjx/LM+jSFJWbowqWeeJxhaGY
> iJR47uG4Tmo+8CVjr9Pgjm84TsEcBWDitvnIHHsYCxCmURKQ/xABgcZoCZi4a0+Q
> px5aE9gB3IZR/IV4+r03Ig6CCqC5/XeY5sz5OeVZBatTG6jCCOxWC8nsKjahjvfn
> efe7nuF1xO60ObBjbKN5jn6Dq9GxdP6If8toTPa0aRz101s7m8E9P0He0lthVpvt
> 5rEvlPlyqzkkLwS6dWF5zgZbAX336Z4LXh3k1K9vPvmYMgiUm9ZSztAxH9N71x7n
> q3uLBDdoqiYy+DldWCDgWFTKDvRhwV5Pq8E5Elpz
> &lt;/target_gid&gt;
> &lt;target_urn&gt;urn:publicid:IDN+filab.uni-hannover.de+user+brenton&lt;/target_urn&gt;
> &lt;uuid&gt;5fe195dd-ebd2-11ec-a0f3-ac1f6bb14bf8&lt;/uuid&gt;
> &lt;expires&gt;2022-06-15T11:08:52Z&lt;/expires&gt;
> &lt;privileges&gt;
> &lt;privilege&gt;&lt;name&gt;*&lt;/name&gt;&lt;can_delegate&gt;1&lt;/can_delegate&gt;&lt;/privilege&gt;
> &lt;/privileges&gt;&lt;/credential&gt;
> &lt;signatures&gt;
> &lt;Signature xmlns=&quot;http://www.w3.org/2000/09/xmldsig#&quot; xml:id=&quot;Sig_ref0C7014AA4AFECBB6&quot;&gt;
> &lt;SignedInfo&gt;
> &lt;CanonicalizationMethod Algorithm=&quot;http://www.w3.org/TR/2001/REC-xml-c14n-20010315&quot;/&gt;
> &lt;SignatureMethod Algorithm=&quot;http://www.w3.org/2000/09/xmldsig#rsa-sha1&quot;/&gt;
> &lt;Reference URI=&quot;#ref0C7014AA4AFECBB6&quot;&gt;
> &lt;Transforms&gt;
> &lt;Transform Algorithm=&quot;http://www.w3.org/2000/09/xmldsig#enveloped-signature&quot;/&gt;
> &lt;/Transforms&gt;
> &lt;DigestMethod Algorithm=&quot;http://www.w3.org/2000/09/xmldsig#sha1&quot;/&gt;
> &lt;DigestValue&gt;p3QqoywoNEGxfFmA+gxYYIgABpc=&lt;/DigestValue&gt;
> &lt;/Reference&gt;
> &lt;/SignedInfo&gt;
> &lt;SignatureValue&gt;A5wwC2QOTj25J5pIQNy7i7PF8bJDnXCXTf0964lPgdF/NNLMGxJ78hswDk3gWgYO
> eEilwg6y7XYuTv3QFXQkL44KCIIDBHvX+CfzBPPmOzKRvTtbNojuLvX7zOhRQxOd
> CBNwijagJvuFfWudAk1UY894zWbuWdpN0qyc1KtEaJN7pvVSgvUT/JBXlXObzoPP
> JHJb5hFQI6v8RhaCH8ICnBAkLGZzz/VEUh5ZXDkCTAjQhigNoSu/Mmxp8l5Rr1Cz
> WnguVPB7ohbK7MVfT5yulFSyf3sHzlFuqITf5hGnfVrj/yOOgmgEz9HgUvX0wfN+
> KnbVCLZHz1qCjoEYIQwJfA==&lt;/SignatureValue&gt;
> &lt;KeyInfo&gt;
> &lt;X509Data&gt;
> &lt;X509SubjectName&gt;emailAddress=testb...@filab.uni-hannover.de,CN=517806d6-e70b-11ec-bf71-ac1f6bb14bf8,OU=XXX.sa,O=Future Internet Lab,ST=Niedersachsen,C=DE&lt;/X509SubjectName&gt;
> &lt;X509IssuerSerial&gt;
> &lt;X509IssuerName&gt;emailAddress=testb...@filab.uni-hannover.de,CN=boss.filab.uni-hannover.de,OU=Certificate Authority,O=Future Internet Lab,L=Hannover,ST=Niedersachsen,C=DE&lt;/X509IssuerName&gt;
> &lt;X509SerialNumber&gt;1010&lt;/X509SerialNumber&gt;
> &lt;/X509IssuerSerial&gt;
> &lt;X509Certificate&gt;MIIE2TCCA8GgAwIBAgICA/IwDQYJKoZIhvcNAQEFBQAwgc0xCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMREwDwYDVQQHEwhIYW5ub3ZlcjEcMBoG
> A1UEChMTRnV0dXJlIEludGVybmV0IExhYjEeMBwGA1UECxMVQ2VydGlmaWNhdGUg
> QXV0aG9yaXR5MSMwIQYDVQQDExpib3NzLmZpbGFiLnVuaS1oYW5ub3Zlci5kZTEw
> MC4GCSqGSIb3DQEJARYhdGVzdGJlZC1vcHNAZmlsYWIudW5pLWhhbm5vdmVyLmRl
> MB4XDTIyMDYwODA4MTM1NFoXDTI3MTEyNzA5MTM1NFowgbUxCzAJBgNVBAYTAkRF
> MRYwFAYDVQQIEw1OaWVkZXJzYWNoc2VuMRwwGgYDVQQKExNGdXR1cmUgSW50ZXJu
> ZXQgTGFiMQ8wDQYDVQQLEwZYWFguc2ExLTArBgNVBAMTJDUxNzgwNmQ2LWU3MGIt
> MTFlYy1iZjcxLWFjMWY2YmIxNGJmODEwMC4GCSqGSIb3DQEJARYhdGVzdGJlZC1v
> cHNAZmlsYWIudW5pLWhhbm5vdmVyLmRlMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8A
> MIIBCgKCAQEAwvzqj+A7g3VNPe5zdxbbf/6IMtcRf+V0fSb46MBVPBrpfGUUQK2Q
> L2aNbRSZxrIuuprzSaQXV43m95sisWlUXKzpstiP/teys5+7sR301c2j/tKNL5tP
> JE14UD3gN4XGwh5foqVXwmaX3TTYgBm21+yFiqwEFZV2jbpKZdPHm4MjllaU7QYf
> ebDtiAthJVuE1GZ304kLyo2ckV91Ee+s7T/9GBGPE5BiquJVovuv9f6370ivo7t7
> 44F7ldMeXtJJZWJ3BjgHSoCLi8apUaA7HAAiZq6KqtN0Q8gt2XiomGdGKanUMHbP
> T3E5hdKgExcgTPJftOX2JtSdFuq3wwE8KwIDAQABo4HYMIHVMB0GA1UdDgQWBBTc
> 8XfLYpuBFX1syAVA4do/0BlEwDA+BgNVHREENzA1hjN1cm46cHVibGljaWQ6SURO
> K2ZpbGFiLnVuaS1oYW5ub3Zlci5kZSthdXRob3JpdHkrc2EwDwYDVR0TAQH/BAUw
> AwEB/zBjBggrBgEFBQcBAQRXMFUwUwYUaYPMk4ComMyox72xp4CAqq7XihuGO2h0
> dHBzOi8vd3d3LmZpbGFiLnVuaS1oYW5ub3Zlci5kZToxMjM2OS9wcm90b2dlbmkv
> eG1scnBjL3NhMA0GCSqGSIb3DQEBBQUAA4IBAQCRspps9DBrx4hL7w/3+b23KafK
> azXW2ihUhKTcDCeclXr4LBoebJ7DJ8c2SBHRLWMDstemE+TzitFoVjBmE9u0y+XU
> /zGZ6iLdqZ6E7l74tMtZOqLgIN4RxGsfgtttOjGIsCwHEATDYOily0YRfyqI4CLt
> pxP7Bq59/R1kpG1ih7vKeFWwVpmnkcSB1Vf1UQTGIkLywJEYai0QX+upv/dXCH8t
> kCMQropiUqflluLqtSkhTrpLbtknXZf4RH7oSA+we8B2rnZ+So5//JlKj4E3WPIT
> EkLZMrGX/4qJTlkmZTr7BqrrZ/2PJKz1aF1X70VAKvk3DjViB6kmK+MRMoVr&lt;/X509Certificate&gt;
> &lt;/X509Data&gt;
> &lt;KeyValue&gt;
> &lt;RSAKeyValue&gt;
> &lt;Modulus&gt;
> wvzqj+A7g3VNPe5zdxbbf/6IMtcRf+V0fSb46MBVPBrpfGUUQK2QL2aNbRSZxrIu
> uprzSaQXV43m95sisWlUXKzpstiP/teys5+7sR301c2j/tKNL5tPJE14UD3gN4XG
> wh5foqVXwmaX3TTYgBm21+yFiqwEFZV2jbpKZdPHm4MjllaU7QYfebDtiAthJVuE
> 1GZ304kLyo2ckV91Ee+s7T/9GBGPE5BiquJVovuv9f6370ivo7t744F7ldMeXtJJ
> ZWJ3BjgHSoCLi8apUaA7HAAiZq6KqtN0Q8gt2XiomGdGKanUMHbPT3E5hdKgExcg
> TPJftOX2JtSdFuq3wwE8Kw==
> &lt;/Modulus&gt;
> &lt;Exponent&gt;
> AQAB
> &lt;/Exponent&gt;
> &lt;/RSAKeyValue&gt;
> &lt;/KeyValue&gt;
> &lt;/KeyInfo&gt;
> &lt;/Signature&gt;
> &lt;/signatures&gt;
> &lt;/signed-credential&gt;
> </string></value></data></array></value>
> </member>
> <member><name>slice_urn</name><value><string>urn:publicid:IDN+filab.uni-hannover.de:testbed+slice+vmtest2</string></value></member>
> <member><name>asyncmode</name><value><i4>1</i4></value></member>
> <member><name>keys</name><value><array><data>
> <value><struct>
> <member><name>shell</name><value><string>bash</string></value></member>
> <member><name>privs</name><value><string>root</string></value></member>
> <member><name>urn</name><value><string>urn:publicid:IDN+filab.uni-hannover.de+user+brenton</string></value></member>
> <member><name>keys</name><value><array><data>
> <value><struct>
> <member><name>type</name><value><string>ssh</string></value></member>
> <member><name>key</name><value><string>ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvPX4VZl0yA5TFgKz0y9VUK513C8RksHyhbz2gNFQ2QPo1ELzekW1wVuObErKUDDLxm03TvkzqDv6aod5QFQmHCYLsYgp4ETaOfMGTYQcjd7ENH+sYH5ADxMHEm5lothEmxpQHZP6u3fQEWBclh/G0OFK8OMm8TzGhsYS6tX6o+S/jIzgWk7usu4mDUlPkahpg4DyF1m6lCIlrkPX5Zmx6KqyjkGCg41t5oMx85M4ceXT1scFXY/rZJSpB8LlmhgopKP7Bat57l23fe8B7M+F+fxHZSDZB72ce/RoRMknESY9f9YhsLsh2V5XKw7pAofDvtV0sj5OvrmHmkce/Yy53 brenton@at-1431-bw</string></value></member>
> </struct></value>
> <value><struct>
> <member><name>type</name><value><string>ssh</string></value></member>
> <member><name>key</name><value><string>ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDhVUmN+X1uzuQvWmv8QL6SdEfcc31UBAs/24vPj8tAxLefuExcoZXZCA9KsMs9LYjiOHmmk1iKKEzLAs4YrOJQZY1bEw+kWaHgH0qeYNM5TqV0Bc1AVsfU+l320n0zbo5ddUzcXR1UG0B4gyjc3YJLvyuUAENX2lVQ9nR6QxCyz16SA29mePWM7i+ksKBa9qW6wWyUwwmIFPw7ozAlMqJVTFU0iTG17TofzNXHnbyEG/KPNFMPFPNn+4Kn9mYalhzoUbKsa9cUk+ABwIVEal3wDffBJuQUx8B5hKkOIVlK9X85swLMFdmLRwS05pDdv0n/W9Ta4K3UhX/4Z2NiuFWv r...@filab.uni-hannover.de</string></value></member>
> </struct></value>
> <value><struct>
> <member><name>type</name><value><string>ssh</string></value></member>
> <member><name>key</name><value><string>ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+i8+EPxeGx9TE7wDaSkeF55z/oXVxCrYiU+2iXMvwp2rptmpLJYQsha+gU8iKgEO3+DugnfZgvG6ITUjS0uMZnng0gRi07pJVMPRKH4I9SfSct/hLWK69GheaG9ONspGDbNcI0fZY98MuMcJDiJcTbT96Ajyvw2bSmZyN+T2ocagi+hoC0H+0SUZhgJrtGStaehhBQD+Zl8s4Sd6aigrN48S5SjlM7nqUoLUMQysg8AjImBSkSTheCqJoJZrBjvadXqmpj0ilXP05ZioNkdf4IuFmHJEAvRGgq3msa5rk35hMBhIY+fWLMr69LomYgBO/FHNwSVH3ETwsllajAiuB sslcert:1018</string></value></member>
> </struct></value>
> </data></array></value>
> </member>
> <member><name>login</name><value><string>brenton</string></value></member>
> </struct></value>
> </data></array></value>
> </member>
> </struct></value>
> </param>
> </params>
> </methodCall>
> ';
>
> -------------- Result ------------------
> $VAR1 = 0;
>
> ----------------------------------------
>
> Debugging is on.
> Image rendering proceeding in background mode ...
> TIMESTAMP: 13:09:08:663560 Starting mapper
> TIMESTAMP: 13:09:09:129362 Finished mapper
> ----------------------------------------------
> ---------------- Mapper Log ------------------
> Starting the new and improved mapper wrapper.
> TIMESTAMP: 13:09:09:081219 Create libvtop started
> TIMESTAMP: 13:09:09:105405 Create libvtop ended
> TIMESTAMP: 13:09:09:106309 vtopgen started
> Loading physical info
> Interface Speeds:
> pc5019:ethernet - 1000000
> sim:ethernet - 1000000
> pcvm:ethernet - 1000000
> pc:ethernet - 1000000
> pc2260:ethernet - 1000000
> pc6019:ethernet - 1000000
> Loading virtual nodes
> node1 type:pcvm ips:
> isrem:0 isvirt:1
> *** ERROR: mapper:
> *** Can't call method "DefaultParent" on an undefined value at
> *** /usr/testbed/lib/libvtop_stable.pm line 1455, <DATA> line 2786.
> Forked child returned an error
>
> Debugging is on.

Brenton Walker

unread,
Jun 17, 2022, 9:10:02 AM6/17/22
to emulab-admins
Thank you, with the Xen VMs following your instructions got it working.

For the delay node and tevc issue, using FBSD113-64-STD made it work.  The example script I was using had specified FBSD121 (which I don't have), so at first I tried 123 and 130, which were not cooperating with the tevc commands.

One strange thing, at first FBSD 123 and 130 would at least image and run on the nodes, but since yesterday they fail.  Watching the frisbee output on the console, it's interspersed with errors from imageunzip like:
WARNING: image too large for target slice, truncating
WARNING: partition 'a' too large for slice, truncating
WARNING: partition 'c' too large for slice, truncating

Then when the node boots, it fails because the disk is corrupt.  I've repeated this on several nodes now.  Absolutely puzzled about what I could have done.  Its' not really important, though.  As long as we have a working delay node image.

One other question: when people run boss and ops in VMs, they're talking about FreeBSD Jail, not Xen, right?

Thanks,
Brenton

Leigh Stoller

unread,
Jun 17, 2022, 9:14:54 AM6/17/22
to emulab...@googlegroups.com

> One strange thing, at first FBSD 123 and 130 would at least image and run on the nodes, but since yesterday they fail. Watching the frisbee output on the console, it's interspersed with errors from imageunzip like:
> WARNING: image too large for target slice, truncating
> WARNING: partition 'a' too large for slice, truncating
> WARNING: partition 'c' too large for slice, truncating
>
> Then when the node boots, it fails because the disk is corrupt. I've repeated this on several nodes now. Absolutely puzzled about what I could have done. Its' not really important, though. As long as we have a working delay node image.

Mike is on vacation till next Tuesday, he will have something to say about
this.

>
> One other question: when people run boss and ops in VMs, they're talking about FreeBSD Jail, not Xen, right?

No, this installation type uses Xen VMs. Note that a VM based installation
is good for a cluster with not too many nodes (a few hundred) and not very
busy. Our experience with our clusters is that it does not work well on big
heavily used clusters.

Leigh


Mike Hibler

unread,
Jun 21, 2022, 10:48:46 AM6/21/22
to emulab...@googlegroups.com
I will try to get the FreeBSD confusion fixed up today. We are moving to
standard images with a larger root filesystem, which requires some changes
to the "MFS" infrastructure. I updated the latest FreeBSD images to use
the new larger root filesystem, but I also need to update the downloadable
MFS tarball to reflect the changes.

What is happening to you currently is that frisbee is trying to stuff a
64GB filesystem into a 16GB partition (hence the truncation messages) and
it is working about as well as you would expect. :-)
> --
> You received this message because you are subscribed to the Google Groups
> "emulab-admins" group.
> To unsubscribe from this group and stop receiving emails from it, send an email
> to emulab-admin...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/
> emulab-admins/b34db386-4bef-40f2-aba7-9ac805773be2n%40googlegroups.com.

Mike Hibler

unread,
Jun 21, 2022, 7:14:46 PM6/21/22
to emulab...@googlegroups.com
I have updated the tarball:
https://www.emulab.net/downloads/tftpboot-latest.tar.gz
to include support for the 64GB root FS image. Follow the instructions in:
https://gitlab.flux.utah.edu/emulab/emulab-devel/-/wikis/install/MFS-Import
for upgrading.
> > ifconfig_xn0_alias0="inet 172.17.254.254 netmask 255.240.0.0???
> >
> > ???xn0??? would need to change for your boss. Ditto ops, but use 172.17.253.254
> >
> > Leigh
> >
> >
> >
> > --
> > You received this message because you are subscribed to the Google Groups
> > "emulab-admins" group.
> > To unsubscribe from this group and stop receiving emails from it, send an email
> > to emulab-admin...@googlegroups.com.
> > To view this discussion on the web visit https://groups.google.com/d/msgid/
> > emulab-admins/b34db386-4bef-40f2-aba7-9ac805773be2n%40googlegroups.com.
>
> --
> You received this message because you are subscribed to the Google Groups "emulab-admins" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to emulab-admin...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/emulab-admins/20220621144843.GB16885%40flux.utah.edu.
Reply all
Reply to author
Forward
0 new messages