[Testbed-admins] exp with more than 5 nodes fail to swap in...

6 views

Skip to first unread message

Eric Hall

unread,

Nov 19, 2008, 5:23:34 PM11/19/08

to Emulab-derived testbed admins/operators

Experiments with more than five nodes fail to swap in (as seen below.)

I don't see how this failure meets the definition of "no_connect" as
found at http://www.isislab.vanderbilt.edu/kb-show.php3?xref_tag=assignfail

Any advice about what to investigate appreciated,
--
Eric

-=-=-=
# This is a simple ns script that demonstrates loops.
set ns [new Simulator]
source tb_compat.tcl

set controller [$ns node]
set tracker [$ns node]
set broker [$ns node]
set pub [$ns node]
set sub [$ns node]
set sub1 [$ns node]
set sub2 [$ns node]
set sub3 [$ns node]

# Put all the nodes in a lan
#set link0 [$ns duplex-link $broker $pub 1000Mb 0ms DropTail]

#set lan [$ns make-lan "$broker $tracker $controller $pub $sub $sub1
$sub2 $sub3" 1000Mb 0ms]
set lan [$ns make-lan "$broker $tracker $controller $pub $sub $sub1
$sub2 $sub3" 1000Mb 0ms]

#tb-set-noshaping $lan 1

$ns rtproto Static

# Go!
$ns run

-------- Original Message --------
Subject: ISISLAB.VANDERBILT.EDU: Swap in Failure: Temp Resource
Shortage: testproj/testexp2
Date: Wed, 19 Nov 2008 15:56:55 -0600 (CST)
From: Testbed Ops <testb...@isis.vanderbilt.edu>
To: Eric Hall <eric...@vanderbilt.edu>
CC: Eric Hall <eric...@vanderbilt.edu>

Failed to find a set of physical testbed nodes to run your experiment
on. This might mean that there are not enough nodes or switch resources
free, or your experiment might require certain hardware which is not
available. If you believe this message is in error, contact
testb...@isis.vanderbilt.edu.

Type precheck passed.
Node mapping precheck succeeded
Pruning pclasses.
pclass pruning complete: removed 2 pclasses, 14 remain.
Type precheck passed.
Annealing.
Doing melting run
Reverting: forced
Reverting to best solution
Done
BEST SCORE: 9.8 in 25000 iters and 0.357627 seconds
unassigned: 0
pnode_load: 0
no_connect: 3
link_users: 0
bandwidth: 0
desires: 0
vclass: 0
delay: 0
trivial mix: 0
subnodes: 0
max_types: 0
endpoints: 0

Please take a look at this Knowledge Base entry for hints on what to do:

http://www.isislab.vanderbilt.edu/kb-show.php3?xref_tag=no_resources

--------- /usr/testbed/expwork/testproj/testexp2/swapexp.55xS8E --------
Running 'tbswap in testproj testexp2'
Beginning swap-in for testproj/testexp2 (82). 11/19/2008 15:56:28
TIMESTAMP: 15:56:28:274139 tbswap in started
Checking with Admission Control ...
Mapping to physical reality ...
TIMESTAMP: 15:56:28:290009 assign_wrapper started
assign_wrapper improved started
TIMESTAMP: 15:56:28:637723 assign_wrapper started
TIMESTAMP: 15:56:28:639168 TOP started
Resetting DB before updating.
opened topfile
Minimum nodes = 8
Maximum nodes = 8
TIMESTAMP: 15:56:28:679735 TOP finished
TIMESTAMP: 15:56:28:680905 assign_loop started
Assign Run 1
TIMESTAMP: 15:56:28:683103 ptopgen started
ptopargs -p testproj -e testexp2
TIMESTAMP: 15:56:29:272020 ptopgen finished
TIMESTAMP: 15:56:29:275476 assign started
assign -P testproj-testexp2-66402.ptop testproj-testexp2-66402.top
ASSIGN FAILED:
Type precheck passed.
Node mapping precheck succeeded
Pruning pclasses.
pclass pruning complete: removed 2 pclasses, 14 remain.
Type precheck passed.
Annealing.
Doing melting run
Reverting: forced
Reverting to best solution
Done
BEST SCORE: 8.7 in 23000 iters and 0.303056 seconds
unassigned: 2
pnode_load: 0
no_connect: 0
link_users: 0
bandwidth: 0
desires: 0
vclass: 0
delay: 0
trivial mix: 0
subnodes: 0
max_types: 0
endpoints: 0
Trying assign on an empty testbed.
TIMESTAMP: 15:56:31:292495 ptopgen started
ptopargs -p testproj -e testexp2 -a
TIMESTAMP: 15:56:31:881907 ptopgen finished
TIMESTAMP: 15:56:31:885250 assign started
assign -n -P testproj-testexp2-66402-empty.ptop testproj-testexp2-66402.top
Precheck succeeded.
Assign succeeded on an empty testbed.
Waiting 5 seconds and trying again...
Assign Run 2
TIMESTAMP: 15:56:38:905020 ptopgen started
ptopargs -p testproj -e testexp2
TIMESTAMP: 15:56:39:493702 ptopgen finished
TIMESTAMP: 15:56:39:497028 assign started
assign -P testproj-testexp2-66402.ptop testproj-testexp2-66402.top
ASSIGN FAILED:
Type precheck passed.
Node mapping precheck succeeded
Pruning pclasses.
pclass pruning complete: removed 2 pclasses, 14 remain.
Type precheck passed.
Annealing.
Doing melting run
Reverting: forced
Reverting to best solution
Done
BEST SCORE: 9.8 in 25000 iters and 0.358707 seconds
unassigned: 0
pnode_load: 0
no_connect: 3
link_users: 0
bandwidth: 0
desires: 0
vclass: 0
delay: 0
trivial mix: 0
subnodes: 0
max_types: 0
endpoints: 0
Waiting 5 seconds and trying again...
Assign Run 3
TIMESTAMP: 15:56:46:515678 ptopgen started
ptopargs -p testproj -e testexp2
TIMESTAMP: 15:56:47:103611 ptopgen finished
TIMESTAMP: 15:56:47:107013 assign started
assign -P testproj-testexp2-66402.ptop testproj-testexp2-66402.top
ASSIGN FAILED:
Type precheck passed.
Node mapping precheck succeeded
Pruning pclasses.
pclass pruning complete: removed 2 pclasses, 14 remain.
Type precheck passed.
Annealing.
Doing melting run
Reverting: forced
Reverting to best solution
Done
BEST SCORE: 9.8 in 25000 iters and 0.357627 seconds
unassigned: 0
pnode_load: 0
no_connect: 3
link_users: 0
bandwidth: 0
desires: 0
vclass: 0
delay: 0
trivial mix: 0
subnodes: 0
max_types: 0
endpoints: 0
*** ERROR: assign_wrapper: Reached run limit. Giving up.
*** ERROR: tbswap: Failed (65) to map to reality.
Cleaning up after errors.
Stopping the event system
TIMESTAMP: 15:56:50:776448 snmpit started
Removing VLANs.
TIMESTAMP: 15:56:51:630397 snmpit finished
Tearing down virtual nodes.
TIMESTAMP: 15:56:51:635736 vnode_setup -k started
*** /usr/testbed/sbin/vnode_setup:
No allocated nodes in experiment testproj/testexp2!
TIMESTAMP: 15:56:52:122741 vnode_setup finished
Freeing nodes.
TIMESTAMP: 15:56:52:128011 nfree started
Releasing all nodes from experiment 'testexp2' in project 'testproj'.
TIMESTAMP: 15:56:52:615180 nfree finished
Resetting named maps.
TIMESTAMP: 15:56:52:621756 named started
TIMESTAMP: 15:56:53:202996 named finished
Resetting email lists.
TIMESTAMP: 15:56:53:208051 genelists started
TIMESTAMP: 15:56:54:952006 genelists finished
Resetting DB.
Failingly finished swap-in for testproj/testexp2. 15:56:54:960828
TIMESTAMP: 15:56:54:962165 tbswap in finished (failed)
*** ERROR: swapexp: tbswap in failed!
Cleaning up and exiting with status 1 ...
**** Experimental information, please ignore ****
Session ID = 2172754
Likely Cause of the Problem:
Failed to find a set of physical testbed nodes to run your experiment
on. This might mean that there are not enough nodes or switch resources
free, or your experiment might require certain hardware which is not
available. If you believe this message is in error, contact
testb...@isis.vanderbilt.edu.

Reply all

Reply to author

Forward

0 new messages