Unable to start experiment with two c4130 nodes in CloudLab Wisconsin

37 views
Skip to first unread message

Jinghua Wang

unread,
Aug 17, 2026, 1:20:15 PM (3 days ago) Aug 17
to cloudlab-users
Hello CloudLab Admins,

I have an active reservation of 2x c4130 nodes in CloudLab Wisconsin starting this morning (started around 2 hours ago). However, when I try to start an experiment with these two nodes, in the experiment status page I'm seeing this error below:

--------------------------------------
** Resource reservation violation: 2 nodes of type c4130 requested, but only 0 available because of existing resource reservations to other projects or users. TIMESTAMP: 12:01:20:872083 Released the mapper lock after RunAssign1 Unable to map all resources, but since the project has all of the resources reserved, we will keep trying until you delete the resources or terminate the experiment  
--------------------------------------
My reservation of 2x c4130 nodes was created in July 22, and it has been approved. The experiment stayed in pending state for >1h. Could you please take a look at my experiment page (https://www.cloudlab.us/status.php?uuid=b905bcb9-a3f2-490e-a157-5c640a836ab6) and help me fix the nodes pending/unavailable issue? 

Thank you very much!

Jinghua Wang

cloudlab-users

unread,
Aug 17, 2026, 3:17:21 PM (2 days ago) Aug 17
to cloudlab-users
[ Sorry, I responded but my mail doesn't seem to be getting out of the University. ]
The gist is: we have a c4130 node with hardware problems that is out of service and that is preventing you from creating your two node experiment.
I believe that it is going to need a motherboard replacement, so it is going to be out of service for awhile. There is one node available for you, but 
presumably that will not let you do what you need to do. You will have to schedule a new reservation for the future to get two nodes.

Sorry about that, and sorry for the late reply.

Jinghua Wang

unread,
Aug 17, 2026, 4:09:31 PM (2 days ago) Aug 17
to cloudlab-users
I see. Thank you for the reply! 

Jinghua

cloudlab-users

unread,
Aug 17, 2026, 7:22:34 PM (2 days ago) Aug 17
to cloudlab-users
The problem with the out-of-service c4130 node proved to be software and not hardware. It should be available for
allocation once more. Try to start your two node experiment again.

Jinghua Wang

unread,
Aug 17, 2026, 7:26:31 PM (2 days ago) Aug 17
to cloudlab-users
Great! I'll terminate my current experiment and start a new two c4130 experiment later today. Thank you very much for your help!

Jinghua

Jinghua Wang

unread,
Aug 18, 2026, 11:20:14 PM (2 days ago) Aug 18
to cloudlab-users
Update: Today I rebooted the node "c4130-110433" after installing NVIDIA GPU driver, and after reboot I see the 100Gbps NIC disappeared in "lspci" from this node, and this node left the experimental network. I rebooted this node again in Recovery mode but it didn't help. Is this "c4130-110433" node the problematic "c4130" node we discussed earlier this week? Could you please take a look at this node again regarding if this is a software issue or a hardware error? Thanks! 

Mike Hibler

unread,
Aug 19, 2026, 9:20:41 PM (5 hours ago) Aug 19
to cloudla...@googlegroups.com
We are having a reservation overbook problem due to a failed node. I will
try to resolve this in a little while.
> --
> You received this message because you are subscribed to the Google Groups
> "cloudlab-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email
> to cloudlab-user...@googlegroups.com.
> To view this discussion visit https://groups.google.com/d/msgid/cloudlab-users/
> 52a596bd-e62f-4b1f-b3d3-38631d8376aan%40googlegroups.com.

Mike Hibler

unread,
Aug 19, 2026, 9:20:41 PM (5 hours ago) Aug 19
to cloudla...@googlegroups.com
Unfortunately, it appears you will only be able to get one node right now.
The second node is having hardware problems. I will see if there is anything
that the Wisconsin people can do to expedite a fix.

On Mon, Aug 17, 2026 at 10:20:15AM -0700, Jinghua Wang wrote:
Reply all
Reply to author
Forward
0 new messages