[slurm-users] detailed worker state with sinfo

1,842 views
Skip to first unread message

z1...@arcor.de

unread,
Jun 26, 2022, 8:34:39 AM6/26/22
to slurm-users
Hello,

if I call "sinfo -o %all", the worker state includes only a single state
word like "DRNG".

It is clearer in the slurm database:
ALLOCATED + DRAIN = DRNG, compared to the db entry.

Where can I get a list of what all the sinfo state names mean compared
to the database?

MIX + DRAIN = ?
IDLE + DRAIN = ?
...


Regards,
Mike


Brian Andrus

unread,
Jun 26, 2022, 9:37:26 AM6/26/22
to slurm...@lists.schedmd.com

Mike,

There are not such differences for draining nodes.

DRNG = Draining

DRAIN = Drained

So if a node is not fully drained yet, it is draining

It would never be IDLE + DRAINING because it can immediately become drained.

STATE
State of the nodes. Possible states include: allocated, completing, down, drained, draining, fail, failing, future, idle, maint, mixed, perfctrs, planned, power_down, power_up, reserved, and unknown. Their abbreviated forms are: alloc, comp, down, drain, drng, fail, failg, futr, idle, maint, mix, npc, plnd, pow_dn, pow_up, resv, and unk respectively.

NOTE: The suffix "*" identifies nodes that are presently not responding.

Brian Andrus

Guillaume COCHARD

unread,
Jun 27, 2022, 3:06:28 AM6/27/22
to Slurm User Community List
Hello,

You can use `scontrol show nodes` (for all nodes) or `scontrol show node <nodename(s)>` (for one or more nodes).

For example :

```
$ scontrol show node node0001
NodeName=node0001 Arch=x86_64
[…]
   State=DOWN+DRAIN+NOT_RESPONDING
[…]
```

With that it would be quite easy to write a small script if you want a specific output.

Regards,
Guillaume


De: "Brian Andrus" <toom...@gmail.com>
À: slurm...@lists.schedmd.com
Envoyé: Dimanche 26 Juin 2022 15:36:53
Objet: Re: [slurm-users] detailed worker state with sinfo

mercan

unread,
Jun 27, 2022, 3:24:13 AM6/27/22
to Slurm User Community List, z1...@arcor.de
Hi;

You can look the slurm code for information.

https://github.com/SchedMD/slurm/blob/master/src/common/slurm_protocol_defs.c#L3838

The "ALLOCATED + DRAIN" and  "MIX + DRAIN" are same. Others are
different. Also There are some other flags which can change status keywords.

Regards;

Ahmet M.
Reply all
Reply to author
Forward
0 new messages