Request: Disable Intel VMD on specific sm110p nodes for DAOS server deployment

[Yuan Liang]

Hello,

I’m setting up DAOS on sm110p nodes. DAOS cannot use NVMe devices when they appear under 32-bit PCI domains generated by VMD (e.g., 10000:01:00.0). On the following nodes:

10s10611

10s10607

10s10616

the NVMe controllers still show up as 10000:*, and DAOS server refuses to start with:

"Ignoring PCI device with non-16bit domain.
class nvme requires valid PCI addresses in bdev_list"

Other sm110p nodes have VMD fully off (0000:*) and DAOS works normally.

Could you please fully disable VMD on these three nodes as well?

Thank you.

[Mike Hibler]

Done.

> --
> You received this message because you are subscribed to the Google Groups
> "cloudlab-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email
> to cloudlab-user...@googlegroups.com.
> To view this discussion visit https://groups.google.com/d/msgid/cloudlab-users/
> 7e12105c-4983-44d9-9119-478e8dc1d1a6n%40googlegroups.com.

[Yuan Liang]

Thank you! But it seems those three nodes are still stuck at booting or failing to start. Should I reload them or keep waiting?

Thank you for the help!

[Yuan Liang]

Hello admin,

Could you do the same with the node sm110p-10s10619.wisc.cloudlab.us please? The NVMe addresses on this node are still masked by VMD. 

Thank you!

[Mike Hibler]

Should be fixed. Thanks for letting us know.

> 2b7efc2f-9984-4478-a1ad-201ff87a0e54n%40googlegroups.com.