Multiuser environment and Slurm

[Pragnesh P]

Hi, 

I have two questions about mlflow. 

Is it possible to use mlflow for multiuser environment ? How they can access gui running their own experiments ? 

Is there a way to integrate slurm job manager in mlflow ? 

Please let me know. Thank you. 

[Aaron Davidson]

MLflow can definitely be used in multiuser environments. For these, simply stand up a hosted tracking server, and point all users at the same one (and users can manage or share experiments).

Since MLflow is API-based, I think you can simply use MLflow within a Slurm scheduler, and that would create runs appropriately within MLflow. Do you foresee some issue with that approach?

--
You received this message because you are subscribed to the Google Groups "mlflow-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mlflow-users...@googlegroups.com.
To post to this group, send email to mlflow...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/mlflow-users/4c33ab2a-c9ca-4820-ae68-74257beaca24%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Pragnesh P]

Hi Aaron, 

Thank you for quick response. I am looking into Hosted Tracking Server. How does authentication system work in it ? 

For Slurm and MLflow, my understanding is that there should be an interface in MLflow that can use underlying resource managers such as slurm, PBS or others. 

Has anyone tried to use any of resource manager with MLflow ? 

pragnesh

[Aaron Davidson]

Currently, authentication is expected to be handled outside of MLflow -- that is, by setting up an nginx server or OAuth proxy server in front of MLflow.

On the Slurm side, unfortunately I am not familiar enough to say how that integration might work.

To view this discussion on the web visit https://groups.google.com/d/msgid/mlflow-users/cd07b4e2-61d7-43cf-94f9-24388b339348%40googlegroups.com.