Does PIO support [ --master yarn --deploy-mode cluster ]?

[wei li]

Hi, all

Any one have any idea about this?

[Pat Ferrel]

Yes PIO support Yarn but you may have more luck getting an explanation on the PredictionIO mailing list.

Subscribe here: http://predictionio.incubator.apache.org/support/

On Nov 9, 2017, at 11:33 PM, wei li <liwei....@gmail.com> wrote:

Hi, all

Any one have any idea about this?

--
You received this message because you are subscribed to the Google Groups "actionml-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to actionml-use...@googlegroups.com.
To post to this group, send email to action...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/actionml-user/af5c6748-ae7f-4c05-bbc5-6dcf6c1a480a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[wei li]

Hi Pat

Thanks a lot for your advice.

We are using [yarn-client] mode now, UR trains well and we can monitor the output log at pio application console.

I tried to find a way to use [yarn-cluster] mode, to submit a train job and shutdown the pio application (in docker) immediately.

(monitor the job process at hadoop culster website instead of pio application console).

But then I met errors like this: file path [file://xxx.jar] can not be found.

Maybe,  [yarn-cluster] mode is not supported now. I will keep looking for the explanation.

在 2017年11月11日星期六 UTC+8上午12:41:33，pat写道：

[Pat Ferrel]

yarn-cluster mode is supported but extra config needs to be set so the driver can be run on a remote machine.

I have seen instructions for this on the PIO mailing list.

To view this discussion on the web visit https://groups.google.com/d/msgid/actionml-user/8668b1a1-09b9-4de8-aedb-5b786a9cf7e4%40googlegroups.com.