Model-Parallel Layout in Mesh-Tensorflow

[Suhas Shekhar]

I am trying to understand the mesh shape and layout rules. The paper talks about splitting the model in the hidden layer for model parallelization. And the example provided has one hidden layer. How to specify the layout for multiple hidden layers? My assumption is, it is enough to provide one layer of the model for the layout rules and the rest of the layer will be split accordingly. Is it a right assumption? Also, could anyone provide an example of the layout for CNN with multiple layers?

Thank you.

[Praneet]

+1, looking for answer/

Thanks you