Where is the Dockerfile for elyra/spark-py ?

[ray.h...@eliiza.com.au]

I'd like to customize the spark-based kernels for enterprise gateway to have more support libraries (i.e. S3) - but unsure where the base image's dockerfile is. 

Can anyone shed some light?

Ray

[Kevin Bates]

Hi Ray.  The image was built using the `bin/docker-image-tool.sh` script straight out of the Apache spark repo.  So the dockerfiles for scala, python and R will be located in https://github.com/apache/spark/tree/master/resource-managers/kubernetes/docker/src/main/dockerfiles/spark and the `bindings` subdirectories.  I'll go ahead and update the docker hub description with the dockerfile locations, but the script may be doing some additional massaging.

Also note that issue https://github.com/jupyter/enterprise_gateway/issues/522 will be visiting this topic so please comment on that issue if there's anything you feel should be generally available.

Thanks.