Spark-DL correct version

[THIAM HUAT TAN]

according to https://github.com/databricks/spark-deep-learning

can I know what is the working version of spark-deep-learning package to install for below purpose? It looks all confusing to me.

I had spark-deep-learning:1.4.0-spark2.4-s_2.11 installed, but below 3 lines will not work:

img_dir = '/FileStore/tables/deep-learning-images/'

from sparkdl import readImages

image_df = readImages(img_dir)

which I had to change to below for it to work:

from pyspark.ml.image import ImageSchema

image_df = ImageSchema.readImages(img_dir)

And below

from sparkdl import DeepImageFeaturizer

gives persistent error of:

AttributeError: module 'sparkdl' has no attribute 'graph'

I am running the above code in DataBricks environment itself