Spark Cluster Support for Whoosh

[AKASH BAVISKAR]

Hi all,

I am trying to query whoosh on a multinode pyspark cluster. I have written a pandas-udf to search on whoosh index. But I keep getting error whoosh.index.EmptyIndexError: Index 'MAIN' does not exist in FileStorage('whoosh_indexdir/').

I was able to cross-check that the required index files were present in whoosh_indexdir, but still get this error.

Does this mean Whoosh does not have 'Spark Cluster Support'?

Thanks