Spark Cluster Support for Whoosh

22 views
Skip to first unread message

AKASH BAVISKAR

unread,
Oct 22, 2021, 8:10:38 AM10/22/21
to Whoosh
Hi all,
I am trying to query whoosh on a multinode pyspark cluster. I have written a pandas-udf to search on whoosh index. But I keep getting error whoosh.index.EmptyIndexError: Index 'MAIN' does not exist in FileStorage('whoosh_indexdir/').
I was able to cross-check that the required index files were present in whoosh_indexdir, but still get this error.

Does this mean Whoosh does not have 'Spark Cluster Support'?

Thanks
 
Reply all
Reply to author
Forward
0 new messages