Hi,
What does the parameter add_jars in the sc constructor exactly do?
Does it add all the files to the classpath of worker JVM?
I have some text files that I read data from while processing.
Can I add it in add jars so that it doesn't have to read it again from HDFS and read from local (Something like Distributed Cache in Hadoop Mapreduce). What path would I read it from?