Dependency isn't visible in the notebook

[Alex Ott]

Hello

I'm experimenting with the spark-notebook, and trying to use the spark-solr package using the dependency: com.lucidworks.spark % spark-solr % 2.0.1

I check that the dependency is really downloaded (I removed the local repo, wait until everything is downloaded to be sure that jar is in place).

But when I do the import with

import com.lucidworks.spark.analysis.LuceneTextAnalyzer

Then I get error:

<console>:57: error: object lucidworks is not a member of package com
import com.lucidworks.spark.analysis.LuceneTextAnalyzer

I checked that this class in the jar, and package is correct...

The only errors that I see in the log is:

2016-05-25 14:42:04,385 ERROR [Remote-akka.actor.default-dispatcher-6] (SBT downloads) - org.apache.commons#commons-compress;1.4.1!commons-compress.jar origin location must be absolute: file:/home/ott/.m2/repository/org/apache/commons/commons-compress/1.4.1/commons-compress-1.4.1.jar
2016-05-25 14:42:04,386 ERROR [Remote-akka.actor.default-dispatcher-6] (SBT downloads) - Tracing error in SBT

But I see the corresponding artifact in the local repository, so I don't understand this error...

I'm using Spark Notebook 0.6.3 with Scala [2.10.5] Spark [1.6.0] Hadoop [2.6.0-cdh5.7.0] {Hive ✓} {Parquet ✓}


How I can debug such kind of problems?

Thank you

P.S. It would be also nice to see the progress of the downloading of dependencies that are specified in the notebook configuration - for some dependencies this may take some time, and it's not obvious that downloading happens.