Re: What is the plan to get the "commoncrawl-0.1-nolibs.jar" dependency?

29 views
Skip to first unread message

DigitalPebble

unread,
Feb 22, 2013, 8:58:25 AM2/22/13
to digita...@googlegroups.com
Hi Peter

This is more a question for Grant as this dependency is not part of Behemoth per-se but specific to his repository and I am not sure that the missing jar is compatible with the one we have in the common crawl module of Behemoth.

The LucidImagination people have opened a new repository with their SOLR related code for Behemoth on https://github.com/lucidimagination/behemoth-lws, which is much cleaner as they don't need to duplicate the code in Behemoth anymore and can rely on the artefacts published in Maven instead. You should be able to use the version Behemoth from the DigitalPebble repo for its non-SOLR modules and behemoth-lws  separately.

Hope it helps

Julien

-- 
 
Open Source Solutions for Text Engineering
 

On 22 February 2013 13:47, spex66 <spe...@gmail.com> wrote:
Hi experts,

I'm trying to compile behemoth from https://github.com/gsingers/behemoth (master branch with Solr41 support)

There is a dependency in "behemoth/io/pom.xml"

    <!-- Common Crawl deps -->
    <dependency>
          <groupId>org.commoncrawl</groupId>
          <version>0.1-nolibs</version>
          <artifactId>commoncrawl</artifactId>
      <scope>system</scope>
      <systemPath>${basedir}/lib/commoncrawl-0.1-nolibs.jar</systemPath>
    </dependency>

This means that the lib needs to be there before compilation.
the
But Google didn't helped me that time to figure out, where I get 
"commoncrawl-0.1-nolibs.jar"

Maybe from "behemoth-commoncrawl / lib"?!?

Thank you for hints

cheers
Peter
(=PA=)

--
You received this message because you are subscribed to the Google Groups "DigitalPebble" group.
To unsubscribe from this group and stop receiving emails from it, send an email to digitalpebbl...@googlegroups.com.
To post to this group, send an email to digita...@googlegroups.com.
Visit this group at http://groups.google.com/group/digitalpebble?hl=en-GB.
For more options, visit https://groups.google.com/groups/opt_out.
 
 


spex66

unread,
Mar 1, 2013, 3:02:00 AM3/1/13
to digita...@googlegroups.com, jul...@digitalpebble.com
Thank you Julien for that information.
I will test that route... but in the meantime, Hadoop compilation on Windows gives me serious headaches...
regards
Peter
(=PA=)
Reply all
Reply to author
Forward
0 new messages