Avro dependencies in cdh3

47 views
Skip to first unread message

Alex Cozzi

unread,
Apr 12, 2013, 12:16:58 PM4/12/13
to scoob...@googlegroups.com
I believe that in


this dependency is wrong:

<dependency>
<groupId>org.apache.avro</groupId>
<artifactId>avro-mapred</artifactId>
<version>1.7.4</version>
<classifier>hadoop2</classifier>
</dependency>

the hadoop2 version is for cdh4. I think the fix is simply removing "hadoop2" from the project/build.scala file on the cdh3 branch:

     Seq(
      "javassist"                %  "javassist"                 % "3.12.1.GA",
      "org.apache.avro"          %  "avro-mapred"               % "1.7.4",
      "org.apache.avro"          %  "avro"                      % "1.7.4",
      "com.thoughtworks.xstream" %  "xstream"                   % "1.4.4"            intransitive(),
      "com.googlecode.kiama"     %% "kiama"                     % "1.5.0-SNAPSHOT",

Eric Torreborre

unread,
Apr 12, 2013, 11:24:28 PM4/12/13
to scoob...@googlegroups.com
Right, sorry about that I need to amend our publication script. I will do it on Monday.

E.

Eric Torreborre

unread,
Apr 14, 2013, 9:56:02 PM4/14/13
to scoob...@googlegroups.com
I have fixed the build now, the new CDH3 jar/pom should be republished by Jenkins soon.

E.

On Saturday, April 13, 2013 2:16:58 AM UTC+10, Alex Cozzi wrote:

Alex Cozzi

unread,
Apr 16, 2013, 12:08:05 PM4/16/13
to scoob...@googlegroups.com
I think that the version published with date 4/15 has still "hadoop2"

Eric Torreborre

unread,
Apr 17, 2013, 2:45:18 AM4/17/13
to scoob...@googlegroups.com
Thanks Alex for noticing this, the release process for cdh3 was still not doing the right thing for an unknown reason. I tweaked things a little bit and now it's fine:

Alex Cozzi

unread,
Apr 17, 2013, 5:17:09 PM4/17/13
to scoob...@googlegroups.com
Thanks! 
Works now. BTW: we switched many of our jobs over to scoobi 0.7-SNAPSHOT/ scala 2.10 and so far we did not encounter any problem. Great work!
Alex

Eric Torreborre

unread,
Apr 17, 2013, 6:54:46 PM4/17/13
to scoob...@googlegroups.com
That's really good news! I hope we can have a RC1 soon.

E.
Reply all
Reply to author
Forward
0 new messages