mongo-hadoop adapter - Build failing

245 views

Skip to first unread message

Raghu

unread,

Mar 12, 2012, 6:55:55 AM3/12/12

to mongodb-user

I am trying to build mongo-hadoop adapter for CDH3 settings using the
command:

./sbt package

I am getting the following error:

[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/mongodb/mongo-
java-driver/2.7.3/mongo-java-driver-2.7.3.pom
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/mongodb/mongo-
java-driver/2.7.3/mongo-java-driver-2.7.3.jar
[info] Resolving org.apache.hadoop#hadoop-core;0.20.2-cdh3u3 ...
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/apache/hadoop/
hadoop-core/0.20.2-cdh3u3/hadoop-core-0.20.2-cdh3u3.pom
[error] Server access Error: Connection timed out url=https://
oss.sonatype.org/content/repositories/releases/org/apache/hadoop/
hadoop-core/0.20.2-cdh3u3/hadoop-core-0.20.2-cdh3u3.pom
[warn] module not found: org.apache.hadoop#hadoop-core;0.20.2-cdh3u3
[warn] ==== local: tried
[warn] /data/raghu/.ivy2/local/org.apache.hadoop/hadoop-core/0.20.2-
cdh3u3/ivys/ivy.xml
[warn] ==== Simile Repo at MIT: tried
[warn] http://simile.mit.edu/maven/org/apache/hadoop/hadoop-core/0.20.2-cdh3u3/hadoop-core-0.20.2-cdh3u3.pom
[warn] ==== Cloudera Repository: tried
[warn]
https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/hadoop/hadoop-core/0.20.2-cdh3u3/hadoop-core-0.20.2-cdh3u3.pom
[warn] ==== Maven.Org Repository: tried
[warn] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.20.2-cdh3u3/hadoop-core-0.20.2-cdh3u3.pom
[warn] ==== releases: tried
[warn]
https://oss.sonatype.org/content/repositories/releases/org/apache/hadoop/hadoop-core/0.20.2-cdh3u3/hadoop-core-0.20.2-cdh3u3.pom
[warn] ==== public: tried
[warn] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.20.2-cdh3u3/hadoop-core-0.20.2-cdh3u3.pom
[warn] ==== Scala-Tools Maven2 Repository: tried
[warn] http://scala-tools.org/repo-releases/org/apache/hadoop/hadoop-core/0.20.2-cdh3u3/hadoop-core-0.20.2-cdh3u3.pom
[info] Resolving org.apache.hadoop#hadoop-hdfs;0.20.2-cdh3u3 ...
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/apache/hadoop/
hadoop-hdfs/0.20.2-cdh3u3/hadoop-hdfs-0.20.2-cdh3u3.pom
[error] Server access Error: Connection timed out url=https://
oss.sonatype.org/content/repositories/releases/org/apache/hadoop/
hadoop-hdfs/0.20.2-cdh3u3/hadoop-hdfs-0.20.2-cdh3u3.pom
[warn] module not found: org.apache.hadoop#hadoop-hdfs;0.20.2-cdh3u3
[warn] ==== local: tried
[warn] /data/raghu/.ivy2/local/org.apache.hadoop/hadoop-hdfs/0.20.2-
cdh3u3/ivys/ivy.xml
[warn] ==== Simile Repo at MIT: tried
[warn] http://simile.mit.edu/maven/org/apache/hadoop/hadoop-hdfs/0.20.2-cdh3u3/hadoop-hdfs-0.20.2-cdh3u3.pom
[warn] ==== Cloudera Repository: tried
[warn]
https://repository.cloudera.com/artifactory/cloudera-repos/org/apache/hadoop/hadoop-hdfs/0.20.2-cdh3u3/hadoop-hdfs-0.20.2-cdh3u3.pom
[warn] ==== Maven.Org Repository: tried
[warn] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.20.2-cdh3u3/hadoop-hdfs-0.20.2-cdh3u3.pom
[warn] ==== releases: tried
[warn]
https://oss.sonatype.org/content/repositories/releases/org/apache/hadoop/hadoop-hdfs/0.20.2-cdh3u3/hadoop-hdfs-0.20.2-cdh3u3.pom
[warn] ==== public: tried
[warn] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.20.2-cdh3u3/hadoop-hdfs-0.20.2-cdh3u3.pom
[warn] ==== Scala-Tools Maven2 Repository: tried
[warn] http://scala-tools.org/repo-releases/org/apache/hadoop/hadoop-hdfs/0.20.2-cdh3u3/hadoop-hdfs-0.20.2-cdh3u3.pom
[info] Resolving org.scala-lang#scala-library;2.9.1 ...
[info] Resolving junit#junit;4.10 ...
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/junit/junit/4.10/
junit-4.10.pom
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/junit/junit/4.10/
junit-4.10.jar
[info] Resolving org.hamcrest#hamcrest-core;1.1 ...
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/hamcrest/
hamcrest-core/1.1/hamcrest-core-1.1.pom
[info] Resolving org.hamcrest#hamcrest-parent;1.1 ...
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/hamcrest/
hamcrest-parent/1.1/hamcrest-parent-1.1.pom
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/hamcrest/
hamcrest-parent/1.1/hamcrest-parent-1.1.jar
[error] Server access Error: Connection timed out url=https://
oss.sonatype.org/content/repositories/releases/org/hamcrest/hamcrest-
parent/1.1/hamcrest-parent-1.1.jar
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/hamcrest/
hamcrest-core/1.1/hamcrest-core-1.1.jar
[info] Resolving org.specs2#specs2_2.9.1;1.7.1 ...
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/specs2/
specs2_2.9.1/1.7.1/specs2_2.9.1-1.7.1.pom
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/specs2/
specs2_2.9.1/1.7.1/specs2_2.9.1-1.7.1.jar
[info] Resolving org.specs2#specs2-scalaz-core_2.9.1;6.0.1 ...
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/specs2/specs2-
scalaz-core_2.9.1/6.0.1/specs2-scalaz-core_2.9.1-6.0.1.pom
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/org/specs2/specs2-
scalaz-core_2.9.1/6.0.1/specs2-scalaz-core_2.9.1-6.0.1.jar
[info] downloading http://repo1.maven.org/maven2/org/mongodb/mongo-java-driver/2.7.3/mongo-java-driver-2.7.3.jar
...
[info] [SUCCESSFUL ] org.mongodb#mongo-java-driver;2.7.3!mongo-java-
driver.jar (495ms)
[info] downloading http://repo1.maven.org/maven2/junit/junit/4.10/junit-4.10.jar
...
[info] [SUCCESSFUL ] junit#junit;4.10!junit.jar (1118ms)
[info] downloading http://repo1.maven.org/maven2/org/specs2/specs2_2.9.1/1.7.1/specs2_2.9.1-1.7.1.jar
...
[info] [SUCCESSFUL ] org.specs2#specs2_2.9.1;1.7.1!specs2_2.9.1.jar
(10528ms)
[info] downloading http://repo1.maven.org/maven2/org/hamcrest/hamcrest-core/1.1/hamcrest-core-1.1.jar
...
[info] [SUCCESSFUL ] org.hamcrest#hamcrest-core;1.1!hamcrest-core.jar
(461ms)
[info] downloading
http://repo1.maven.org/maven2/org/specs2/specs2-scalaz-core_2.9.1/6.0.1/specs2-scalaz-core_2.9.1-6.0.1.jar
...
[info] [SUCCESSFUL ] org.specs2#specs2-scalaz-core_2.9.1;6.0.1!specs2-
scalaz-core_2.9.1.jar (3510ms)
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: org.apache.hadoop#hadoop-core;0.20.2-cdh3u3: not found
[warn] :: org.apache.hadoop#hadoop-hdfs;0.20.2-cdh3u3: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[info] Resolving org.scala-lang#scala-library;2.9.1 ...
[info] Done updating.
[info] Resolving org.mongodb#mongo-java-driver;2.7.3 ...
[info] Resolving com.cloudera#flume-core;0.9.4-cdh3u3 ...
[error] Server access Error: Connection timed out url=https://
repository.cloudera.com/artifactory/cloudera-repos/com/cloudera/flume-
core/0.9.4-cdh3u3/flume-core-0.9.4-cdh3u3.pom
[error] Server access Error: Connection timed out url=https://
oss.sonatype.org/content/repositories/releases/com/cloudera/flume-core/
0.9.4-cdh3u3/flume-core-0.9.4-cdh3u3.pom
[warn] module not found: com.cloudera#flume-core;0.9.4-cdh3u3
[warn] ==== local: tried
[warn] /data/raghu/.ivy2/local/com.cloudera/flume-core/0.9.4-cdh3u3/
ivys/ivy.xml
[warn] ==== Simile Repo at MIT: tried
[warn] http://simile.mit.edu/maven/com/cloudera/flume-core/0.9.4-cdh3u3/flume-core-0.9.4-cdh3u3.pom
[warn] ==== Cloudera Repository: tried
[warn] https://repository.cloudera.com/artifactory/cloudera-repos/com/cloudera/flume-core/0.9.4-cdh3u3/flume-core-0.9.4-cdh3u3.pom
[warn] ==== Maven.Org Repository: tried
[warn] http://repo1.maven.org/maven2/com/cloudera/flume-core/0.9.4-cdh3u3/flume-core-0.9.4-cdh3u3.pom
[warn] ==== releases: tried
[warn] https://oss.sonatype.org/content/repositories/releases/com/cloudera/flume-core/0.9.4-cdh3u3/flume-core-0.9.4-cdh3u3.pom
[warn] ==== public: tried
[warn] http://repo1.maven.org/maven2/com/cloudera/flume-core/0.9.4-cdh3u3/flume-core-0.9.4-cdh3u3.pom
[warn] ==== Scala-Tools Maven2 Repository: tried
[warn] http://scala-tools.org/repo-releases/com/cloudera/flume-core/0.9.4-cdh3u3/flume-core-0.9.4-cdh3u3.pom
[info] Resolving org.scala-lang#scala-library;2.9.1 ...
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: UNRESOLVED DEPENDENCIES ::
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[warn] :: com.cloudera#flume-core;0.9.4-cdh3u3: not found
[warn] ::::::::::::::::::::::::::::::::::::::::::::::
[error] {file:/data/raghu/MongoDB/mongo-hadoop/}mongo-flume/*:update:
sbt.ResolveException: unresolved dependency: com.cloudera#flume-core;
0.9.4-cdh3u3: not found
[error] {file:/data/raghu/MongoDB/mongo-hadoop/}mongo-hadoop-core/
*:update: sbt.ResolveException: unresolved dependency:
org.apache.hadoop#hadoop-core;0.20.2-cdh3u3: not found
[error] unresolved dependency: org.apache.hadoop#hadoop-hdfs;0.20.2-
cdh3u3: not found
[error] Total time: 423 s, completed Mar 12, 2012 6:54:07 AM

Can someone please suggest what could have gone wrong here?

Regards,
Raghavendra

Nat

unread,

Mar 12, 2012, 7:48:57 AM3/12/12

to mongod...@googlegroups.com

Sounds like you cannot access https 443 port?

--
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To post to this group, send email to mongod...@googlegroups.com.
To unsubscribe from this group, send email to mongodb-user...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/mongodb-user?hl=en.

Raghu

unread,

Mar 13, 2012, 7:41:26 AM3/13/12

to mongodb-user

Thanks Nat,

Yes, it was the problem related to the port 443. After enabling this
port I was able to build mongo-hadoop for hadoop versions: 0.22 and
0.23. But for the hadoop version: cdh3, it did not build. The error
was that its not able to locate hadoop-hdfs:0.20.2 related files.

On Mar 12, 4:48 pm, "Nat" <nat.lu...@gmail.com> wrote:
> Sounds like you cannot access https 443 port?
>
> -----Original Message-----
> From: Raghu <raghu...@gmail.com>
> Sender: mongod...@googlegroups.com
> Date: Mon, 12 Mar 2012 03:55:55
> To: mongodb-user<mongod...@googlegroups.com>
> Reply-To: mongod...@googlegroups.com
> Subject: [mongodb-user] mongo-hadoop adapter -Buildfailing
>

> I am trying tobuildmongo-hadoop adapter for CDH3 settings using the

> command:
>
> ./sbt package
>
> I am getting the following error:
>
> [error] Server access Error: Connection timed out url=https://
> repository.cloudera.com/artifactory/cloudera-repos/org/mongodb/mongo-
> java-driver/2.7.3/mongo-java-driver-2.7.3.pom
> [error] Server access Error: Connection timed out url=https://
> repository.cloudera.com/artifactory/cloudera-repos/org/mongodb/mongo-
> java-driver/2.7.3/mongo-java-driver-2.7.3.jar
> [info] Resolving org.apache.hadoop#hadoop-core;0.20.2-cdh3u3 ...
> [error] Server access Error: Connection timed out url=https://
> repository.cloudera.com/artifactory/cloudera-repos/org/apache/hadoop/
> hadoop-core/0.20.2-cdh3u3/hadoop-core-0.20.2-cdh3u3.pom
> [error] Server access Error: Connection timed out url=https://
> oss.sonatype.org/content/repositories/releases/org/apache/hadoop/
> hadoop-core/0.20.2-cdh3u3/hadoop-core-0.20.2-cdh3u3.pom
> [warn] module not found: org.apache.hadoop#hadoop-core;0.20.2-cdh3u3
> [warn] ==== local: tried
> [warn] /data/raghu/.ivy2/local/org.apache.hadoop/hadoop-core/0.20.2-
> cdh3u3/ivys/ivy.xml
> [warn] ==== Simile Repo at MIT: tried

> [warn] http://simile.mit.edu/maven/org/apache/hadoop/hadoop-core/0.20.2-cdh3...

> [warn] ==== Cloudera Repository: tried

> [warn]https://repository.cloudera.com/artifactory/cloudera-repos/org/apache...

> [warn] ==== Maven.Org Repository: tried

> [warn] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.20.2-cd...
> [warn] ==== releases: tried
> [warn]https://oss.sonatype.org/content/repositories/releases/org/apache/had...
> [warn] ==== public: tried
> [warn] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-core/0.20.2-cd...

> [warn] ==== Scala-Tools Maven2 Repository: tried

> [warn] http://scala-tools.org/repo-releases/org/apache/hadoop/hadoop-core/0....

> [info] Resolving org.apache.hadoop#hadoop-hdfs;0.20.2-cdh3u3 ...
> [error] Server access Error: Connection timed out url=https://
> repository.cloudera.com/artifactory/cloudera-repos/org/apache/hadoop/
> hadoop-hdfs/0.20.2-cdh3u3/hadoop-hdfs-0.20.2-cdh3u3.pom
> [error] Server access Error: Connection timed out url=https://
> oss.sonatype.org/content/repositories/releases/org/apache/hadoop/
> hadoop-hdfs/0.20.2-cdh3u3/hadoop-hdfs-0.20.2-cdh3u3.pom
> [warn] module not found: org.apache.hadoop#hadoop-hdfs;0.20.2-cdh3u3
> [warn] ==== local: tried
> [warn] /data/raghu/.ivy2/local/org.apache.hadoop/hadoop-hdfs/0.20.2-
> cdh3u3/ivys/ivy.xml
> [warn] ==== Simile Repo at MIT: tried

> [warn] http://simile.mit.edu/maven/org/apache/hadoop/hadoop-hdfs/0.20.2-cdh3...

> [warn] ==== Cloudera Repository: tried

> [warn]https://repository.cloudera.com/artifactory/cloudera-repos/org/apache...

> [warn] ==== Maven.Org Repository: tried

> [warn] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.20.2-cd...
> [warn] ==== releases: tried
> [warn]https://oss.sonatype.org/content/repositories/releases/org/apache/had...
> [warn] ==== public: tried
> [warn] http://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs/0.20.2-cd...

> [warn] ==== Scala-Tools Maven2 Repository: tried

> [warn] http://scala-tools.org/repo-releases/org/apache/hadoop/hadoop-hdfs/0....

> [info] downloadinghttp://repo1.maven.org/maven2/org/mongodb/mongo-java-driver/2.7.3/mon...

> ...
> [info] [SUCCESSFUL ] org.mongodb#mongo-java-driver;2.7.3!mongo-java-
> driver.jar (495ms)

> [info] downloadinghttp://repo1.maven.org/maven2/junit/junit/4.10/junit-4.10.jar

> ...
> [info] [SUCCESSFUL ] junit#junit;4.10!junit.jar (1118ms)

> [info] downloadinghttp://repo1.maven.org/maven2/org/specs2/specs2_2.9.1/1.7.1/specs2_2....

> ...
> [info] [SUCCESSFUL ] org.specs2#specs2_2.9.1;1.7.1!specs2_2.9.1.jar
> (10528ms)

> [info] downloadinghttp://repo1.maven.org/maven2/org/hamcrest/hamcrest-core/1.1/hamcrest...

> ...
> [info] [SUCCESSFUL ] org.hamcrest#hamcrest-core;1.1!hamcrest-core.jar
> (461ms)

> [info] downloadinghttp://repo1.maven.org/maven2/org/specs2/specs2-scalaz-core_2.9.1/6.0...

> ...
> [info] [SUCCESSFUL ] org.specs2#specs2-scalaz-core_2.9.1;6.0.1!specs2-
> scalaz-core_2.9.1.jar (3510ms)
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> [warn] :: UNRESOLVED DEPENDENCIES ::
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> [warn] :: org.apache.hadoop#hadoop-core;0.20.2-cdh3u3: not found
> [warn] :: org.apache.hadoop#hadoop-hdfs;0.20.2-cdh3u3: not found
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> [info] Resolving org.scala-lang#scala-library;2.9.1 ...
> [info] Done updating.
> [info] Resolving org.mongodb#mongo-java-driver;2.7.3 ...
> [info] Resolving com.cloudera#flume-core;0.9.4-cdh3u3 ...
> [error] Server access Error: Connection timed out url=https://
> repository.cloudera.com/artifactory/cloudera-repos/com/cloudera/flume-
> core/0.9.4-cdh3u3/flume-core-0.9.4-cdh3u3.pom
> [error] Server access Error: Connection timed out url=https://
> oss.sonatype.org/content/repositories/releases/com/cloudera/flume-core/
> 0.9.4-cdh3u3/flume-core-0.9.4-cdh3u3.pom
> [warn] module not found: com.cloudera#flume-core;0.9.4-cdh3u3
> [warn] ==== local: tried
> [warn] /data/raghu/.ivy2/local/com.cloudera/flume-core/0.9.4-cdh3u3/
> ivys/ivy.xml
> [warn] ==== Simile Repo at MIT: tried

> [warn] http://simile.mit.edu/maven/com/cloudera/flume-core/0.9.4-cdh3u3/flum...

> [warn] ==== Cloudera Repository: tried

> [warn] https://repository.cloudera.com/artifactory/cloudera-repos/com/cloude...

> [warn] ==== Maven.Org Repository: tried

> [warn] http://repo1.maven.org/maven2/com/cloudera/flume-core/0.9.4-cdh3u3/fl...
> [warn] ==== releases: tried
> [warn] https://oss.sonatype.org/content/repositories/releases/com/cloudera/f...
> [warn] ==== public: tried
> [warn] http://repo1.maven.org/maven2/com/cloudera/flume-core/0.9.4-cdh3u3/fl...

> [warn] ==== Scala-Tools Maven2 Repository: tried

> [warn] http://scala-tools.org/repo-releases/com/cloudera/flume-core/0.9.4-cd...

> [info] Resolving org.scala-lang#scala-library;2.9.1 ...
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> [warn] :: UNRESOLVED DEPENDENCIES ::
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> [warn] :: com.cloudera#flume-core;0.9.4-cdh3u3: not found
> [warn] ::::::::::::::::::::::::::::::::::::::::::::::
> [error] {file:/data/raghu/MongoDB/mongo-hadoop/}mongo-flume/*:update:
> sbt.ResolveException: unresolved dependency: com.cloudera#flume-core;
> 0.9.4-cdh3u3: not found
> [error] {file:/data/raghu/MongoDB/mongo-hadoop/}mongo-hadoop-core/
> *:update: sbt.ResolveException: unresolved dependency:
> org.apache.hadoop#hadoop-core;0.20.2-cdh3u3: not found
> [error] unresolved dependency: org.apache.hadoop#hadoop-hdfs;0.20.2-
>

> ...
>
> read more »

Raghu

unread,

Mar 14, 2012, 10:57:43 AM3/14/12

to mongodb-user

Any updates on this. There is a problem in locating hadoop-hdfs:0.20.2
related files when I try to build mongo-hadoop adapter for the hadoop
version: cdh3

Thanks,

On Mar 13, 4:41 pm, Raghu <raghu...@gmail.com> wrote:
> Thanks Nat,
>
> Yes, it was the problem related to the port 443. After enabling this

> port I was able tobuildmongo-hadoop for hadoop versions: 0.22 and
> 0.23. But for the hadoop version: cdh3, it did notbuild. The error

Brendan W. McAdams

unread,

Mar 14, 2012, 3:25:49 PM3/14/12

to mongodb-user

There appear to have been some issues with the way our cross-build
system was resolving dependencies.

This build should work correctly now against all necessary
configurations if you update to master.

> ...
>
> read more »

Raghu

unread,

Mar 15, 2012, 9:37:40 AM3/15/12

to mongodb-user

Hi Brendan,

Now its working fine. Thanks for quick reply.

On Mar 15, 12:25 am, "Brendan W. McAdams" <bren...@10gen.com> wrote:
> There appear to have been some issues with the way our cross-build
> system was resolving dependencies.
>

> Thisbuildshould work correctly now against all necessary

> configurations if you update to master.
>
> On Mar 14, 10:57 am, Raghu <raghu...@gmail.com> wrote:
>
> > Any updates on this. There is a problem in locating hadoop-hdfs:0.20.2

> > related files when I try tobuildmongo-hadoop adapter for the hadoop

> ...
>
> read more »