mongo-hadoop examples do not work

[natalia.v...@gmail.com]

Hello,

   I have just checked out the current version of mongo-hadoop, and I am running hadoop 2.2.0 (which works fine -- just checked by putting a file into hdfs).   I followed all the instructions on the "getting started" webpage here: http://docs.mongodb.org/ecosystem/tutorial/getting-started-with-hadoop/, including copying mongo-2.7.3.jar and  core/target/mongo-hadoop-core_2.2.0-1.2.0.jar to $HADOOP_HOME/lib.  

    I built both the treasury-example and enron-example packages without errors.  However, I am unable to run run_job.sh for either example.  

   -- For the treasury one, the problems are that there is no  treasury_yield-1.2.1-SNAPSHOT-hadoop_2.2.jar anywhere, and certainly not in mongo-hadoop/build/libs, especially since build itself does not exist within mongo-hadoop!

    -- For the enron one, I got:

> bash examples/enron/run_job.sh

Exception in thread "main" java.lang.NoClassDefFoundError: com/mongodb/hadoop/util/MongoTool

  

   even though, like I said, both mongo jar files are in $HADOOP_HOME/lib:

>ls $HADOOP_HOME/lib

mongo-2.7.3.jar native

mongo-hadoop-core_2.2.0-1.2.0.jar

   I even set the CLASSPATH to include $HADOOP_HOME/lib, but that did not work either.

    Any suggestions would be appreciated.

 

    Thank you,

    Natalia

[Justin Lee]

Those docs are out of date (there's a pending pull request that fixes them).  To run the examples, look here https://github.com/mongodb/mongo-hadoop/blob/master/examples/README.md

--
--
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To post to this group, send email to mongod...@googlegroups.com
To unsubscribe from this group, send email to
mongodb-user...@googlegroups.com
See also the IRC channel -- freenode.net#mongodb

---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[natalia.v...@gmail.com]

Hi Justin,

   Thank you for your message but I am afraid the example you pointed out not work either.  Here's what I did:

>./gradlew jar  

(this step worked fine)

>./gradlew historicalYield

   this still gives me the same error:

Tue Mar 25 09:11:40.778 dropping: mongo_hadoop.yield_historical.in

Tue Mar 25 09:11:41.238 check 9 5193

Tue Mar 25 09:11:41.238 imported 5193 objects

Executing hadoop job:

 ../hadoop-binaries/hadoop-2.3.0/bin/hadoop \

jar \

examples/treasury_yield/build/libs/treasury_yield-1.2.1-SNAPSHOT-hadoop_2.3.jar \

com.mongodb.hadoop.examples.treasury.TreasuryYieldXMLConfig \

-Dmongo.input.split_size=8 \

-Dmongo.job.verbose=true

Exception in thread "main" java.lang.NoClassDefFoundError: com/mongodb/hadoop/util/MongoTool

    Natalia

[Justin Lee]

Does ../hadoop-binaries/hadoop-2.3.0/share/hadoop/common/mongo-hadoop-core.jar exist?

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.

---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user...@googlegroups.com.

To post to this group, send email to mongod...@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/34308f54-a7c0-4829-9654-6c64b7d79db6%40googlegroups.com.

[natalia.v...@gmail.com]

Yes, it does.

[Justin Lee]

What's the full stack trace on that exception, then?

To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/89176ee8-4d98-4ba3-b5ca-f50edb630d31%40googlegroups.com.

[natalia.v...@gmail.com]

connected to: 127.0.0.1

Tue Mar 25 09:56:10.563 dropping: mongo_hadoop.yield_historical.in

Tue Mar 25 09:56:11.439 check 9 5193

Tue Mar 25 09:56:11.439 imported 5193 objects

Executing hadoop job:

 ../hadoop-binaries/hadoop-2.3.0/bin/hadoop \

jar \

examples/treasury_yield/build/libs/treasury_yield-1.2.1-SNAPSHOT-hadoop_2.3.jar \

com.mongodb.hadoop.examples.treasury.TreasuryYieldXMLConfig \

-Dmongo.input.split_size=8 \

-Dmongo.job.verbose=true

Exception in thread "main" java.lang.NoClassDefFoundError: com/mongodb/hadoop/util/MongoTool

at java.lang.ClassLoader.defineClass1(Native Method)

at java.lang.ClassLoader.defineClass(ClassLoader.java:792)

at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)

at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)

at java.net.URLClassLoader.access$100(URLClassLoader.java:71)

at java.net.URLClassLoader$1.run(URLClassLoader.java:361)

at java.net.URLClassLoader$1.run(URLClassLoader.java:355)

at java.security.AccessController.doPrivileged(Native Method)

at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

at java.lang.ClassLoader.loadClass(ClassLoader.java:424)

at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

at java.lang.Class.forName0(Native Method)

at java.lang.Class.forName(Class.java:270)

at org.apache.hadoop.util.RunJar.main(RunJar.java:205)

Caused by: java.lang.ClassNotFoundException: com.mongodb.hadoop.util.MongoTool

at java.net.URLClassLoader$1.run(URLClassLoader.java:366)

at java.net.URLClassLoader$1.run(URLClassLoader.java:355)

at java.security.AccessController.doPrivileged(Native Method)

at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

at java.lang.ClassLoader.loadClass(ClassLoader.java:424)

at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

... 14 more

:historicalYield FAILED

FAILURE: Build failed with an exception.

* Where:

Build file '/Users/hadoop/mongo-hadoop/build.gradle' line: 359

* What went wrong:

Execution failed for task ':historicalYield'.

> Process 'command '../hadoop-binaries/hadoop-2.3.0/bin/hadoop'' finished with non-zero exit value 1

* Try:

Run with --info or --debug option to get more log output.

* Exception is:

org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':historicalYield'.

at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:69)

at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:46)

at org.gradle.api.internal.tasks.execution.PostExecutionAnalysisTaskExecuter.execute(PostExecutionAnalysisTaskExecuter.java:35)

at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:64)

at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:58)

at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:42)

at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:52)

at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:53)

at org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:43)

at org.gradle.api.internal.AbstractTask.executeWithoutThrowingTaskFailure(AbstractTask.java:289)

at org.gradle.execution.taskgraph.AbstractTaskPlanExecutor$TaskExecutorWorker.executeTask(AbstractTaskPlanExecutor.java:79)

at org.gradle.execution.taskgraph.AbstractTaskPlanExecutor$TaskExecutorWorker.processTask(AbstractTaskPlanExecutor.java:63)

at org.gradle.execution.taskgraph.AbstractTaskPlanExecutor$TaskExecutorWorker.run(AbstractTaskPlanExecutor.java:51)

at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor$1.run(DefaultTaskPlanExecutor.java:33)

at org.gradle.internal.Factories$1.create(Factories.java:22)

at org.gradle.cache.internal.DefaultCacheAccess.longRunningOperation(DefaultCacheAccess.java:198)

at org.gradle.cache.internal.DefaultCacheAccess.longRunningOperation(DefaultCacheAccess.java:266)

at org.gradle.cache.internal.DefaultPersistentDirectoryStore.longRunningOperation(DefaultPersistentDirectoryStore.java:135)

at org.gradle.api.internal.changedetection.state.DefaultTaskArtifactStateCacheAccess.longRunningOperation(DefaultTaskArtifactStateCacheAccess.java:95)

at org.gradle.execution.taskgraph.DefaultTaskPlanExecutor.process(DefaultTaskPlanExecutor.java:31)

at org.gradle.execution.taskgraph.DefaultTaskGraphExecuter.execute(DefaultTaskGraphExecuter.java:86)

at org.gradle.execution.SelectedTaskExecutionAction.execute(SelectedTaskExecutionAction.java:29)

at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:61)

at org.gradle.execution.DefaultBuildExecuter.access$200(DefaultBuildExecuter.java:23)

at org.gradle.execution.DefaultBuildExecuter$2.proceed(DefaultBuildExecuter.java:67)

at org.gradle.execution.DryRunBuildExecutionAction.execute(DryRunBuildExecutionAction.java:32)

at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:61)

at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:54)

at org.gradle.initialization.DefaultGradleLauncher.doBuildStages(DefaultGradleLauncher.java:166)

at org.gradle.initialization.DefaultGradleLauncher.doBuild(DefaultGradleLauncher.java:113)

at org.gradle.initialization.DefaultGradleLauncher.run(DefaultGradleLauncher.java:81)

at org.gradle.launcher.exec.InProcessBuildActionExecuter$DefaultBuildController.run(InProcessBuildActionExecuter.java:64)

at org.gradle.launcher.cli.ExecuteBuildAction.run(ExecuteBuildAction.java:33)

at org.gradle.launcher.cli.ExecuteBuildAction.run(ExecuteBuildAction.java:24)

at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:35)

at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:26)

at org.gradle.launcher.cli.RunBuildAction.run(RunBuildAction.java:50)

at org.gradle.internal.Actions$RunnableActionAdapter.execute(Actions.java:171)

at org.gradle.launcher.cli.CommandLineActionFactory$ParseAndBuildAction.execute(CommandLineActionFactory.java:201)

at org.gradle.launcher.cli.CommandLineActionFactory$ParseAndBuildAction.execute(CommandLineActionFactory.java:174)

at org.gradle.launcher.cli.CommandLineActionFactory$WithLogging.execute(CommandLineActionFactory.java:170)

at org.gradle.launcher.cli.CommandLineActionFactory$WithLogging.execute(CommandLineActionFactory.java:139)

at org.gradle.launcher.cli.ExceptionReportingAction.execute(ExceptionReportingAction.java:33)

at org.gradle.launcher.cli.ExceptionReportingAction.execute(ExceptionReportingAction.java:22)

at org.gradle.launcher.Main.doAction(Main.java:46)

at org.gradle.launcher.bootstrap.EntryPoint.run(EntryPoint.java:45)

at org.gradle.launcher.Main.main(Main.java:37)

at org.gradle.launcher.bootstrap.ProcessBootstrap.runNoExit(ProcessBootstrap.java:50)

at org.gradle.launcher.bootstrap.ProcessBootstrap.run(ProcessBootstrap.java:32)

at org.gradle.launcher.GradleMain.main(GradleMain.java:23)

at org.gradle.wrapper.BootstrapMainStarter.start(BootstrapMainStarter.java:33)

at org.gradle.wrapper.WrapperExecutor.execute(WrapperExecutor.java:130)

at org.gradle.wrapper.GradleWrapperMain.main(GradleWrapperMain.java:61)

Caused by: org.gradle.process.internal.ExecException: Process 'command '../hadoop-binaries/hadoop-2.3.0/bin/hadoop'' finished with non-zero exit value 1

at org.gradle.process.internal.DefaultExecHandle$ExecResultImpl.assertNormalExitValue(DefaultExecHandle.java:361)

at org.gradle.process.internal.DefaultExecAction.execute(DefaultExecAction.java:31)

at org.gradle.api.internal.file.DefaultFileOperations.exec(DefaultFileOperations.java:176)

at org.gradle.api.internal.project.AbstractProject.exec(AbstractProject.java:875)

at org.gradle.groovy.scripts.DefaultScript.exec(DefaultScript.java:188)

at org.gradle.api.Script$exec.callCurrent(Unknown Source)

at build_6nmuvvdmefglbpsbjuff49pkao.hadoop(/Users/hadoop/mongo-hadoop/build.gradle:359)

at build_6nmuvvdmefglbpsbjuff49pkao$_run_closure15.doCall(/Users/hadoop/mongo-hadoop/build.gradle:293)

at org.gradle.api.internal.AbstractTask$ClosureTaskAction.execute(AbstractTask.java:502)

at org.gradle.api.internal.AbstractTask$ClosureTaskAction.execute(AbstractTask.java:483)

at org.gradle.api.internal.tasks.TaskStatusNagger$1.execute(TaskStatusNagger.java:77)

at org.gradle.api.internal.tasks.TaskStatusNagger$1.execute(TaskStatusNagger.java:73)

at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:80)

at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:61)

... 52 more

BUILD FAILED

Total time: 10.432 secs

[Justin Lee]

My apologies.  I got pulled off in to other code and lost track of this thread.  I've tracked down and fixed this problem (jars were being "copied" too early in the build cycle).  If you pull from github and try again you should be all set.

[Tang XuNing]

Justin, I just see this post and would like to paste my similar issue here. Hope you don't mind.

I have spent a few days on this but there is no luck. I successfully build the mongo-hadoop-connector using ./gradlew. However, when I run the example, it has error like this:

hduser@xutang-ThinkPad-X220:~/mongo-hadoop$ ./gradlew -PclusterVersion='2.2' historicalYield
:installHadoop
Extracting /home/hduser/hadoop-binaries/hadoop-2.2.0.tar.gz
:installHive
:copyFiles
Updating mongo jars
Download http://central.maven.org/maven2/org/mongodb/mongo-java-driver/2.12.2/mongo-java-driver-2.12.2.jar
Updating cluster configuration
:configureCluster
Configuring 2.2 cluster
Shutting down node manager
Shutting down resource manager
Shutting down data node
Shutting down name node
Shutting down hive server
build/hadoop-2.2.sh: line 36: $LOG: ambiguous redirect
Starting namenode
Starting datanode
Starting resourcemanager
Starting nodemanager
Starting hiveserver
:historicalYield
connected to: 127.0.0.1
2014-06-27T09:42:39.564-0400 dropping: mongo_hadoop.yield_historical.in
2014-06-27T09:42:39.799-0400 check 9 5193
2014-06-27T09:42:39.800-0400 imported 5193 objects
Executing hadoop job:
 /home/hduser/hadoop-binaries/hadoop-2.2.0/bin/hadoop \
    jar \
    examples/treasury_yield/build/libs/treasury_yield-1.3.0-SNAPSHOT.jar \
    com.mongodb.hadoop.examples.treasury.TreasuryYieldXMLConfig \
    -Dmongo.input.split_size=8 \
    -Dmongo.job.verbose=true \
    -Dmongo.input.uri=mongodb://localhost:27017/mongo_hadoop.yield_historical.in \
    -Dmongo.output.uri=mongodb://localhost:27017/mongo_hadoop.yield_historical.out

Exception in thread "main" java.lang.NoClassDefFoundError: com/mongodb/hadoop/util/MongoTool

    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:800)

    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)

    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:270)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:205)
Caused by: java.lang.ClassNotFoundException: com.mongodb.hadoop.util.MongoTool
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)

    ... 14 more
:historicalYield FAILED

FAILURE: Build failed with an exception.

* Where:

Build file '/home/hduser/mongo-hadoop/build.gradle' line: 498

* What went wrong:
Execution failed for task ':historicalYield'.

> Process 'command '/home/hduser/hadoop-binaries/hadoop-2.2.0/bin/hadoop'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output.

BUILD FAILED

Total time: 23.648 secs

I have checked out the latest version from github this morning and the result is same. I also check this folder and make sure the mongo-hadoop-core.jar is there.

hduser@xutang-ThinkPad-X220:~/hadoop-binaries/hadoop-2.2.0/share/hadoop/common$ ls
hadoop-common-2.2.0.jar        jdiff                  mongo-hadoop-streaming.jar  templates
hadoop-common-2.2.0-tests.jar  lib                    mongo-java-driver.jar
hadoop-nfs-2.2.0.jar           mongo-hadoop-core.jar  sources

Any help will be highly appreciated!

[Justin Lee]

Yep.  I'm fixing that right now.  Slight code drift broke those.  I'll add these to the regular jenkins job once they're fixed so we don't run in to this again.

--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
 
For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user...@googlegroups.com.
To post to this group, send email to mongod...@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.

To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/de77a0fe-d52a-44f6-bf51-f66b3781de3a%40googlegroups.com.

[Tang XuNing]

Thank you a lot!

[Justin Lee]

Do a pull and try again.  As a bonus, they also work properly now on a 1.0 cluster.  Although hopefully everyone's on something much newer.

To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/53964897-0dff-495d-b018-a47f0f735222%40googlegroups.com.

[Tang XuNing]

Hi Justin,

Thank you so much for the quick response. I really appreciate that!!

I pulled and tried twice but the results are the same. It still doesn't work on my machine. Below please see the info.

hduser@xutang-ThinkPad-X220:~/mongo-hadoop$ ./gradlew -PclusterVersion='2.2' historicalYield
:installHadoop

/home/hduser/hadoop-binaries/hadoop-2.2.0 not found.  Downloading from http://archive.apache.org/dist/hadoop/common/hadoop-2.2.0/hadoop-2.2.0.tar.gz to /home/hduser/hadoop-binaries/hadoop-2.2.0.tar.gz
Download http://archive.apache.org/dist/hadoop/common/hadoop-2.2.0/hadoop-2.2.0.tar.gz
Extracting /home/hduser/hadoop-binaries/hadoop-2.2.0.tar.gz
:installHive
/home/hduser/hadoop-binaries/hive-0.12.0 not found.  Downloading from https://archive.apache.org/dist/hive/hive-0.12.0/hive-0.12.0.tar.gz to /home/hduser/hadoop-binaries/hive-0.12.0.tar.gz
Download https://archive.apache.org/dist/hive/hive-0.12.0/hive-0.12.0.tar.gz
Extracting /home/hduser/hadoop-binaries/hive-0.12.0.tar.gz

:copyFiles
Updating mongo jars
Download http://central.maven.org/maven2/org/mongodb/mongo-java-driver/2.12.2/mongo-java-driver-2.12.2.jar
Updating cluster configuration
:configureCluster
Configuring 2.2 cluster

Starting namenode
Starting datanode
Starting resourcemanager
Starting nodemanager
Starting hiveserver
:historicalYield
connected to: 127.0.0.1

2014-06-27T12:24:10.726-0400 dropping: mongo_hadoop.yield_historical.in
2014-06-27T12:24:10.918-0400 check 9 5193
2014-06-27T12:24:10.934-0400 imported 5193 objects

Executing hadoop job:
 /home/hduser/hadoop-binaries/hadoop-2.2.0/bin/hadoop \
    jar \

    examples/treasury_yield/build/libs/treasury_yield-1.4.0-SNAPSHOT.jar \

Total time: 4 mins 25.869 secs

[Justin Lee]

./gradlew -PclusterVersion=2.2 jar historicalYield

You have to build the core jar first.

To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/9b4362fd-9805-4872-908a-db8d28d8b2bd%40googlegroups.com.

[Tang XuNing]

Hi Justin,

Thank you for your time and suggestion. I think I have built the core jar but it still doesn't work for me. Below is the info.

hduser@xutang-ThinkPad-X220:~/mongo-hadoop$ ./gradlew -PclusterVersion=2.2 jar historicalYield
:compileJava UP-TO-DATE
:processResources UP-TO-DATE
:classes UP-TO-DATE
:jar UP-TO-DATE
:generateScripts
:core:compileJava UP-TO-DATE
:core:processResources UP-TO-DATE
:core:classes UP-TO-DATE
:core:jar UP-TO-DATE
:examples/enron:compileJava UP-TO-DATE
:examples/enron:processResources UP-TO-DATE
:examples/enron:classes UP-TO-DATE
:examples/enron:jar UP-TO-DATE
:examples/sensors:compileJava UP-TO-DATE
:examples/sensors:processResources UP-TO-DATE
:examples/sensors:classes UP-TO-DATE
:examples/sensors:jar UP-TO-DATE
:examples/treasury_yield:compileJava UP-TO-DATE
:examples/treasury_yield:processResources UP-TO-DATE
:examples/treasury_yield:classes UP-TO-DATE
:examples/treasury_yield:jar UP-TO-DATE
:flume:compileJava UP-TO-DATE
:flume:processResources UP-TO-DATE
:flume:classes UP-TO-DATE
:flume:jar UP-TO-DATE
:hive:compileJava UP-TO-DATE
:hive:processResources UP-TO-DATE
:hive:classes UP-TO-DATE
:hive:jar UP-TO-DATE
:integration-tests:compileJava UP-TO-DATE
:integration-tests:processResources UP-TO-DATE
:integration-tests:classes UP-TO-DATE
:integration-tests:jar UP-TO-DATE
:pig:compileJava UP-TO-DATE
:pig:processResources UP-TO-DATE
:pig:classes UP-TO-DATE
:pig:jar UP-TO-DATE
:streaming:compileJava UP-TO-DATE
:streaming:processResources UP-TO-DATE
:streaming:classes UP-TO-DATE
:streaming:jar UP-TO-DATE
:installHadoop

:installHive
:copyFiles
Updating mongo jars

Updating cluster configuration
:configureCluster
Configuring 2.2 cluster

Shutting down node manager
Shutting down resource manager
Shutting down data node
Shutting down name node
Shutting down hive server
build/hadoop-2.2.sh: line 36: $LOG: ambiguous redirect

Starting namenode
Starting datanode
Starting resourcemanager
Starting nodemanager
Starting hiveserver
:historicalYield
connected to: 127.0.0.1

2014-06-27T14:01:39.476-0400 dropping: mongo_hadoop.yield_historical.in
2014-06-27T14:01:39.603-0400 check 9 5193
2014-06-27T14:01:39.710-0400 imported 5193 objects

Total time: 21.89 secs

[Justin Lee]

That command works for me, actually.  You might try doing a clean first.  That will remove the "cluster" that gradle builds so it create be recreated from scratch.

To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/6b33c505-752c-494f-952d-dfe199197172%40googlegroups.com.

[Tang XuNing]

Thank you for the suggestions.

I deleted the entire ~/mongo-hadoop folder and the ~/hadoop-binaries folder as well. I also deleted the ~/.gradle folder.  Then I redo everything but it still doesn't work.

I can't figure out where it goes wrong but will keep trying. Please let me know if you can think of any clues. Thank you again!

...

[Tang XuNing]

I have followed your instructions and re-build that multiple times. It works right now. Thank you!

...