NullPointerException while running hadoop-build-readonly-store.sh

53 views
Skip to first unread message

Jeremy Custenborder

unread,
Jul 1, 2011, 12:59:45 PM7/1/11
to project-...@googlegroups.com
All,

I was wondering if someone could give me some direction on this
exception. I'm trying to build out our first read-store and whenever I
fire off hadoop-build-readonly-store.sh I get the following exception.
This seems to happen before my mapper is ever called. I verified that
I am using the class proper name of my mapper so that is not the
issue. I'm not sure if this is a common configuration problem or what.
Any direction would be greatly appreciated.

I've been loosely following this blog post as an example.
http://sna-projects.com/blog/2009/06/voldemort-and-hadoop/

Here are the settings on my development machine.

declare -x HADOOP_HOME="/usr/lib/hadoop/hadoop-0.20.2"
declare -x HADOOP_VERSION="0.20.2"
declare -x PIG_CLASSPATH="/usr/lib/hadoop/hadoop-0.20.2/conf"
declare -x VOLDEMORT_HOME="/home/jeremy/lib/voldemort-0.80.2"
declare -x PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/lib/pig/pig-0.8.1/bin:/usr/lib/hadoop/hadoop-0.20.2/bin"

Input is a sequence file in the format of nullwritable, byteswritable.

~/lib/voldemort-0.80.2$ ./bin/hadoop-build-readonly-store.sh --cluster
./config/single_node_cluster/config/cluster.xml --storedefinitions
./config/single_node_cluster/config/stores.xml --storename
offerstatistics --jar
/home/jeremy/source/whaleshark/MapReduce/src/java/MapReduce.Voldemort/target/mapreduce.voldemort-1.0-SNAPSHOT-job.jar
--mapper <ValidMapperClassName> --replication 2 --tmpdir
/tmp/voldemorttemp --input /tmp/voldemort-input/ --output
/tmp/voldemort-output/ --chunksize 1073741824
java.lang.NullPointerException
at java.util.Hashtable.put(Hashtable.java:394)
at java.util.Properties.setProperty(Properties.java:143)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:404)
at voldemort.store.readonly.mr.HadoopStoreBuilder.build(HadoopStoreBuilder.java:165)
at voldemort.store.readonly.mr.HadoopStoreJobRunner.run(HadoopStoreJobRunner.java:183)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at voldemort.store.readonly.mr.HadoopStoreJobRunner.main(HadoopStoreJobRunner.java:260)

Reply all
Reply to author
Forward
0 new messages