kenbarclay
unread,Oct 14, 2009, 3:14:18 PM10/14/09Sign in to reply to author
Sign in to forward
You do not have permission to delete messages in this group
Either email addresses are anonymous for this group or you need the view member email addresses permission to view the original message
to happy-user
Hello,
I went to Colin's pywebsf talk and am finally getting around to
installing happy0.1 and running the example code. I want to create a
hadoop-powered version of a web-based log search tool that I have.
I'm going to dig into the hadoop docs now to figure out the error
below but I wondered if any knows off-hand, why happy is unable to
deserialize the below .bin file?
I'm running an old version of Centos, 4.1.2 I believe
Thanks
Ken
[kbarclay@localhost happy-0.1]$ ./bin/happy.sh ./examples/wordcount.py
input output
09/10/14 11:15:51 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName=JobTracker, sessionId=
09/10/14 11:15:52 INFO mapred.FileInputFormat: Total input paths to
process : 2
09/10/14 11:15:52 INFO mapred.JobClient: Running job: job_local_1
09/10/14 11:15:52 INFO mapred.MapTask: numReduceTasks: 1
09/10/14 11:15:53 INFO happy.HappyMap: Starting config for job
wordcount.py - WordCount
09/10/14 11:15:53 INFO happy.HappyMap: Deserializing
happy-1027663929250576691.bin
09/10/14 11:15:53 WARN mapred.LocalJobRunner: job_local_1
java.lang.RuntimeException: Error deserializing
happy-1027663929250576691.bin
at com.freebase.happy.HappyBase.configure(HappyBase.java:135)
at org.apache.hadoop.util.ReflectionUtils.setConf
(ReflectionUtils.java:58)
at org.apache.hadoop.util.ReflectionUtils.newInstance
(ReflectionUtils.java:82)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:215)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run
(LocalJobRunner.java:157)
Caused by: java.io.FileNotFoundException:
happy-1027663929250576691.bin (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:106)
at java.io.FileInputStream.<init>(FileInputStream.java:66)
at com.freebase.happy.util.PyObjectSerializer.deserialize
(PyObjectSerializer.java:70)
at com.freebase.happy.HappyBase.configure(HappyBase.java:133)
... 4 more
Traceback (innermost last):
File "./examples/wordcount.py", line 31, in ?
File "/home/kbarclay/happy-0.1/happy.jar/happy/__init__.py", line
235, in run
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:
1062)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:592)
java.io.IOException: java.io.IOException: Job failed!