Deserialization error

2 views
Skip to first unread message

kenbarclay

unread,
Oct 14, 2009, 3:14:18 PM10/14/09
to happy-user
Hello,

I went to Colin's pywebsf talk and am finally getting around to
installing happy0.1 and running the example code. I want to create a
hadoop-powered version of a web-based log search tool that I have.

I'm going to dig into the hadoop docs now to figure out the error
below but I wondered if any knows off-hand, why happy is unable to
deserialize the below .bin file?

I'm running an old version of Centos, 4.1.2 I believe

Thanks
Ken

[kbarclay@localhost happy-0.1]$ ./bin/happy.sh ./examples/wordcount.py
input output
09/10/14 11:15:51 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName=JobTracker, sessionId=
09/10/14 11:15:52 INFO mapred.FileInputFormat: Total input paths to
process : 2
09/10/14 11:15:52 INFO mapred.JobClient: Running job: job_local_1
09/10/14 11:15:52 INFO mapred.MapTask: numReduceTasks: 1
09/10/14 11:15:53 INFO happy.HappyMap: Starting config for job
wordcount.py - WordCount
09/10/14 11:15:53 INFO happy.HappyMap: Deserializing
happy-1027663929250576691.bin
09/10/14 11:15:53 WARN mapred.LocalJobRunner: job_local_1
java.lang.RuntimeException: Error deserializing
happy-1027663929250576691.bin
at com.freebase.happy.HappyBase.configure(HappyBase.java:135)
at org.apache.hadoop.util.ReflectionUtils.setConf
(ReflectionUtils.java:58)
at org.apache.hadoop.util.ReflectionUtils.newInstance
(ReflectionUtils.java:82)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:215)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run
(LocalJobRunner.java:157)
Caused by: java.io.FileNotFoundException:
happy-1027663929250576691.bin (No such file or directory)
at java.io.FileInputStream.open(Native Method)
at java.io.FileInputStream.<init>(FileInputStream.java:106)
at java.io.FileInputStream.<init>(FileInputStream.java:66)
at com.freebase.happy.util.PyObjectSerializer.deserialize
(PyObjectSerializer.java:70)
at com.freebase.happy.HappyBase.configure(HappyBase.java:133)
... 4 more
Traceback (innermost last):
File "./examples/wordcount.py", line 31, in ?
File "/home/kbarclay/happy-0.1/happy.jar/happy/__init__.py", line
235, in run
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:
1062)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:592)

java.io.IOException: java.io.IOException: Job failed!
Reply all
Reply to author
Forward
0 new messages