--
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
Hi,
You should not need to make any code changes to use Avro. Just set the following configs:build.input.path=/some/hdfs/path/to/an/avro/datasetbuild.type.avro=trueavro.serializer.versioned=trueavro.key.field=field_name_of_your_key_in_the_avro_recordsavro.value.field=field_name_of_your_value_in_the_avro_recordsLet me know if that doesn't work.-F
@Xiao, any luck getting this working? I've been attempting the same thing myself (build and push with avro), but have yet to get a working combination of makekey() and makevalue()...
On Thursday, May 28, 2015 at 4:17:16 PM UTC-7, Xiao Zhou wrote:Any example how to build store with avro formatwhat need to be done in the makekey() makevalue() override?Thanks,
--
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldemort+unsubscribe@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
--
Félix
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
--
--
Félix
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
type=java
job.class=voldemort.store.readonly.mr.azkaban.VoldemortBuildAndPushJob
...
Exception in thread "main" java.lang.ClassNotFoundException: voldemort.store.readonly.mr.azkaban.VoldemortBuildAndPushJob
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldemort+unsubscribe@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
--
--
Félix
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
----
Felix GV
Senior Software Engineer
Data Infrastructure
f...@linkedin.com
linkedin.com/in/felixgv
plugins/jobtypes/voldemortBuildAndPush/lib/
Caused by: java.lang.ClassNotFoundException: azkaban.jobtype.HadoopJavaJob
$ cat plugins/jobtypes/hadoopJava/private.propertiesjobtype.class=azkaban.jobtype.HadoopJavaJob
azkaban.jobtype.plugin.dir=plugins/jobtypes
$ cat plugins/jobtypes/voldemortBuildAndPush/plugin.propertiesjob.class=voldemort.store.readonly.mr.azkaban.VoldemortBuildAndPushJobvoldemort.fetcher.protocol=webhdfshadoop-conf.mapreduce.job.classloader=true
$ cat plugins/jobtypes/voldemortBuildAndPush/private.propertiesjobtype.classpath=lib/*jobtype.class=azkaban.jobtype.HadoopJavaJobazkaban.no.user.classpath=true
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldemort+unsubscribe@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
--
--
Félix
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldemort+unsubscribe@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
----
Felix GV
Senior Software Engineer
Data Infrastructure
--
--
Félix
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
--
--
Félix
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
--
Felix GV
Senior Software Engineer
Data Infrastructure
----
--
Félix
INFO Class name voldemort.store.readonly.mr.azkaban.VoldemortBuildAndPushJob 25-06-2015 14:58:42 PDT build_and_push_avro ERROR - Exception in thread "main" java.lang.ClassNotFoundException: voldemort.store.readonly.mr.azkaban.VoldemortBuildAndPushJob
25-06-2015 15:28:38 PDT build_and_push_avro INFO - INFO Running job build_and_push_avro 25-06-2015 15:28:38 PDT build_and_push_avro INFO - INFO Class name voldemort.store.readonly.mr.azkaban.VoldemortBuildAndPushJob 25-06-2015 15:28:38 PDT build_and_push_avro ERROR - Exception in thread "main" java.lang.ClassNotFoundException: voldemort.store.readonly.mr.azkaban.VoldemortBuildAndPushJob 25-06-2015 15:28:38 PDT build_and_push_avro ERROR - at java.net.URLClassLoader$1.run(URLClassLoader.java:372) 25-06-2015 15:28:38 PDT build_and_push_avro ERROR - at java.net.URLClassLoader$1.run(URLClassLoader.java:361) 25-06-2015 15:28:38 PDT build_and_push_avro ERROR - at java.security.AccessController.doPrivileged(Native Method) 25-06-2015 15:28:38 PDT build_and_push_avro ERROR - at java.net.URLClassLoader.findClass(URLClassLoader.java:360) 25-06-2015 15:28:38 PDT build_and_push_avro ERROR - at java.lang.ClassLoader.loadClass(ClassLoader.java:424) 25-06-2015 15:28:38 PDT build_and_push_avro ERROR - at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) 25-06-2015 15:28:38 PDT build_and_push_avro ERROR - at java.lang.ClassLoader.loadClass(ClassLoader.java:357) 25-06-2015 15:28:38 PDT build_and_push_avro ERROR - at azkaban.jobtype.JavaJobRunnerMain.getObject(JavaJobRunnerMain.java:269) 25-06-2015 15:28:38 PDT build_and_push_avro ERROR - at azkaban.jobtype.JavaJobRunnerMain.(JavaJobRunnerMain.java:107) 25-06-2015 15:28:38 PDT build_and_push_avro ERROR - at azkaban.jobtype.JavaJobRunnerMain.main(JavaJobRunnerMain.java:72
You received this message because you are subscribed to a topic in the Google Groups "project-voldemort" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/project-voldemort/GuIP5D2zmDg/unsubscribe.
To unsubscribe from this group and all its topics, send an email to project-voldem...@googlegroups.com.
You received this message because you are subscribed to the Google Groups "azkaban" group.
To unsubscribe from this group and stop receiving emails from it, send an email to azkaban-dev...@googlegroups.com.
java.lang.RuntimeException: Your store definition does not match the store definition that is already in the cluster. Tried to resolve identical schemas between local and remote, but failed.
$ ls plugins/jobtypes/VoldemortBuildAndPushJob hadoopJavacommon.properties javacommonprivate.properties package.version
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldemort+unsubscribe@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
--
--
Félix
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldemort+unsubscribe@googlegroups.com.
--
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
--
--
Félix
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
--
Felix GV
Senior Software Engineer
Data Infrastructure
----
--
Félix
You received this message because you are subscribed to the Google Groups "project-voldemort" group.
To unsubscribe from this group and stop receiving emails from it, send an email to project-voldem...@googlegroups.com.
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to a topic in the Google Groups "project-voldemort" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/project-voldemort/GuIP5D2zmDg/unsubscribe.To unsubscribe from this group and all its topics, send an email to project-voldem...@googlegroups.com.--
Visit this group at http://groups.google.com/group/project-voldemort.
For more options, visit https://groups.google.com/d/optout.
You received this message because you are subscribed to the Google Groups "azkaban" group.To unsubscribe from this group and stop receiving emails from it, send an email to azkaban-dev...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--