custom serialization

[Curt Holden]

Hello,

I am following the Setting custom serialization recipe at http://pangool.net/userguide/schemas.html, but it appears that the com.datasalt.pangool.io.Field.setSerialization() method no longer exists in Pangool 0.70.  Is field serialization no longer supported in schema?

At a higher level, my mapper is reading Avro and I would like to simply pass that data in Avro format onto the reducer.  What is the best way to do that?

Thanks,

Curt-

[Iván de Prado]

Hi Curt, 

Better have a look to this page: http://pangool.net/userguide/custom_serialization.html

This is an example of using Avro in a Pangool tuple field:

  List<Field> fields = new ArrayList<Field>(); 

  fields.add(Fields.createAvroField("my_avro_field", myAvroSchema));

  Schema schema = new Schema("schema", fields);

  

  Tuple tuple = new Tuple(schema);

  Record avroRecord = new Record(myAvroSchema); //Avro Record

  tuple.set("my_avro_field", avroRecord);

Have a look to this complete example: https://github.com/datasalt/pangool/blob/master/examples/src/main/java/com/datasalt/pangool/examples/avro/AvroTopicalWordCount.java

In the example you will see a how to pass the avro data just to the reducer. 

Regards, 

Iván

--
Has recibido este mensaje porque estás suscrito al grupo "pangool-user" de Grupos de Google.
Para anular la suscripción a este grupo y dejar de recibir sus mensajes, envía un correo electrónico a pangool-user...@googlegroups.com.
Para acceder a más opciones, visita https://groups.google.com/d/optout.

--

Iván de Prado

CEO & Co-founder

www.datasalt.com

[Curt Holden]

The first example you listed helped me sort out my issue.

Thanks,

Curt-