Apache Avro vs Apache Thrift

65 views
Skip to first unread message

Kalyana Sundaram Balasubramanian

unread,
Jan 13, 2015, 3:56:35 AM1/13/15
to chenn...@googlegroups.com
Dear Experts,

From the "Hadoop Definitve guide", I understand that Apache Avro and Apache Thrift both are serialization frameworks. Why do we need multiple frameworks in Hadoop?
Can someone please help me understand the distinction.

Regards
Kalyan

Senthil Kumar

unread,
Feb 2, 2015, 10:16:00 PM2/2/15
to chenn...@googlegroups.com
Sorry for the delayed reply.

You missed out Apache Thrift. http://thrift.apache.org/

Each serialization comes out with their RPC mechanism. Only main difference i see is IDL / no IDL. IDL stands for Interface Definition language.

Thrift / protoBuf - Needs IDL to be generated in target language
Avro - doesnot need IDL and provides dynamic typing. It provides schema as part of serialized records itlself.

Thanks
Senthil
Reply all
Reply to author
Forward
0 new messages