LZO Compression

[mamin mamin]

Hi Dave,

  Additional information on the compression on the following directory:-

 

/usr/share/doc/hadoop-1.0.3-Intel/api  

 

 

From the Apache Hadoop website:- www.hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/core-default.xml

io.compression.codecs		A comma-separated list of the compression codec classes that can be used for compression/decompression. In addition to any classes specified with this property (which take precedence), codec classes on the classpath are discovered using a Java ServiceLoader.
io.compression.codec.bzip2.library	system-native	The native-code library to be used for compression and decompression by the bzip2 codec. This library could be specified either by by name or the full pathname. In the former case, the library is located by the dynamic linker, usually searching the directories specified in the environment variable LD_LIBRARY_PATH. The value of "system-native" indicates that the default system library should be used. To indicate that the algorithm should operate entirely in Java, specify "java-builtin".

 

For the LZO, should you have a need to install in addition to the snappy just make sure to install on each node and the java code /code is making reference to the lzo

 

Thanks