I tried to use lzo in my hive script, but got this error message. It seemed that I did not have the class for lzo in the classpath.
Did anyone else meet this problem before, how to fix this problem, maybe what I need to know is that where I can get the jar fi开发者_开发百科le for the lzo compression, thx.
Here are some detailed instructions on how to setup LZO compression.
Lzo configuration is not correct in one (or all) of the nodes.
Add the following configuration in core-site.xml.
<property>
<name>io.compression.codecs</name>
<value>org.apache.hadoop.io.compress.DefaultCodec,com.hadoop.compression.lzo.LzoCodec,com.hadoop.compression.lzo.LzopCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec</value>
</property>
<property>
<name>io.compression.codec.lzo.class</name>
<value>com.hadoop.compression.lzo.LzoCodec</value>
</property>
精彩评论