开发者

java.io.IOException: No LZO codec found, cannot run

开发者 https://www.devze.com 2023-04-06 05:17 出处:网络
I tried to use lzo in my hive script, but got this error message. It seemed that I did not have the class for lzo in the classpath.

I tried to use lzo in my hive script, but got this error message. It seemed that I did not have the class for lzo in the classpath.

Did anyone else meet this problem before, how to fix this problem, maybe what I need to know is that where I can get the jar fi开发者_开发百科le for the lzo compression, thx.


Here are some detailed instructions on how to setup LZO compression.


Lzo configuration is not correct in one (or all) of the nodes.

Add the following configuration in core-site.xml.

<property> 
  <name>io.compression.codecs</name> 
  <value>org.apache.hadoop.io.compress.DefaultCodec,com.hadoop.compression.lzo.LzoCodec,com.hadoop.compression.lzo.LzopCodec,org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec</value> 
</property> 
<property> 
  <name>io.compression.codec.lzo.class</name> 
  <value>com.hadoop.compression.lzo.LzoCodec</value> 
</property> 
0

精彩评论

暂无评论...
验证码 换一张
取 消

关注公众号