hb120973135 发表于 2016-12-5 11:15:09

hadoop lzo & Elephant Bird

  http://www.iyunv.com/Linux/2014-05/101090.htm
  https://github.com/kevinweil/hadoop-lzo
  https://github.com/twitter/elephant-bird
  https://github.com/twitter/elephant-bird/wiki/How-to-use-Elephant-Bird-with-Hive
  http://search.maven.org/#search|gav|1|g%3A%22com.twitter.elephantbird%22%20AND%20a%3A%22elephant-bird%22
  http://blog.csdn.net/zhangzhaokun/article/details/17595325
  (1)安装LZO
  wget http://www.oberhumer.com/opensource/lzo/download/lzo-2.06.tar.gz
tar -zxvf lzo-2.06.tar.gz 
./configure -enable-shared -prefix=/usr/local/hadoop/lzo/
make && make test && make install

(2)安装LZOP
wget http://www.lzop.org/download/lzop-1.03.tar.gz
tar -zxvf lzop-1.03.tar.gz 
./configure -enable-shared -prefix=/usr/local/hadoop/lzop
make  && make install

(3)把lzop复制到/usr/bin/
    ln -s /usr/local/hadoop/lzop/bin/lzop /usr/bin/lzop
  (4)测试lzop
   lzop /home/hadoop/data/access_20131219.log
页: [1]
查看完整版本: hadoop lzo & Elephant Bird