hadoop lzo & Elephant Bird
http://www.iyunv.com/Linux/2014-05/101090.htmhttps://github.com/kevinweil/hadoop-lzo
https://github.com/twitter/elephant-bird
https://github.com/twitter/elephant-bird/wiki/How-to-use-Elephant-Bird-with-Hive
http://search.maven.org/#search|gav|1|g%3A%22com.twitter.elephantbird%22%20AND%20a%3A%22elephant-bird%22
http://blog.csdn.net/zhangzhaokun/article/details/17595325
(1)安装LZO
wget http://www.oberhumer.com/opensource/lzo/download/lzo-2.06.tar.gz
tar -zxvf lzo-2.06.tar.gz
./configure -enable-shared -prefix=/usr/local/hadoop/lzo/
make && make test && make install
(2)安装LZOP
wget http://www.lzop.org/download/lzop-1.03.tar.gz
tar -zxvf lzop-1.03.tar.gz
./configure -enable-shared -prefix=/usr/local/hadoop/lzop
make && make install
(3)把lzop复制到/usr/bin/
ln -s /usr/local/hadoop/lzop/bin/lzop /usr/bin/lzop
(4)测试lzop
lzop /home/hadoop/data/access_20131219.log
页:
[1]