源码编译hadoop-2.5.1成功案例
部署环境：系统：CentOS 6.4 64bit
Hadoop 版本：hadoop-2.5.1
jdk 版本：jdk-7u65-linux-x64.gz（注意：本人刚开始用的jdk1.8,不行，用的jdk1.7才顺利编译成功）
1、安装hadoop所需要依赖的包
yum -y install lzo-devel zlib-devel gcc autoconf automake libtool gcc-c++
yum -y install openssl-devel ncurses-devel
2、编译hadoop依赖环境
Ant
Maven
ProtocolBuffer
findbugs
CMak
3、编译安装Protobuf
tar xf protobuf-2.5.0.tar.gz
cd protobuf-2.5.0
./configure --prefix=/usr/local/protobuf
make && make install
4、编译安装cmake
tar xf cmake-2.8.12.tar.gz
cd cmake-2.8.12
./bootstrap
make && make install
5、Ant安装
tar -zxvf apache-ant-1.9.4-bin.tar.gz
root用户安装
cp apache-ant-1.9.4 /usr/local/ant
建一个default的软link，方便后面设置环境还有以后更新
cd /usr/local/ant
ln -s usr/local/apache-ant-1.9.4 ant_default
用root用户进入
cd /usr/sbin
建立脚本的软链接
ln -s /usr/local/ant/ant_default/bin/ant ant
6、maven安装
tar -zxvf apache-maven-3.2.3-bin.tar.gz
cp apache-maven-3.2.3 /usr/local/maven
cd usr/local/maven
ln -s /usr/local/apache-maven/-3.2.3 maven_default
cd /usr/sbin
ln -s /usr/local/maven_default/bin/mvn mvn
7、findbugs安装
tar xf findbugs-2.0.2.tar.gz -C /usr/local/
8、环境变量配置
protobuf
export PROTOBUF_HOME=/usr/local/protobuf
export> export PATH=$PATH:$PROTOBUF_HOME/bin
findbugs
export FINDBUGS_HOME=/usr/local/findbugs-2.0.2
export> export PATH=$PATH:$FINDBUGS_HOME/bin
9.加入配置
cd hadoop-2.5.1-src
vim hadoop-common-project/hadoop-auth/pom.xml
加入内容如下：
org.mortbay.jetty
jetty-util
test
org.mortbay.jetty
jetty
test
10.测试环境是否配置成功
java -version
ant -version
mvn -version
findbugs -version
protoc --version
11.开始编译 进入hadoop源码包
cd hadoop-2.5.1-src
mvn package -Pdist -DskipTests -Dtar
等待安装大概40分钟左右
Reactor Summary:
Apache Hadoop Main ................................. SUCCESS
Apache Hadoop Project POM .......................... SUCCESS
Apache Hadoop Annotations .......................... SUCCESS [ 10.227 s]
Apache Hadoop Assemblies ........................... SUCCESS
Apache Hadoop Project Dist POM ..................... SUCCESS
Apache Hadoop Maven Plugins ........................ SUCCESS
Apache Hadoop MiniKDC .............................. SUCCESS
Apache Hadoop Auth ................................. SUCCESS
Apache Hadoop Auth Examples ........................ SUCCESS
Apache Hadoop Common ............................... SUCCESS
Apache Hadoop NFS .................................. SUCCESS [ 22.756 s]
Apache Hadoop Common Project ....................... SUCCESS
.............
Apache Hadoop MapReduce Streaming .................. SUCCESS [ 15.821 s]
Apache Hadoop Distributed Copy ..................... SUCCESS [ 33.312 s]
Apache Hadoop Archives ............................. SUCCESS
Apache Hadoop Rumen ................................ SUCCESS [ 15.896 s]
Apache Hadoop Gridmix .............................. SUCCESS [ 10.355 s]
Apache Hadoop Data Join ............................ SUCCESS
Apache Hadoop Extras ............................... SUCCESS
Apache Hadoop Pipes ................................ SUCCESS
Apache Hadoop OpenStack support .................... SUCCESS [ 13.306 s]
Apache Hadoop Client ............................... SUCCESS [ 16.149 s]
Apache Hadoop Mini-Cluster ......................... SUCCESS
Apache Hadoop Scheduler Load Simulator ............. SUCCESS [ 26.096 s]
Apache Hadoop Tools Dist ........................... SUCCESS [ 15.652 s]
Apache Hadoop Tools ................................ SUCCESS
Apache Hadoop Distribution ......................... SUCCESS
------------------------------------------------------------------------
BUILD SUCCESS
------------------------------------------------------------------------
Total time: 29:39 min
Finished at: 2014-10-19T12:06:47+08:00
Final Memory: 92M/239M
------------------------------------------------------------------------
#
安装成功
进入编译的hadoop源码包
cd hadoop-2.5.1-src/hadoop-dist/target/
ll 能看到hadoop-2.5.1
hadoop-2.5.1.tar.gz就是你编译好的hadoop
ll hadoop-2.5.1
drwxr-xr-x 2 root root4096 10月 19 12:05 bin
drwxr-xr-x 3 root root4096 10月 19 12:05 etc
drwxr-xr-x 2 root root4096 10月 19 12:05 include
drwxr-xr-x 2 root root4096 10月 19 12:05 libexec
-rw-r--r-- 1 root root 15458 10月 19 12:05 LICENSE.txt
-rw-r--r-- 1 root root 101 10月 19 12:05 NOTICE.txt
-rw-r--r-- 1 root root1366 10月 19 12:05 README.txt
drwxr-xr-x 2 root root4096 10月 19 12:05 sbin
drwxr-xr-x 4 root root4096 10月 19 12:05 share
嘻嘻，做了这么多的准备，然后去安心的部署hadoop环境吧！
页:
[1]