hadoop0.23 编译
Yarn编译指南首先下载hadoop0.23版本
svn checkout http://svn.apache.org/repos/asf/hadoop/common/tags/release-0.23.0-rc1
2. 进入release-0.23.0-rc0目录下能看到INSTALL.TXT文件,这里有编译hadoop 0.23的教程.
编译前的准备:.
a) * UnixSystem
b) * JDK1.6
c) * Maven3.0
d) *Forrest 0.8 (if generating docs)
e) *Findbugs 1.3.9 (if running findbugs)
f) *ProtocolBuffer 2.4.1+ (for MapReduce)
g) *Autotools (if compiling native code)
h) *Internet connection for first build (to fetch all Maven and Hadoopdependencies)
可以根据需要安装全部或部分的工具,然后把它们加入到$PATH中. 这里介绍一下
ProtocolBuffer的安装方法:下载2.4.1版本后解压,进入目录,运行如下命令即可.
1、./configure（注：默认可能会安装在/usr/local目录下，可以加--prefix=/usr来指定安装到/usr/lib下，可以免去路径的设置）
2、make
3、make check
4、make install
ProtocolBuffer要添加环境变量: export LD_LIBRARY_PATH=/usr/local/lib
出现问题:
save java.io.IOException: error=13,Permissiondenied
chmod777 BLAAAA …..
编译: mvn package -Pdist -DskipTests –Dtar
Executed tasks
------------------------------------------------------------------------
Reactor Summary:
Apache Hadoop Main ................................ SUCCESS
Apache Hadoop Project POM ......................... SUCCESS
Apache Hadoop Annotations ......................... SUCCESS
Apache Hadoop Assemblies .......................... SUCCESS
Apache Hadoop Project Dist POM .................... SUCCESS
Apache Hadoop Auth ................................ SUCCESS
Apache Hadoop Auth Examples ....................... SUCCESS
Apache Hadoop Common .............................. SUCCESS
Apache Hadoop Common Project ...................... SUCCESS
Apache Hadoop HDFS ................................ SUCCESS
Apache Hadoop HDFS Project ........................ SUCCESS
hadoop-yarn ....................................... SUCCESS
hadoop-yarn-api ................................... SUCCESS
hadoop-yarn-common ................................ SUCCESS
hadoop-yarn-server ................................ SUCCESS
hadoop-yarn-server-common ......................... SUCCESS
hadoop-yarn-server-nodemanager .................... SUCCESS
hadoop-yarn-server-web-proxy ...................... SUCCESS
hadoop-yarn-server-resourcemanager ................ SUCCESS
hadoop-yarn-server-tests .......................... SUCCESS
hadoop-yarn-applications .......................... SUCCESS
hadoop-yarn-applications-distributedshell ......... SUCCESS
hadoop-yarn-site .................................. SUCCESS
hadoop-mapreduce-client ........................... SUCCESS
hadoop-mapreduce-client-core ...................... SUCCESS
hadoop-mapreduce-client-common .................... SUCCESS
hadoop-mapreduce-client-shuffle ................... SUCCESS
hadoop-mapreduce-client-app ....................... SUCCESS
hadoop-mapreduce-client-hs ........................ SUCCESS
hadoop-mapreduce-client-jobclient ................. SUCCESS
hadoop-mapreduce .................................. SUCCESS
Apache Hadoop Tools ............................... SUCCESS
Apache Hadoop Distribution ........................ SUCCESS
------------------------------------------------------------------------
BUILD SUCCESS
------------------------------------------------------------------------
Total time: 1:52.011s
Finished at: Fri Sep 07 13:18:27 CST 2012
Final Memory: 75M/218M
页:
[1]