hadoop伪分布式系统安装部署
1.软件下载:wget http://apache.dataguru.cn/hadoop/common/hadoop-2.7.0/hadoop-2.7.0.tar.gz
wget http://download.oracle.com/otn-pub/java/jdk/7u79-b15/jdk-7u79-linux-x64.tar.gz
2.配置安装java:
tar -zxvf jdk-7u79-linux-x64.tar.gz -C /usr/local
cd /usr/local
chown -R root. /usr/local/jdk1.7.0_79
ln -s jdk1.7.0_79 jdk
echo 'export PATH=/usr/local/java/bin:$PATH;' >/etc/profile.d/java.sh
echo 'export JAVA_HOME=/usr/local/java' >>/etc/profile
source /etc/profile.d/java.sh
source /etc/profile
java -version
3.安装hadoop:
useradd hadoop
passwd hadoop
tar -zxvf hadoop-2.7.0.tar.gz -C /usr/local
chown -R hadoop:hadoop /usr/local/hadoop-2.7.0
echo 'export PATH=/usr/local/hadoop/bin:/usr/local/hadoop/sbin:$PATH;'>/etc/profile.d/hadoop.sh
source /etc/profile.d/hadoop.sh
hadoop -version
echo '127.0.0.1 myhost3' >/etc/hosts
修改/usr/local/hadoop/etc/hadoop/hadoop-env.sh的JAVA_HOME为绝对路径:
export JAVA_HOME=/usr/local/java
4.配置hadoop:
su - hadoop
cd /usr/local/hadoop/etc/hadoop;
mkdir -p /home/hadoop/temp
4.1配置core-site.xml
fs.default.name
hdfs://myhost3:9000/
hadoop.tmp.dir
/home/hadoop/temp
4.2配置mapred-site.xml
mapred.job.tracker
myhost3:9001
4.3配置hdfs-site.xml
dfs.replication
1
4.4配置ssh互信:
ssh-keygen -t rsa
ssh-copy-id -i ~/.ssh/id_rsa.pubmyhost3
ssh myhost3 "date"
4.5格式化HDFS系统
/usr/local/hadoop/bin/hadoop namenode -format
5.启动hadoop:
start-all.sh
6.检查验证:
$ jps
7365 NodeManager
7662 Jps
6800 NameNode
6902 DataNode
7250 ResourceManager
7039 SecondaryNameNode
页:
[1]