hadoop僞分佈式搭建

上傳jdk hadoop 編輯etc/profile export JAVA_HOME=/opt/setup/jdk1.8.0_60 export HADOOP_DEV_HOME=/opt/setup/hadoop-2.7.1 export HADOOP_MAPARED_HOME=${HADOOP_DEV_HOME} export HADOOP_COMMON_HOME=${HADOOP_DEV_HOME} export HADOOP_HDFS_HOME=${HADOOP_DEV_HOME} export YARN_HOME=${HADOOP_DEV_HOME} export HADOOP_CONF_DIR=${HADOOP_DEV_HOME}/etc/hadoop export HDFS_CONF_DIR=${HADOOP_DEV_HOME}/etc/hadoop export YARN_CONF_DIR=${HADOOP_DEV_HOME}/etc/hadoop export ZOOKEEPER_HOME=/opt/setup/zookeeper-3.4.5 export PATH=$PATH:$JAVA_HOME/bin:$HADOOP_DEV_HOME/bin:$HADOOP_DEV_HOME/sbin:$ZOOKEEPER_HOME/bin 編輯etc/hosts 192.168.80.3 hadoop1 設置網編輯 編輯etc/sysconfig/network-scripts/ifcfg-eth0 DEVICE=eth0 HWADDR=00:0C:29:78:9A:82 TYPE=Ethernet UUID=c1020d36-fe91-487b-af49-fdc888394574 ONBOOT=yes NM_CONTROLLED=yes BOOTPROTO=static IPV6INIT=no USERCTL=no IPADDR=192.168.80.3 NETMASK=255.255.255.0 GATEWAY=192.168.80.1 編輯core-site.xml fs.defaultFS hdfs://hadoop1:9000 hadoop.tmp.dir /home/hadoop/tmp 編輯hadoop-env.sh export JAVA_HOME=/opt/setup/jdk1.8.0_60 編輯hdfs-site.xml dfs.replication 1 編輯mapred-site.xml mapreduce.framework.name yarn 編輯yarn-site.xml yarn.resourcemanager.hostname hadoop1 yarn.nodemanager.aux-services mapreduce_shuffle yarn.nodemanager.aux-services.mapreduce_shuffle.class org.apache.hadoop.mapred.ShuffleHandler 關閉防火牆 service iptables stop chkconfig iptables off 配置ssh無密鑰登陸 ssh-keygen -t rsa 一路按回車； 執行：cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys 在Eclipse開發，須要在VM arguments裏添加 -DHADOOP_USER_NAME=root 啓動全部服務 進入/opt/setup/hadoop-2.7.1/sbin目錄 ./start-dfs.sh