Hadoop HDFS 單節點部署方案

初學者，再次記錄一下。

確保Java 和 Hadoop已安裝完畢(每一個人的不必定同樣，但確定都有數據，僅供參考)

 

[root@jans hadoop-2.9.0]# pwd
/usr/local/hadoop-2.9.0
[root@jans hadoop-2.9.0]# echo $JAVA_HOME
/usr/
[root@jans hadoop-2.9.0]# java -version
openjdk version "1.8.0_161"
OpenJDK Runtime Environment (build 1.8.0_161-b14)
OpenJDK 64-Bit Server VM (build 25.161-b14, mixed mode)
[root@jans hadoop-2.9.0]# echo $HADOOP_HOME
/usr/local/hadoop-2.9.0
[root@jans hadoop-2.9.0]# ./bin/hadoop version
Hadoop 2.9.0
Subversion https://git-wip-us.apache.org/repos/asf/hadoop.git -r 756ebc8394e473ac25feac05fa493f6d612e6c50
Compiled by arsuresh on 2017-11-13T23:15Z
Compiled with protoc 2.5.0
From source with checksum 0a76a9a32a5257331741f8d5932f183
This command was run using /usr/local/hadoop-2.9.0/share/hadoop/common/hadoop-common-2.9.0.jar

Java and Hadoop 安裝狀態查看

 

 

 

hadoop根目錄：

　　/usr/local/hadoop-2.9.0/

確保當前工做目錄處於Hadoop根目錄

1：編輯配置文件
編輯文件：/usr/local/hadoop-2.9.0/etc/hadoop/core-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
  Licensed under the Apache License, Version 2.0 (the "License");
  you may not use this file except in compliance with the License.
  You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License. See accompanying LICENSE file.
-->

<!-- Put site-specific property overrides in this file. -->

<configuration>
    <property>
      <name>hadoop.tmp.dir</name>
      <value>file:/home/hadoop/tmp</value>
      <description>Abase for other temporary directories.</description>
    </property>
    <property>
      <name>fs.defaultFS</name>
      <value>hdfs://localhost:9000</value>
    </property>
</configuration>

編輯文件：/usr/local/hadoop-2.9.0/etc/hadoop/hdfs-site.xml

<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!--
  Licensed under the Apache License, Version 2.0 (the "License");
  you may not use this file except in compliance with the License.
  You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software
  distributed under the License is distributed on an "AS IS" BASIS,
  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  See the License for the specific language governing permissions and
  limitations under the License. See accompanying LICENSE file.
-->

<!-- Put site-specific property overrides in this file. -->

<configuration>
    <property>
      <name>dfs.replication</name>
      <value>1</value>
    </property>
    <property>
      <name>dfs.namenode.name.dir</name>
      <value>file:/home/hadoop/tmp/dfs/name</value>
    </property>
    <property>
      <name>dfs.datanode.data.dir</name>
      <value>file:/home/hadoop/tmp/dfs/data</value>
    </property> 
 
</configuration>

2：格式化節點

./bin/hadoop namenode -format

3：啓動服務

 ./sbin/start-all.sh 

此操做會啓動兩個服務：

　　This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh

4：狀態查看

http://{IP address}:50070 查看概況

http://{IP address}:50075 查看Node Status

http://{IP address}:8088 查看Hadoop 集羣狀態

若是看不到數據則部署失敗

其餘端口查看