部署hadoop標準文檔及標準目錄

時間 2019-12-20

標籤部署 hadoop 標準文檔目錄欄目 Hadoop 简体版

原文原文鏈接

部署hadoop標準文檔及標準目錄

版本：v1.1

安裝基礎系統

1. 操做系統安裝：centos6.3 x64

2. 分區狀況：boot分區200M，根分區50G，swap分區，>32G <64G, 剩餘空間（或者獨立磁盤分區）劃分到/data目錄。

3. 安裝套件：基礎系統、開發環境。

4. 光盤安裝：或者掛載光驅，執行yum --disablerepo=\* --enablerepo=c6-media groupinstall base 'Development tools'

datanode硬件初始化

1. RAID製做：系統盤作raid1，數據盤每一個盤獨立作raid0。

2. 格式化分區：使用下列命令進行每塊硬盤的分區和格式化。

#!/bin/bash

for i in sdb sdc sdd sde sdf sdg sdh sdi

parted /dev/$i mklabel gpt

parted /dev/$i mkpart 1 ext4 0M 2000G

mkfs.ext4 /dev/${i}1 &

done

3. 修改fstab

[root@namenode002 ~]# cat /etc/fstab

tmpfs /dev/shm tmpfs defaults 0 0

devpts /dev/pts devpts gid=5,mode=620 0 0

sysfs /sys sysfs defaults 0 0

proc /proc proc defaults 0 0

/dev/sda1 /boot ext3 defaults 1 1

/dev/sda2 / ext3 defaults 1 1

/dev/sdb1 /data/disk01 ext3 noatime,nodiratime 1 1

/dev/sdc1 /data/disk02 ext3 noatime,nodiratime 1 1

/dev/sdd1 /data/disk03 ext3 noatime,nodiratime 1 1

/dev/sde1 /data/disk04 ext3 noatime,nodiratime 1 1

/dev/sdf1 /data/disk05 ext3 noatime,nodiratime 1 1

/dev/sdg1 /data/disk06 ext3 noatime,nodiratime 1 1

/dev/sdh1 /data/disk07 ext3 noatime,nodiratime 1 1

/dev/sdi1 /data/disk08 ext3 noatime,nodiratime 1 1

[root@namenode002 ~]# mkdir -p /data/disk0{1,2,3,4,5,6,7,8}

[root@namenode002 ~]# mount -a

[root@namenode002 ~]# cat /etc/mtab

/dev/sda2 / ext3 rw 0 0

proc /proc proc rw 0 0

sysfs /sys sysfs rw 0 0

devpts /dev/pts devpts rw,gid=5,mode=620 0 0

tmpfs /dev/shm tmpfs rw 0 0

/dev/sda1 /boot ext3 rw 0 0

none /proc/sys/fs/binfmt_misc binfmt_misc rw 0 0

/dev/sdb1 /data/disk01 ext3 rw,noatime,nodiratime 0 0

/dev/sdc1 /data/disk02 ext3 rw,noatime,nodiratime 0 0

/dev/sdd1 /data/disk03 ext3 rw,noatime,nodiratime 0 0

/dev/sde1 /data/disk04 ext3 rw,noatime,nodiratime 0 0

/dev/sdf1 /data/disk05 ext3 rw,noatime,nodiratime 0 0

/dev/sdg1 /data/disk06 ext3 rw,noatime,nodiratime 0 0

/dev/sdh1 /data/disk07 ext3 rw,noatime,nodiratime 0 0

/dev/sdi1 /data/disk08 ext3 rw,noatime,nodiratime 0 0

設置系統環境

在每臺服務器上執行以下操做：

1. 修改網絡設置IP地址，主機名。

2. 關閉selinux，關閉iptables服務。sed -i 's/SELINUX=enforcing/SELINUX=disabled/' /etc/selinux/config

3. 設置/etc/hosts 文件，將hadoop列表全部機器添加到host文件中。

[root@namenode01 ~]# cat /etc/hosts

192.168.12.235 namenode01

192.168.12.236 datanode01

192.168.12.237 datanode02

192.168.12.238 datanode03

192.168.12.239 namenode02

192.168.12.240 jobtracker01

4. 修改yum.conf

sed -i 's/keepcache=0/keepcache=1/' /etc/yum.conf

5. 修改服務運行級別

/etc/init.d/iptables stop;chkconfig iptables off

6. 作ssh信任受權。

for i in datanode004 datanode005 datanode006 datanode007; do scp -rp .ssh/ root@$i:/root/; done

7. 修改dns，更新ntp時間。

[root@namenode001 ~]# for i in `cat /etc/hosts|awk '{print $2}'|grep -v localhost`; do scp /etc/resolv.conf root@$i:/etc/;ssh root@$i ntpdate dns.elong.cn;ssh root@$i hwclock -w;ssh $i chkconfig ntpd on; scp /etc/ntp.conf root@$i:/etc/;ssh $i /etc/init.d/ntpd restart; done

8. 批量重啓

for i in `cat /etc/hosts|awk '{print $2}'|grep -v localhost|tac`;do ssh root@$i shutdown -r now;done

9. 拷貝軟件安裝包

for i in datanode004 datanode005 datanode006 datanode007; do scp jdk-6u37-linux-x64.bin mysql-connector-java-5.1.22.tar.gz cloudera-cdh-4-0.noarch.rpm root@$i:/root/; done

10. 設置mount環境

mkdir -p /opt/hadoop;yum -y install nfs-utils

安裝jdk

在每臺服務器上執行以下操做：

1. 安裝 jdk-6u37-linux-x64.bin

chmod +x jdk-6u37-linux-x64.bin ;./jdk-6u37-linux-x64.bin

mv jdk1.6.0_37/ /usr/local/jdk

2. 安裝cdh源

rpm -ivh http://archive.cloudera.com/cdh4/one-click-install/redhat/6/x86_64/cloudera-cdh-4-0.noarch.rpm

配置環境變量jdk

1. 增長jdk環境變量

[root@namenode01 ~]# cat /etc/profile

# for java env

export JAVA_HOME=/usr/local/jdk

export PATH=$JAVA_HOME/bin:$PATH

export CLASSPATH=.:$JAVA_HOME/lib/tools.jar:$JAVAHOME/lib/dt.jar

[root@namenode01 ~]# java -version

java version "1.6.0_37"

Java(TM) SE Runtime Environment (build 1.6.0_37-b06)

Java HotSpot(TM) 64-Bit Server VM (build 20.12-b01, mixed mode)

安裝hadoop

1. 安裝namenode

yum install hadoop-hdfs-namenode

chkconfig hadoop-hdfs-namenode on

2. 安裝secondary namenode

yum install hadoop-hdfs-secondarynamenode

chkconfig hadoop-hdfs-secondarynamenode on

3. 安裝jobtracker

yum install hadoop-0.20-mapreduce-jobtracker

chkconfig hadoop-0.20-mapreduce-jobtracker on

4. 安裝datanode 和 tasktracker

yum install hadoop-0.20-mapreduce-tasktracker hadoop-hdfs-datanode

chkconfig hadoop-0.20-mapreduce-tasktracker on;chkconfig hadoop-hdfs-datanode on

5. 安裝hadoop客戶端

yum install hadoop-client

6. 將下列JAVA運行環境添加到上述各類hadoop的啓動腳本的第二行中，以便於開機啓動。

[root@namenode01 ~]# vi /etc/init.d/hadoop-hdfs-namenode

#!/bin/bash

export JAVA_HOME=/usr/local/jdk

export CLASSPATH=.:$JAVA_HOME/lib/tools.jar:$JAVA_HOME/lib/dt.jar

export PATH=$JAVA_HOME/bin:$PATH

配置hadoop

1. 配置文件

[root@namenode01 ~]# rm -f /etc/hadoop/conf/; cp -rp /etc/hadoop/conf.empty /etc/hadoop/conf

[root@namenode01 ~]# cat /etc/hadoop/conf/masters

namenode02

[root@namenode01 ~]# cat /etc/hadoop/conf/slaves

datanode01

datanode02

datanode03

[root@namenode01 ~]# cat /etc/hadoop/conf/core-site.xml

<?xml version="1.0" encoding="UTF-8"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<name>fs.default.name</name>

<value>hdfs://namenode001:9000</value>

</property>

<name>hadoop.tmp.dir</name>

</property>

</configuration>

[root@namenode01 ~]# cat /etc/hadoop/conf/hdfs-site.xml

<?xml version="1.0" encoding="UTF-8"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<description>Name node save the metadata namespace</description>

</property>

</property>

<name>dfs.replication</name>

</property>

<name>dfs.webhdfs.enabled</name>

</property>

<name>dfs.namenode.http-address</name>

<value>namenode01:50070</value>

<description>The address and the base port on which the dfs NameNode Web UI will listen. If the port is 0, the server will start on a free port.</description>

</property>

</configuration>

[root@namenode01 ~]# cat /etc/hadoop/conf/mapred-site.xml

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<name>mapred.job.tracker</name>

<value>jobtracker001:9001</value>

</property>

<name>mapred.local.dir</name>

<value>/tmp/hadoop/mapred/local</value>

</property>

<name>mapred.system.dir</name>

<value>/mapred/system</value>

</property>

</configuration>

2. 在namenode上執行建立目錄

[root@namenode002 ~]# mkdir -p /data/disk0{1,2,3,4,5,6,7,8}/hdfs ; mkdir -p /data/disk0{1,2,3,4,5,6,7,8}/mapred/local ; chown -R hdfs /data/disk0{1,2,3,4,5,6,7,8}/hdfs ; chown -R mapred /data/disk0{1,2,3,4,5,6,7,8}/mapred/local ;

[root@namenode002 ~]# chown -R mapred /usr/lib/hadoop-0.20-mapreduce/bin/../logs/

[root@namenode002 ~]# su - hdfs

-bash-4.1$ hadoop fs -mkdir /mapred/system

-bash-4.1$ hadoop fs -chown -R mapred /mapred/system

-bash-4.1$ hdfs namenode -format

12/11/21 19:50:30 INFO namenode.NameNode: STARTUP_MSG:

/************************************************************

STARTUP_MSG: Starting NameNode

STARTUP_MSG: host = namenode002/10.35.66.11

STARTUP_MSG: args = [-format]

STARTUP_MSG: version = 2.0.0-cdh4.1.2

STARTUP_MSG: classpath = /etc/hadoop/conf:/usr/lib/hadoop/lib/guava-11.0.2.jar:/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/junit-4.8.2.jar:/usr/lib/hadoop/lib/commons-configuration-1.6.jar:/usr/lib/hadoop/lib/commons-logging-1.1.1.jar:/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar:/usr/lib/hadoop/lib/zookeeper-3.4.3-cdh4.1.2.jar:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop/lib/asm-3.2.jar:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/lib/hadoop/lib/commons-io-2.1.jar:/usr/lib/hadoop/lib/commons-digester-1.8.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop/lib/kfs-0.3.jar:/usr/lib/hadoop/lib/commons-lang-2.5.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop/lib/servlet-api-2.5.jar:/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar:/usr/lib/hadoop/lib/activation-1.1.jar:/usr/lib/hadoop/lib/jline-0.9.94.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/jersey-server-1.8.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar:/usr/lib/hadoop/lib/jersey-json-1.8.jar:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar:/usr/lib/hadoop/lib/log4j-1.2.17.jar:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop/lib/jersey-core-1.8.jar:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop/lib/stax-api-1.0.1.jar:/usr/lib/hadoop/lib/jsp-api-2.1.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop/lib/paranamer-2.3.jar:/usr/lib/hadoop/lib/jsr305-1.3.9.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/jettison-1.1.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar:/usr/lib/hadoop/lib/commons-collections-3.2.1.jar:/usr/lib/hadoop/lib/avro-1.7.1.cloudera.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop/lib/commons-math-2.1.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop/lib/commons-net-3.1.jar:/usr/lib/hadoop/.//hadoop-common.jar:/usr/lib/hadoop/.//hadoop-auth.jar:/usr/lib/hadoop/.//hadoop-annotations-2.0.0-cdh4.1.2.jar:/usr/lib/hadoop/.//hadoop-annotations.jar:/usr/lib/hadoop/.//hadoop-common-2.0.0-cdh4.1.2.jar:/usr/lib/hadoop/.//hadoop-auth-2.0.0-cdh4.1.2.jar:/usr/lib/hadoop/.//hadoop-common-2.0.0-cdh4.1.2-tests.jar:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar:/usr/lib/hadoop-hdfs/lib/zookeeper-3.4.3-cdh4.1.2.jar:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar:/usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar:/usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar:/usr/lib/hadoop-hdfs/lib/jline-0.9.94.jar:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar:/usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar:/usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.0.0-cdh4.1.2.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.0.0-cdh4.1.2-tests.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/lib/hadoop-yarn/.//*:/usr/lib/hadoop-0.20-mapreduce/./:/usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar:/usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar:/usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar:/usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.1.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar:/usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.1.cloudera.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.1.cloudera.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-2.0.0-mr1-cdh4.1.2-test.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-2.0.0-mr1-cdh4.1.2-ant.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-examples-2.0.0-mr1-cdh4.1.2.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-examples.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-2.0.0-mr1-cdh4.1.2-tools.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-tools-2.0.0-mr1-cdh4.1.2.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-ant-2.0.0-mr1-cdh4.1.2.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-2.0.0-mr1-cdh4.1.2-core.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-test-2.0.0-mr1-cdh4.1.2.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-test.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-core.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-core-2.0.0-mr1-cdh4.1.2.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-ant.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-2.0.0-mr1-cdh4.1.2-examples.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-tools.jar

STARTUP_MSG: build = file:///data/1/jenkins/workspace/generic-package-rhel64-6-0/topdir/BUILD/hadoop-2.0.0-cdh4.1.2/src/hadoop-common-project/hadoop-common -r f0b53c81cbf56f5955e403b49fcd27afd5f082de; compiled by 'jenkins' on Thu Nov 1 17:33:23 PDT 2012

************************************************************/

12/11/21 19:50:31 WARN common.Util: Path /data/disk01/hdfs/name should be specified as a URI in configuration files. Please update hdfs configuration.

12/11/21 19:50:31 WARN common.Util: Path /data/disk02/hdfs/name should be specified as a URI in configuration files. Please update hdfs configuration.

12/11/21 19:50:31 WARN common.Util: Path /data/disk03/hdfs/name should be specified as a URI in configuration files. Please update hdfs configuration.

12/11/21 19:50:31 WARN common.Util: Path /data/disk04/hdfs/name should be specified as a URI in configuration files. Please update hdfs configuration.

12/11/21 19:50:31 WARN common.Util: Path /data/disk05/hdfs/name should be specified as a URI in configuration files. Please update hdfs configuration.

12/11/21 19:50:31 WARN common.Util: Path /data/disk06/hdfs/name should be specified as a URI in configuration files. Please update hdfs configuration.

12/11/21 19:50:31 WARN common.Util: Path /data/disk07/hdfs/name should be specified as a URI in configuration files. Please update hdfs configuration.

12/11/21 19:50:31 WARN common.Util: Path /data/disk08/hdfs/name should be specified as a URI in configuration files. Please update hdfs configuration.