Centos7 部署 Aambari 集羣

官網連接
https://docs.hortonworks.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-installation/content/mmsr_max_open_file_reqs.html

1.環境要求：cenots 7
軟件要求：本地yum 源,Openssl(V1.0),Python 2.7.x,OracleJDK 1.8,scp,unzip,curl,
查看安裝版本
openssl version
java -version
python --version

Aambari-server端須要一個關係型數據庫：Mysql5.6或者Postgresql 9.x

安裝jdk
# mkdir /usr/local/jdk
# tar -xvf jdk-8u131-linux-x64.tar.gz -C /usr/local/jdk/

# vim /etc/profile
export JAVA_HOME=/usr/local/jdk/jdk1.8.0_131
export JRE_HOME=$JAVA_HOME/jre
export CLASSPATH=:$JAVA_HOME/lib:$JRE_HOME/lib
export PATH=$PATH:$JAVA_HOME/bin:$JRE_HOME/bin

# source /etc/profile
# java -version

打開最大文件要求（每一臺主機）
ulimit -n 10000

2.爲集羣主機配置互信
在Ambari Server中，確保能夠使用SSH鏈接到集羣中的每一個主機，而沒必要輸入密碼。
ssh-keygen #一路回車,生成密鑰
for host in 192.168.10.20 192.168.0.21; do
ssh-copy-id -i ~/.ssh/id_rsa.pub $host
done

配置本地系統鏡像源
vim /etc/yum.repos.d/yum.repo
[Media_local]
name=CentOS-Media
baseurl=file:///media/mnt
gpgcheck=0
enabled=1

mkdir -p /media/mnt
mount /dev/sr0 /media/mnt

安裝http服務,配置本地http源
yum install -y httpd

配置httpdf服務打開目錄
vim /etc/httpd/conf.d/welcome.conf
<LocationMatch "^/+$">
Options Indexes #將Indexes前面的 - 去掉
ErrorDocument 403 /.noindex.html
</LocationMatch>

# mkdir -p /var/www/html/ambari-hdp
將ambari須要的包解壓到var/www/html/ambari-hdp 下
# tar -zxvf ambari-2.2.1.0-centos7.tar.gz -C /var/www/html/ambari-hdp/
# tar -zxvf HDP-2.4.0.0-centos7-rpm.tar.gz -C /var/www/html/ambari-hdp/
# tar -zxvf HDP-GPL-3.1.0.0-centos7-gpl.tar.gz -C /var/www/html/ambari-hdp/
# tar -zxvf HDP-UTILS-1.1.0.20-centos7.tar.gz -C /var/www/html/ambari-hdp/HDP-UTILS

保存重啓httpd服務
web 訪問下http服務能不能看到解壓的目錄(看到則正常)

在ambari.server上執行：
# yum localinstall -y yum-plugin-priorities-1.1.31-50.el7.noarch.rpm
# 設置爲如下內容
vi /etc/yum/pluginconf.d/priorities.conf
[main]
enabled=1
gpgcheck=0

3.在server端配置NTP服務器，客戶端同步時間後在部署就行
yum install -y ntp
vi /etc/ntp.conf
服務端：
restrict 192.168.10.0 mask 255.255.255.0 nomodify notrap
restrict 127.0.0.1
restrict ::1
server 127.127.1.0
fudge 127.127.1.0 stratum 10

客戶端：
server 192.168.10.20(服務端IP)
restrict 192.168.10.20 nomodify notrap noquery
fudge 192.168.10.20 stratum 10

時區配置爲上海
rm -rf /etc/localtime
ln -s /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

4.配置網絡主機名
vi /etc/sysconfig/network
NETWORKING=yes
HOSTNAME=hostname

vi /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
192.168.10.20 test20
192.168.10.21 test21
192.168.10.22 test22

 

5.安裝基礎數據庫
yum install -y postgresql*
yum install postgresql-jdbc*

安裝ambari-server
yum install -y ambari-server
ambari初始化數據庫組件爲postgresql
ambari-server setup --jdbc-db=postgres --jdbc-driver=/usr/share/java/postgresql-jdbc.jar

確認.jar文件位於java共享目錄中
ll /usr/share/java/postgresql-jdbc.jar
chmod 644 /usr/share/java/postgresql-jdbc.jar

postgresql 初始化並啓動
postgresql-setup initdb
systemctl start postgresql
su - postgres
psql

建立基礎數據庫和用戶
CREATE DATABASE "ambaridb";
CREATE DATABASE "hivedb";
CREATE USER rangerdba with password 'citms';
CREATE USER hive with password 'citms';
GRANT ALL PRIVILEGES ON DATABASE ambaridb TO rangerdba;
GRANT ALL PRIVILEGES ON DATABASE hivedb TO hive;
\connect ambaridb;
create schema ambari AUTHORIZATION rangerdba;
alter schema ambari owner to rangerdba;
alter role rangerdba set search_path to 'ambari','public';

修改配置文件
vim /var/lib/pgsql/data/postgresql.conf
listen_addresses='localhost' 改成 listen_addresses='本機IP'

vim /var/lib/pgsql/data/pg_hba.conf
修改一下內容
# "local" is for Unix domain socket connections only
local all * trust
# IPv4 local connections:
host all * 0.0.0.0/0 trust

編輯完成後，用postgres 刷新配置
su - postgres
pg_ctl -D $PGDATA reload

導入基礎數據
psql -U rangerdba -d ambaridb
\i /var/lib/ambari-server/resources/Ambari-DDL-Postgres-CREATE.sql
----------------------------------------------------------------------

ambari-server setup
根據提示選擇進行安裝
1.y
2.回車
3.Enable Ambari Server to download and install GPL Licensed LZO packages [y/n] (n)
4.Enter advanced database configuration [y/n] (n)? y
選擇4
5.Enter choice (1): 4
Hostname (localhost): 192.168.0.237
Port (5432):
Database name (ambari): ambaridb
Postgres schema (ambari):
Username (ambari): rangerdba
Enter Database Password (bigdata):
Re-enter password:
Configuring ambari database...
----------------------------------------------------------

啓動服務
ambari-server start

Server started listening on 8080
DB configs consistency check: no errors and warnings were found.
Ambari Server 'start' completed successfully.
----------------------------------------------------------

訪問Web初始化配置集羣
http:server_IP:8080
admin/admin

安裝集羣時：
1.發現主機配置輸入主機名,不要用IP
將ambari-server 的私鑰複製進Host Registration Information 文件中
而且agent端須要安裝客戶端
yum install -y ambari-agent

2.安裝hadoop組件時可能會提示安裝hadoop_3_1_0_0_78 包失敗
緣由是缺乏包(已經離線下載到壓縮包中)
yum localinstall -y libtirpc-0.2.4-0.15.el7.x86_64.rpm
yum localinstall -y libtirpc-devel-0.2.4-0.15.el7.x86_64.rpm

 

############################################
報錯解決
1.hive啓動報錯
Sys DB and Information Schema not created yet

解決方案：
cd /etc/hive/
touch /etc/hive/sys.db.created
進入ambari-server 端重啓
ambari-server restart

Advance_SSL報錯密碼和帳戶名同樣：admin/admin