Cloudera Manager安裝部署

1:下載jdk1.8

2新建/usr/java文件夾

   將jdk-8u11-linux-x64.tar.gz放到該文件夾中,並將工做目錄切換到/usr/java目錄下。以下圖所示: java

 

解壓 tar -xzvf jdk-8u11-linux-x64.tar.gz python

 

3:配置環境變量

進入etc/profile linux

 

添加環境變量配置。 web

4:設置profile使其當即生效

 

5:Establish Your Cloudera Manager Repository Strategy(建立Cloudera Manager 倉庫源信息)

 

添加內容爲 shell

Wq退出vim編輯器 vim

 

6.安裝Cloudera Manager Server Packages

 

 

7.安裝Cloudera Manager Agent Packages

 

安裝cloudera-manager-agent-5.5.1-1.cm551.p0.8.el6.x86_64.rpm centos

安裝MySQL-python-1.2.3-0.3.c1.1.el6.x86_64.rpm tomcat

安裝mod_ssl-2.2.15-47.el6.centos.1.x86_64.rpm 編輯器

安裝python-psycopg2-2.0.14-2.el6.x86_64.rpm oop

升級安裝httpd-2.2.15-47.el6.centos.1.x86_64.rpm                                                                          

升級安裝httpd-tools-2.2.15-47.el6.centos.1.x86_64.rpm

若是rpm包沒有下載那直接用

yum install cloudera-manager-agent cloudera-manager-daemons

若是下載了rmp包:

sudo yum --nogpgcheck localinstall cloudera-manager-agent-*.rpm


8配置Cloudera Manager Agent文件

 /etc/cloudera-scm-agent/config.ini

server_host Cloudera Manager Server的主機名

server_port Cloudera Manager Server的端口號

9安裝CDH和管理的各類服務包

Download the CDH 5 "1-click Install" package (or RPM).

下載cloudera-cdh-5-0.x86_64.rpm

wget https://archive.cloudera.com/cdh5/one-click-install/redhat/6/x86_64/cloudera-cdh-5-0.x86_64.rpm

yum --nogpgcheck localinstall cloudera-cdh-5-0.x86_64.rpm 

add a repository key

rpm --import https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera

安裝CDH packages:

yum clean all

yum install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs hadoop-kms hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-core spark-master spark-worker spark-history-server spark-python sqoop sqoop2 whirr

 

以上會安裝如下的包

avro-tools

crunch

flume-ng

hadoop-hdfs-fuse

hadoop-hdfs-nfs3

hadoop-httpfs

hadoop-kms

hbase-solr

hive-hbase

hive-webhcat

hue-beeswax

hue-hbase

hue-impala

hue-pig

hue-plugins

hue-rdbms

hue-search

hue-spark

hue-sqoop

hue-zookeeper

impala

impala-shell

kite

llama

mahout

oozie

pig

pig-udf-datafu

search

sentry

solr-mapreduce

spark-core

spark-history-server

spark-master

spark-python

spark-worker

sqoop

sqoop2

whirr

安裝如下的依賴包

avro-libs

bigtop-jsvc

bigtop-tomcat

bigtop-utils

hadoop

hadoop-0.20-mapreduce

hadoop-client

hadoop-hdfs

hadoop-libhdfs

hadoop-mapreduce

hadoop-yarn

hbase

hive

hive-hcatalog

hive-jdbc

hue-common

oozie-client

parquet

parquet-format

solr

sqoop2-client

zookeeper

 

若是以上的包都已經下載到本地了的目錄cdh-service-rpm

cd cdh-service-rpm/

yum install *

 12.進入****:7180管理界面進行各個節點集羣安裝。

13:省略

相關文章
相關標籤/搜索