CDH5.7整合安裝kafka0.9.0

1. 準備安裝包

csd包：

        http://archive.cloudera.com/csds/kafka/

        KAFKA-1.2.0.jar

parcel包：

        http://archive.cloudera.com/kafka/parcels/latest/ （根據本身的集羣的系統版本下載 ）

        KAFKA-2.0.2-1.2.0.2.p0.5-wheezy.parcel

        KAFKA-2.0.2-1.2.0.2.p0.5-wheezy.parcel.sha

        manifest.json

2. CDH集成Kafka

        2.1 將原來Kafka的在CDH中刪除

        2.二、csd包放到cm安裝節點下的 /opt/cloudera/csd目錄下

                cp KAFKA-1.2.0.jar /opt/cloudera/csd/

        2.三、將parcel包放到cm安裝節點下的/opt/cloudera/parcel-repo目錄下

                cp KAFKA-2.0.2-1.2.0.2.p0.5-wheezy.parcel /opt/cloudera/parcel-repo/

                cp KAFKA-2.0.2-1.2.0.2.p0.5-wheezy.parcel.sha /opt/cloudera/parcel-repo/

        2.四、使用manifest.json中對應的部分，添加到/opt/cloudera/parcel-repomanifest.json中

                vi /opt/cloudera/parcel-repo/manifest.json

                添加

{
            "parcelName": "KAFKA-2.0.2-1.2.0.2.p0.5-wheezy.parcel",
            "components": [
                {
                    "pkg_version": "0.9.0+kafka2.0.2",
                    "pkg_release": "1.2.0.2.p0.5",
                    "name": "kafka",
                    "version": "0.9.0-kafka2.0.2"
                }
            ],
            "depends": "CDH (>= 5.2), CDH (<< 6.0)",
            "replaces": "CLABS_KAFKA",
            "hash": "8756ae832d388880a8f8c38b6569f461996c84bc"
        }

        2.五、啓動Cloudera Manager，檢查更新parcel，分配並激活percel包

                注意此處必定要激活才能使用：

                CM主頁 -> Hosts -> parcel -> 檢查新parcel -> 配置 -> 激活

3.安裝kafka

若是啓動時出現內存溢出錯誤（java.lang.OutOfMemoryError: Java heap space）

        主頁服務列表 -> kafka -> 配置 -> Kafka-Broker -> Java Heap Size of Broker

        修改參數到256以上便可