2018-09-06期 Sqoop工具安裝配置

說明：

Sqoop(發音：skup)是一款開源的工具，主要用於在Hadoop(Hive)與傳統的數據庫(mysql、postgresql...)間進行數據的傳遞，能夠將一個關係型數據庫（例如 ： MySQL ,Oracle ,Postgres等）中的數據導進到Hadoop的HDFS中，也能夠將HDFS的數據導進到關係型數據庫中。Sqoop依賴於hadoop

1、安裝介質

安裝包：sqoop-1.4.4.bin__hadoop-2.0.4-alpha.tar.gz

2、解壓安裝介質

[root@hadoop-server01 apps]# tar -xvf sqoop-1.4.4.bin__hadoop-2.0.4-alpha.tar.gz -C /usr/local/apps/

3、修改配置文件

這裏只須要修改sqoop-env.sh文件便可

#cd /usr/local/apps/sqoop-1.4.4.bin__hadoop-2.0.4-alpha/conf

[root@hadoop-server01 conf]# mv sqoop-env-template.sh sqoop-env.sh

[root@hadoop-server01 conf]# vi sqoop-env.sh

#Set path to where bin/hadoop is available

export HADOOP_COMMON_HOME=/usr/local/apps/hadoop-2.4.1

#Set path to where hadoop-*-core.jar is available

export HADOOP_MAPRED_HOME=/usr/local/apps/hadoop-2.4.1

#set the path to where bin/hbase is available

export HBASE_HOME=/usr/local/apps/hbase-0.96.2-hadoop2

#Set the path to where bin/hive is available

export HIVE_HOME=/usr/local/apps/hive-0.12.0-bin

#Set the path for where zookeper config dir is

export ZOOCFGDIR=/usr/local/apps/zookeeper-3.4.5/conf

4、配置環境變量

export SQOOP_HOME=/usr/local/apps/sqoop-1.4.4.bin__hadoop-2.0.4-alpha

export PATH=$PATH:$ZK_HOME/bin:$HBASE_HOME/bin:$HIVE_HOME/bin:$SQOOP_HOME/bin

5、驗證命令

[root@hadoop-server01 ~]# sqoop help      

Warning: /usr/lib/hcatalog does not exist! HCatalog jobs will fail.

Please set $HCAT_HOME to the root of your HCatalog installation.

usage: sqoop COMMAND [ARGS]

Available commands:

 codegen            Generate code to interact with database records

 create-hive-table  Import a table definition into Hive

 eval               Evaluate a SQL statement and display the results

 export             Export an HDFS directory to a database table

 help               List available commands

 import             Import a table from a database to HDFS

 import-all-tables  Import tables from a database to HDFS

 job                Work with saved jobs

 list-databases     List available databases on a server

 list-tables        List available tables in a database

 merge              Merge results of incremental imports

 metastore          Run a standalone Sqoop metastore

 version            Display version information

爲此，sqoop安裝配置完成