step1: python & scrapy安裝

#首先安裝python,這裏安裝python所需依賴包
yum install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gcc make

 

#解壓縮安裝包並編譯安裝
tar -zxvf Python-3.6.2.tgz

cd Python-3.6.2

./configure --prefix=/usr/local

make && make install

#建立軟連接
mv python python.bak

ln -s /usr/local/bin/python3 /usr/bin/python

#pip安裝scrapy爬蟲框架
pip3 install -i https://pypi.douban.com/simple scrapy

 

按照以下所示配置pycharm遠端服務器：