爬蟲開始

1.安裝scrapy

pip install scrapy

 

2.新建scrapy項目

scrapy startproject douban 

 

3.新建scrapy_spider

cd douban/spiders 

scrapy genspider douban_spider movie.douban.com

 

4.運行項目並保持到csv或json

 

# 運行程序
scrapy crawl douban_spider

# 保存文件到json
scrapy crawl douban_spider -o test.json
 
# 保持文件到csv

scrapy crawl douban_spider -o test.csv