【python3.X】Scrapy學習途徑參考

如何爬取屬性在不一樣頁面的item
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/request-response.html#topics-request-response-ref-request-callback-arguments
我要如何在spider裏模擬用戶登陸呢?
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/request-response.html#topics-request-response-ref-request-userlogin
Scrapy調試內存泄漏
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/leaks.html#topics-leaks
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/leaks.html#topics-leaks-without-leaks
Scrapy項目的例子？
http://scrapy-chs.readthedocs.io/zh_CN/0.24/intro/examples.html#intro-examples
發佈Scrapy爬蟲到生產環境
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/scrapyd.html#topics-scrapyd
在spider中啓動shell來查看response.
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/shell.html#topics-shell-inspect-response

將全部爬取到的item轉存(dump)到JSON/CSV/XML文件的最簡單的方法?
dump到JSON文件:
scrapy crawl myspider -o items.json
dump到CSV文件:
scrapy crawl myspider -o items.csv
dump到XML文件:
scrapy crawl myspider -o items.xml
更多詳情請參考 http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/feed-exports.html#topics-feed-exports

樣例爬蟲
http://github.com/AmbientLighter/rpn-fas/blob/master/fas/spiders/rnp.py
如何避免個人Scrapy機器人(bot)被禁止(ban)呢？
http://scrapy-chs.readthedocs.io/zh_CN/0.24/topics/practices.html#bans