11.Python使用Scrapy爬蟲小Demo(新手入門)

1.前提:已安裝好scrapy,且已新建好項目,編寫小Demo去獲取美劇天堂的電影標題名html

2.在項目中建立一個python文件python

3.代碼以下所示:scrapy

import scrapy

class movies(scrapy.Spider):

    name = 'movieUS'    #惟一標識
    start_urls = ['http://www.meijutt.com/new100.html']   #爬蟲的網址

    def parse(self, response):
        movies = response.xpath('//ul[@class="top-list  fn-clear"]/li')

        for movie in  movies:
            movie_name = movies.xpath('./h5/a/@title').extract()
            print(movie_name)

4.運行操做截圖以下所示:ide

相關文章
相關標籤/搜索