爬蟲 AJAX加載數據(JSON)

獲取JSON是最簡單的,直接輸入URL就好了不須要寫爬蟲。O(∩_∩)O哈哈~
豆瓣電影javascript

#!/usr/bin/env python
# -*- coding:utf-8 -*-
import ssl
import urllib
import urllib2

url = "https://movie.douban.com/j/search_subjects?type=tv&tag=%E7%83%AD%E9%97%A8&sort=recommend"
headers = {
    "Accept": "application/json, text/javascript, */*; q=0.01",
    "X-Requested-With": "XMLHttpRequest",
    "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.99 Safari/537.36",
    "Content-Type": "application/x-www-form-urlencoded; charset=UTF-8",
}
formdate = {"page_limit": "20", "page_start": "0"}
data = urllib.urlencode(formdate)
request = urllib2.Request(url, data=data, headers=headers)
context = ssl._create_unverified_context()  # 忽略SSL安全認證
reponse = urllib2.urlopen(request, context=context)
print reponse.read()

Chrome瀏覽器按F12

相關文章
相關標籤/搜索