Python爬蟲練習：爬取陰陽師高清大圖

前言

本文的文字及圖片來源於網絡,僅供學習、交流使用,不具備任何商業用途,若有問題請及時聯繫咱們以做處理。

基本環境配置

• python 3.6
• pycharm
• requests

相關模塊pip安裝便可

目標網頁

 

通過一些系列的網頁分析，能夠發現它的圖片地址

https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_beforeAwake/201.png https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_afterAwake/201.png https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_skin/201-1.png

 

多看幾張式神的圖片後能夠發現，每一個圖片所改變的是式神的 ID 值

能夠經過開發者工具抓包，找到數據接口

 

 

請求數據

• 得到json數據

import requests url = 'https://yys.res.netease.com/pc/zt/20161108171335/js/app/all_shishen.json' headers = { 'user-agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36' } response = requests.get(url=url, headers=headers) html_data = response.json()

解析數據

• 獲取 id 值 以及 式神名字
• 構建圖片地址

for i in html_data: num_id = i['id'] name = i['name'] beforeAwake = 'https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_beforeAwake/{}.png'.format(num_id) afterAwake = 'https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_afterAwake/{}.png'.format(num_id) skin = 'https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_skin/{}-1.png'.format(num_id) beforeAwake_response = requests.get(url=beforeAwake, headers=headers) beforeAwake_name = name + '初始' + '.png' afterAwake_response = requests.get(url=beforeAwake, headers=headers) afterAwake_name = name + '覺醒' + '.png' skin_response = requests.get(url=beforeAwake, headers=headers) skin_name = name + '皮膚' + '.png'

保存數據

path = 'D:\\python\\demo\\陰陽師\\img\\' def download(name, response): with open(path + name, mode='wb') as f: f.write(response.content)

完整代碼

import requests
import pprint
url = 'https://yys.res.netease.com/pc/zt/20161108171335/js/app/all_shishen.json' path = 'D:\\python\\demo\\陰陽師\\img\\' headers = { 'user-agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36' } def download(name, response): with open(path + name, mode='wb') as f: f.write(response.content) response = requests.get(url=url, headers=headers) html_data = response.json() for i in html_data: num_id = i['id'] name = i['name'] beforeAwake = 'https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_beforeAwake/{}.png'.format(num_id) afterAwake = 'https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_big_afterAwake/{}.png'.format(num_id) skin = 'https://yys.res.netease.com/pc/zt/20161108171335/data/shishen_skin/{}-1.png'.format(num_id) beforeAwake_response = requests.get(url=beforeAwake, headers=headers) beforeAwake_name = name + '初始' + '.png' download(beforeAwake_name, beforeAwake_response) afterAwake_response = requests.get(url=beforeAwake, headers=headers) afterAwake_name = name + '覺醒' + '.png' download(afterAwake_name, afterAwake_response) skin_response = requests.get(url=beforeAwake, headers=headers) skin_name = name + '皮膚' + '.png' download(skin_name, skin_response) print('正在下載{}圖鑑'.format(name))

實現效果