python爬蟲百度翻譯

• python3,爬取的是百度翻譯手機版的網頁

• 運用requests,json模塊

• 英漢互譯，運行結果

#!/bin/python3 # -*- coding: UTF-8 -*-

#============================================= #describe:an en to zh and zh to en translater #version:1 #update:2018-08-03 #--- #author:unihon #E-mail:unihon@outlook.com #github:https://github.com/unihon #=============================================

import requests import json def trans(): userAgent = "Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/604.1.38 (KHTML, like Gecko) Version/11.0 Mobile/15A372 Safari/604.1" header = { "Host": "fanyi.baidu.com", "Origin": "http://fanyi.baidu.com", "User-Agent": userAgent } postUrl="http://fanyi.baidu.com/basetrans" wd = input("please input a word: ") print('-------------------------------') if wd == '': trans() return
    
    for c in wd: if c < u'\u4e00' or c > u'\u9fa5': print('[en to zh]\n') mdata = { "from":"en", "to":"zh", "query" : wd } break
        elif c == wd[-1]: print('[zh to en]\n') mdata = { "from":"zh", "to":"en", "query" : wd } try: response = requests.post(postUrl, data = mdata, headers = header) except: print('connect error!') return 1 result = response.text result=json.loads(result) if len(result["dict"]) == 0: print('is null') else: try: for i in result["dict"]["word_means"]: print('> '+ i) except KeyError: print('key is null') if __name__ == "__main__": print("===============================") trans() print("===============================")

• 小結

須要注意的是，爬到的json數據，中文通常是unicode編碼的形式，能夠用json模塊處理。