分佈式任務隊列與任務調度系統Celery進階——分佈式爬蟲

新建文件crawlertask.py，用於執行數據抓取任務，代碼以下。python #coding:utf-8 from celery import Celery,platforms import requests from bs4 import BeautifulSoup app=Celery('tasks',broker='redis://localhost:6379/0') app.conf

>>阅读原文<<