1 Star 0 Fork 2

JenkinH/haipproxy

forked from Ekber/haipproxy 
加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
克隆/下载
crawler_booter.py 701 Bytes
一键复制 编辑 原始数据 按行查看 历史
"""
This module is used to start multi spiders or validators from IDE or cmd.
All the startup args can be found in config/rules.py, including:
CRAWLER_TASK_MAPS, VALIDATOR_TASK_MAPS
You can start proxy spiders using the following cmd:
python crawler_booter.py --usage crawler
If you want to start only common spider and ajax proxy spider, run:
python crawler_booter.py --usage crawler common ajax
If you want to start all the validators, run:
python crawler_booter.py --usage validator
If you just want to start init and https validator, run:
python crawler_booter.py --usage validator init https
"""
from haipproxy.scheduler import crawler_start
if __name__ == '__main__':
crawler_start()
马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化
1
https://gitee.com/jenkinh/haipproxy.git
git@gitee.com:jenkinh/haipproxy.git
jenkinh
haipproxy
haipproxy
master

搜索帮助