fish 0abc08bd54 0 | 4 months ago | |
---|---|---|
crawl_house | 4 months ago | |
crawl_secondhand | 4 months ago | |
docs | 4 months ago | |
test | 4 months ago | |
.env.example | 4 months ago | |
LICENSE | 1 year ago | |
README.md | 4 months ago | |
crawl_house.py | 4 months ago | |
main.py | 10 months ago | |
requirements.txt | 4 months ago | |
scrapy.cfg | 4 months ago | |
setup.py | 1 year ago |
二手商品监控,二手车,二手房,租房,电子产品。
1、指定商品定时爬取,有新商品时发送邮件通知。 2、比价,有新用户发布同样的商品时发送邮件通知。
链家房源爬虫,通过小区信息爬取所有房源,基于scrapy
setting.py中配置MongoDB
run run.py
Web版本
python main.py server --config config.json
GUI版本
python main.py gui --config config.json
命令行版本
python main.py run --config config.json
pip 包:
python setup.py sdist bdist_wheel
Licensed under the Apache 2.0 © liuyuqi.gov@msn.cn