|
|
1 year ago | |
|---|---|---|
| crawl_house | 1 year ago | |
| crawl_secondhand | 1 year ago | |
| docs | 1 year ago | |
| test | 1 year ago | |
| .env.example | 1 year ago | |
| LICENSE | 2 years ago | |
| README.md | 1 year ago | |
| crawl_house.py | 1 year ago | |
| main.py | 1 year ago | |
| requirements.txt | 1 year ago | |
| scrapy.cfg | 1 year ago | |
| setup.py | 2 years ago |
二手商品监控,二手车,二手房,租房,电子产品。
1、指定商品定时爬取,有新商品时发送邮件通知。 2、比价,有新用户发布同样的商品时发送邮件通知。
链家房源爬虫,通过小区信息爬取所有房源,基于scrapy
setting.py中配置MongoDB
run run.py
Web版本
python main.py server --config config.json
GUI版本
python main.py gui --config config.json
命令行版本
python main.py run --config config.json
pip 包:
python setup.py sdist bdist_wheel
Licensed under the Apache 2.0 © liuyuqi.gov@msn.cn