房产,二手房爬虫,房产分析

fish 0abc08bd54 0 4 months ago
crawl_house 0abc08bd54 0 4 months ago
crawl_secondhand 0abc08bd54 0 4 months ago
docs 0abc08bd54 0 4 months ago
test 0abc08bd54 0 4 months ago
.env.example 0abc08bd54 0 4 months ago
LICENSE 4d21de8a83 modify readme 1 year ago
README.md 0abc08bd54 0 4 months ago
crawl_house.py 0abc08bd54 0 4 months ago
main.py 92571b2236 add docs 10 months ago
requirements.txt 0abc08bd54 0 4 months ago
scrapy.cfg 0abc08bd54 0 4 months ago
setup.py 247dbb3eb2 init extractor 1 year ago

README.md

crawl_secondhand

Version .Python

二手商品监控,二手车,二手房,租房,电子产品。

1、指定商品定时爬取,有新商品时发送邮件通知。 2、比价,有新用户发布同样的商品时发送邮件通知。

链家房源爬虫,通过小区信息爬取所有房源,基于scrapy

Usage

setting.py中配置MongoDB
run run.py

Web版本

python main.py server --config config.json

GUI版本

python main.py gui --config config.json

命令行版本

python main.py run --config config.json

Develop

pip 包:

python setup.py sdist bdist_wheel

License

Licensed under the Apache 2.0 © liuyuqi.gov@msn.cn