|
@@ -1,5 +1,13 @@
|
|
## Development
|
|
## Development
|
|
|
|
|
|
|
|
+[x]提供 web ui 和命令行两种模式。
|
|
|
|
+
|
|
|
|
+目前支持如下网站:
|
|
|
|
+
|
|
|
|
+ [x] xiaohua.com
|
|
|
|
+ [x] meizitu.com
|
|
|
|
+ [x] qinimg.com
|
|
|
|
+
|
|
|
|
|
|
**flask web ui操作;**
|
|
**flask web ui操作;**
|
|
|
|
|
|
@@ -11,15 +19,22 @@ python mian.py server --config xx
|
|
**命令行模式:**
|
|
**命令行模式:**
|
|
|
|
|
|
```
|
|
```
|
|
-# 校花网
|
|
|
|
-python main.py shell --extractor xiaohua --cmd crawl
|
|
|
|
-
|
|
|
|
-#
|
|
|
|
-python main.py shell --extractor xiaohua --cmd crawl
|
|
|
|
|
|
+cd /d C:/Users/dell/Desktop/xiaohua-crawl
|
|
|
|
+virtualenv .venv
|
|
|
|
+source .venv/bin/activate
|
|
|
|
+pip install -r requirements.txt
|
|
|
|
|
|
|
|
+#python setup.py --requires | xargs pip install
|
|
|
|
|
|
|
|
+# 校花网
|
|
|
|
+python main.py run --extractor xiaohua --cmd crawl
|
|
|
|
+# python main.py shell --extractor xiaohua --cmd crawl
|
|
|
|
|
|
|
|
+# 妹子网项目:
|
|
|
|
+python main.py run --extractor meizitu
|
|
|
|
|
|
|
|
+# coser `scrapy crawl coser -o items.csv -t csv`
|
|
|
|
+# WorldCosplay `python worldcosplay.py 53056`
|
|
```
|
|
```
|
|
|
|
|
|
**打包exe:**
|
|
**打包exe:**
|