| ... | ... | @@ -75,7 +75,8 @@ db_password: |
|
|
|
* 每次发布任务前，判断爬取结果为1000的最大zhixing_id与表内最大zhixing_id,若两个id只差小于七万，就补充差额的zhixing_id到loss表内
|
|
|
|
|
|
|
|
* 终本案件
|
|
|
|
* 根据表中zhongben_id的最大值每天生成十万任务
|
|
|
|
* 根据每天终本网页上的最大zhongben_id,按照向上增加2万，向下增加6万的范围补充执行表内没有的id
|
|
|
|
* 每天发布四次任务，每次发布的zhongben_id为距今3天内且爬取失败次数小于80次且爬取结果为1101或null的zhongben_id
|
|
|
|
|
|
|
|
* 限制高消费
|
|
|
|
* 循环失信被执行人表，按名字查询
|
| ... | ... | @@ -675,8 +676,8 @@ index => "public-company-spider-data-%{log_date}" |
|
|
|
```
|
|
|
|
## 代码地址
|
|
|
|
```angular2html
|
|
|
|
http://192.168.109.110/granite/project-collie-app/-/tree/master/app_risk/udms/risk_zhixing_to_redis
|
|
|
|
http://192.168.109.110/granite/project-collie-app/-/tree/master/app_risk/udms/risk_zxgk_loss
|
|
|
|
http://192.168.109.110/granite/project-collie-app/-/blob/master/app_risk/data_pump/zxgk_update_id_to_redis.yml
|
|
|
|
http://192.168.109.110/granite/project-collie-app/-/blob/master/app_risk/data_pump/zxgk_update_id.yml
|
|
|
|
```
|
|
|
|
## 部署地址
|
|
|
|
|
| ... | ... | @@ -700,4 +701,4 @@ http://192.168.109.110/granite/project-collie-app/-/tree/master/app_risk/udms/ri |
|
|
|
## 数据存储表地址
|
|
|
|
|
|
|
|
* 数据库地址：bdp-rds-001.mysql.rds.aliyuncs.com
|
|
|
|
* 表名：risk_zhixing_loss |
|
|
\ No newline at end of file |
|
|
|
* 表名：risk_zhixing_loss,risk_zhongben_loss |
|
|
\ No newline at end of file |
