... | @@ -213,22 +213,31 @@ scrapy |
... | @@ -213,22 +213,31 @@ scrapy |
|
|
|
|
|
## 归集后存放目录
|
|
## 归集后存放目录
|
|
```
|
|
```
|
|
|
|
10.8.6.227
|
|
|
|
/data2/grvael_spider_result/cfc_spider
|
|
```
|
|
```
|
|
|
|
|
|
## logstash配置文件名称
|
|
## logstash配置文件名称
|
|
```
|
|
```
|
|
|
|
# kafka
|
|
|
|
project-deploy/logstash/10.8.6.246/conf.d/collie_spider_data_to_kfk.conf
|
|
|
|
# es
|
|
|
|
project-deploy/logstash/10.8.6.229/conf.d/gravel/gravel_spider_to_es.conf
|
|
```
|
|
```
|
|
|
|
|
|
## logstash文件采集type
|
|
## logstash文件采集type
|
|
```
|
|
```
|
|
|
|
cfc_spider
|
|
```
|
|
```
|
|
|
|
|
|
## 数据归集的topic
|
|
## 数据归集的topic
|
|
```
|
|
```
|
|
|
|
general-taxpayer
|
|
```
|
|
```
|
|
|
|
|
|
## ES日志索引及筛选条件
|
|
## ES日志索引及筛选条件
|
|
```
|
|
```
|
|
|
|
public-company-spider-data-*
|
|
```
|
|
```
|
|
|
|
|
|
## 监控指标看板
|
|
## 监控指标看板
|
... | | ... | |