Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

无法发送采集的数据到InfluxDB #967

Open
JinkunTian opened this issue Apr 11, 2019 · 0 comments
Open

无法发送采集的数据到InfluxDB #967

JinkunTian opened this issue Apr 11, 2019 · 0 comments

Comments

@JinkunTian
Copy link

JinkunTian commented Apr 11, 2019

Bug Report

无法发送采集的数据到InfluxDB

logkit 相关配置:

默认配置,未修改logkit.conf

运行环境:

1.Windows Server 2016
2.CentOS 7
【两个系统都测试了,均无法发送采集的数据到InfluxDB】

logkit 版本:

v1.5.3

操作系统版本:

1.Windows Server 2016
2.CentOS 7

复现过程操作步骤:

下载Logkit1.5.3,解压,运行
浏览器打开http://127.0.0.1:3000
增加系统信息采集收集器,全部保持默认,在配置发送方式时,选择发送至InfluxDB服务,填写了数据库地址,数据库名称,以及measurement名称,其他默认(没有勾选高级选项),创建保存时报错:MissingKey:The configd must contains influxdb_fields,dataType must be [string string,string]
参考了https://github.com/qiniu/logkit/wiki/InfluxDB-Sender 之后,在配置发送方式时,选择发送至InfluxDB服务,填写了数据库地址,数据库名称,以及measurement名称,并勾选了高级选项,手动填写了influxdb_tags,influxdb_fields等参数,可以保存成功,但在InfluxDB中,只有时间戳,没有系统信息

相关日志等其他信息:

2019/04/11 17:57:44 [INFO][github.com/qiniu/logkit] logkit.go:260: Welcome to use Logkit, Version: v1.5.3

Config: main.Config{MaxProcs:1, DebugLevel:0, ProfileHost:":3002", ConfsPath:[]string{"confs*"}, LogPath:"", CleanSelfLog:true, CleanSelfDir:"", CleanSelfPattern:"", TimeLayouts:[]string(nil), CleanSelfLogCnt:0, StaticRootPath:"./public", ManagerConfig:mgr.ManagerConfig{BindHost:":3000", Idc:"", Zone:"", RestDir:"", Cluster:mgr.ClusterConfig{MasterUrl:[]string(nil), IsMaster:false, Enable:false, Address:"", Tag:""}, DisableWeb:false, ServerBackup:false}}
2019/04/11 17:57:44 [WARN][github.com/qiniu/logkit/mgr] mgr.go:497: start to add watcher of conf path C:\Users\Administrator\Desktop\_package\confs
2019/04/11 17:57:44 [INFO][github.com/qiniu/logkit/mgr] mgr.go:550: successfully restored 0 runners in C:\Users\Administrator\Desktop\_package/.logkitconfs web rest dir
2019/04/11 17:57:44 [INFO][github.com/qiniu/logkit/mgr] rest.go:172: successfully start RestService and bind address on :3000
2019/04/11 17:57:44 [INFO][github.com/qiniu/logkit] logkit.go:290: go profile_host was open at :3002
2019/04/11 17:57:54 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:04 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:14 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:24 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:34 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:44 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:54 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:59:04 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:59:14 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:59:24 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:03:50 [DEBUG][github.com/qiniu/logkit/reader] meta.go:176: Runner[runner.20190411175921] Using meta/runner.20190411175921_722245873 as default metaPath
2019/04/11 18:03:50 [INFO][github.com/qiniu/logkit/sender/influxdb] influxdb.go:167: influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table create database by "CREATE DATABASE testdb"
2019/04/11 18:03:50 [INFO][github.com/qiniu/logkit/sender/influxdb] influxdb.go:173: influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table create retention by "CREATE RETENTION POLICY oneDay ON testdb DURATION 7d REPLICATION 1 DEFAULT"
2019/04/11 18:03:50 [WARN][github.com/qiniu/logkit/mgr] metric_runner.go:475: Runner[runner.20190411175921] restore status failed: open C:\Users\Administrator\Desktop\_package\meta\runner.20190411175921_722245873\statistic.meta: The system cannot find the file specified.
2019/04/11 18:03:50 [INFO][github.com/qiniu/logkit/mgr] mgr.go:326: Runner[runner.20190411175921] added: "C:\\Users\\Administrator\\Desktop\\_package\\.logkitconfs\\runner.20190411175921.conf"
2019/04/11 18:03:50 [INFO][github.com/qiniu/logkit/mgr] mgr.go:331: new Runner[runner.20190411175921] is added, total 1
2019/04/11 18:03:54 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:03:55 [DEBUG][github.com/qiniu/logkit/mgr] metric_runner.go:251: collecter <memcached> collect data error: dial tcp [::1]:11211: connectex: No connection could be made because the target machine actively refused it.
2019/04/11 18:04:04 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:04:14 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:04:24 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag service not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag bucket not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field logtype not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field service not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field method not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field path not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag bucket not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag service not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field logtype not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field service not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field method not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field path not exist
......
......
2019/04/11 18:04:34 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:04:39 [DEBUG][github.com/qiniu/logkit/mgr] metric_runner.go:251: collecter <memcached> collect data error: dial tcp [::1]:11211: connectex: No connection could be made because the target machine actively refused it.
2019/04/11 18:04:44 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:04:54 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:04 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:14 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag bucket not exist
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag service not exist
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field logtype not exist
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field service not exist
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field method not exist
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field path not exist
......
......
2019/04/11 18:05:23 [DEBUG][github.com/qiniu/logkit/mgr] metric_runner.go:251: collecter <memcached> collect data error: dial tcp [::1]:11211: connectex: No connection could be made because the target machine actively refused it.
2019/04/11 18:05:24 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:34 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:36 [INFO][github.com/qiniu/logkit/utils/os] signal.go:24: Receiving signal: interrupt
2019/04/11 18:05:36 [ERROR][github.com/qiniu/logkit/mgr] rest.go:505: accept tcp [::]:3000: use of closed network connection
2019/04/11 18:05:36 [WARN][github.com/qiniu/logkit/mgr] metric_runner.go:369: wait for MetricRunner runner.20190411175921 stopped
2019/04/11 18:05:44 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:46 [WARN][github.com/qiniu/logkit/mgr] metric_runner.go:375: MetricRunner runner.20190411175921 exited timeout
2019/04/11 18:05:46 [WARN][github.com/qiniu/logkit/sender] fault_tolerant.go:263: Runner[runner.20190411175921] wait for Sender[influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table] to completely exit
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/sender] fault_tolerant.go:271: Runner[runner.20190411175921] Sender[influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table] has been completely exited
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/queue] disk.go:205: DISKQUEUE(stream_local_save): closing
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/queue] disk.go:807: DISKQUEUE(stream_local_save): closing ... ioLoop
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/queue] disk.go:205: DISKQUEUE(backup_local_save): closing
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/queue] disk.go:807: DISKQUEUE(backup_local_save): closing ... ioLoop
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/mgr] metric_runner.go:382: sender influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table of MetricRunner runner.20190411175921 closed
2019/04/11 18:05:47 [INFO][github.com/qiniu/logkit/mgr] metric_runner.go:535: runner runner.20190411175921, backup status &{122 [0 0] map[influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table:[122 0]] {{{0 0} 0 0 0 0} [] 0 0 0} {{{0 0} 0 0 0 0} [] 0 0 0} map[] map[]}

InfluxDB中的数据:
4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant