Open
Description
Bug Report
无法发送采集的数据到InfluxDB
logkit 相关配置:
默认配置,未修改logkit.conf
运行环境:
1.Windows Server 2016
2.CentOS 7
【两个系统都测试了,均无法发送采集的数据到InfluxDB】
logkit 版本:
v1.5.3
操作系统版本:
1.Windows Server 2016
2.CentOS 7
复现过程操作步骤:
下载Logkit1.5.3,解压,运行
浏览器打开http://127.0.0.1:3000
增加系统信息采集收集器,全部保持默认,在配置发送方式时,选择发送至InfluxDB服务,填写了数据库地址,数据库名称,以及measurement名称,其他默认(没有勾选高级选项),创建保存时报错:MissingKey:The configd must contains influxdb_fields,dataType must be [string string,string]
参考了https://github.com/qiniu/logkit/wiki/InfluxDB-Sender 之后,在配置发送方式时,选择发送至InfluxDB服务,填写了数据库地址,数据库名称,以及measurement名称,并勾选了高级选项,手动填写了influxdb_tags,influxdb_fields等参数,可以保存成功,但在InfluxDB中,只有时间戳,没有系统信息
相关日志等其他信息:
2019/04/11 17:57:44 [INFO][github.com/qiniu/logkit] logkit.go:260: Welcome to use Logkit, Version: v1.5.3
Config: main.Config{MaxProcs:1, DebugLevel:0, ProfileHost:":3002", ConfsPath:[]string{"confs*"}, LogPath:"", CleanSelfLog:true, CleanSelfDir:"", CleanSelfPattern:"", TimeLayouts:[]string(nil), CleanSelfLogCnt:0, StaticRootPath:"./public", ManagerConfig:mgr.ManagerConfig{BindHost:":3000", Idc:"", Zone:"", RestDir:"", Cluster:mgr.ClusterConfig{MasterUrl:[]string(nil), IsMaster:false, Enable:false, Address:"", Tag:""}, DisableWeb:false, ServerBackup:false}}
2019/04/11 17:57:44 [WARN][github.com/qiniu/logkit/mgr] mgr.go:497: start to add watcher of conf path C:\Users\Administrator\Desktop\_package\confs
2019/04/11 17:57:44 [INFO][github.com/qiniu/logkit/mgr] mgr.go:550: successfully restored 0 runners in C:\Users\Administrator\Desktop\_package/.logkitconfs web rest dir
2019/04/11 17:57:44 [INFO][github.com/qiniu/logkit/mgr] rest.go:172: successfully start RestService and bind address on :3000
2019/04/11 17:57:44 [INFO][github.com/qiniu/logkit] logkit.go:290: go profile_host was open at :3002
2019/04/11 17:57:54 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:04 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:14 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:24 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:34 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:44 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:58:54 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:59:04 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:59:14 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 17:59:24 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:03:50 [DEBUG][github.com/qiniu/logkit/reader] meta.go:176: Runner[runner.20190411175921] Using meta/runner.20190411175921_722245873 as default metaPath
2019/04/11 18:03:50 [INFO][github.com/qiniu/logkit/sender/influxdb] influxdb.go:167: influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table create database by "CREATE DATABASE testdb"
2019/04/11 18:03:50 [INFO][github.com/qiniu/logkit/sender/influxdb] influxdb.go:173: influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table create retention by "CREATE RETENTION POLICY oneDay ON testdb DURATION 7d REPLICATION 1 DEFAULT"
2019/04/11 18:03:50 [WARN][github.com/qiniu/logkit/mgr] metric_runner.go:475: Runner[runner.20190411175921] restore status failed: open C:\Users\Administrator\Desktop\_package\meta\runner.20190411175921_722245873\statistic.meta: The system cannot find the file specified.
2019/04/11 18:03:50 [INFO][github.com/qiniu/logkit/mgr] mgr.go:326: Runner[runner.20190411175921] added: "C:\\Users\\Administrator\\Desktop\\_package\\.logkitconfs\\runner.20190411175921.conf"
2019/04/11 18:03:50 [INFO][github.com/qiniu/logkit/mgr] mgr.go:331: new Runner[runner.20190411175921] is added, total 1
2019/04/11 18:03:54 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:03:55 [DEBUG][github.com/qiniu/logkit/mgr] metric_runner.go:251: collecter <memcached> collect data error: dial tcp [::1]:11211: connectex: No connection could be made because the target machine actively refused it.
2019/04/11 18:04:04 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:04:14 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:04:24 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag service not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag bucket not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field logtype not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field service not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field method not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field path not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag bucket not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag service not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field logtype not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field service not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field method not exist
2019/04/11 18:04:33 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field path not exist
......
......
2019/04/11 18:04:34 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:04:39 [DEBUG][github.com/qiniu/logkit/mgr] metric_runner.go:251: collecter <memcached> collect data error: dial tcp [::1]:11211: connectex: No connection could be made because the target machine actively refused it.
2019/04/11 18:04:44 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:04:54 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:04 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:14 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag bucket not exist
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:224: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table tag service not exist
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field logtype not exist
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field service not exist
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field method not exist
2019/04/11 18:05:17 [DEBUG][github.com/qiniu/logkit/sender/influxdb] influxdb.go:234: Runner[runner.20190411175921] influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table field path not exist
......
......
2019/04/11 18:05:23 [DEBUG][github.com/qiniu/logkit/mgr] metric_runner.go:251: collecter <memcached> collect data error: dial tcp [::1]:11211: connectex: No connection could be made because the target machine actively refused it.
2019/04/11 18:05:24 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:34 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:36 [INFO][github.com/qiniu/logkit/utils/os] signal.go:24: Receiving signal: interrupt
2019/04/11 18:05:36 [ERROR][github.com/qiniu/logkit/mgr] rest.go:505: accept tcp [::]:3000: use of closed network connection
2019/04/11 18:05:36 [WARN][github.com/qiniu/logkit/mgr] metric_runner.go:369: wait for MetricRunner runner.20190411175921 stopped
2019/04/11 18:05:44 [DEBUG][github.com/qiniu/logkit/mgr] mgr.go:468: we have totally 1 watchers, periodically try to detect more watchers...
2019/04/11 18:05:46 [WARN][github.com/qiniu/logkit/mgr] metric_runner.go:375: MetricRunner runner.20190411175921 exited timeout
2019/04/11 18:05:46 [WARN][github.com/qiniu/logkit/sender] fault_tolerant.go:263: Runner[runner.20190411175921] wait for Sender[influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table] to completely exit
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/sender] fault_tolerant.go:271: Runner[runner.20190411175921] Sender[influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table] has been completely exited
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/queue] disk.go:205: DISKQUEUE(stream_local_save): closing
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/queue] disk.go:807: DISKQUEUE(stream_local_save): closing ... ioLoop
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/queue] disk.go:205: DISKQUEUE(backup_local_save): closing
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/queue] disk.go:807: DISKQUEUE(backup_local_save): closing ... ioLoop
2019/04/11 18:05:47 [WARN][github.com/qiniu/logkit/mgr] metric_runner.go:382: sender influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table of MetricRunner runner.20190411175921 closed
2019/04/11 18:05:47 [INFO][github.com/qiniu/logkit/mgr] metric_runner.go:535: runner runner.20190411175921, backup status &{122 [0 0] map[influxdbSender:(http://10.60.60.100:8086,db:testdb,measurement:test_table:[122 0]] {{{0 0} 0 0 0 0} [] 0 0 0} {{{0 0} 0 0 0 0} [] 0 0 0} map[] map[]}
Metadata
Metadata
Assignees
Labels
No labels