All notable changes to this project will be documented in this file. Dates are displayed in UTC.
Generated by auto-changelog
.
7 April 2020
- Fix for #191 - refactoring LOGS_ENABLED logic
#217
- added fix for whitelisting k8s pods
98921ca
- refactored logic for checking the logs_enabled env vars
a9c65f9
- edit dockerhub run script
eb606a3
3 April 2020
3 April 2020
- Fix for #213 - output filter for device detection and parsing of userAgent
#214
- Added patterns for Solr 7/8 and audit logs
#216
- Added patterns for Solr 7/8 and audit logs
#215
- changed device detector to output filter
0cd8c22
- Explicitly defining field types for Solr patterns
756295e
- added input filter for device detection and parsing of userAgent headers for web logs
6a44fb3
31 March 2020
- updated run script to have override for logagent config file, to set endpoints and indices in the config file instead of using env vars
5d921f5
- Release 3.0.28
38b87d7
30 March 2020
- Release 3.0.27
09f8cbb
- updated default value for MAX_CLIENT_SOCKETS to 5
02cd275
- updated logsene-js to 1.1.68
58d2ae4
25 March 2020
- Release 3.0.26
dbde4f0
- fix github util healthcheck
0d1a349
- change debug to use consoleLogger
4151ba3
16 March 2020
- SC-7229: Refactor GitHub Webhook
#211
- added logs filter function; todo finish parser functions
e5675b6
- added formatting for release, create, and delete events
3ef16cd
- added formatting for branch push event
affef87
12 March 2020
- SC-7229: refactored input, moved parsing code to filter, added region config value
9d43ad1
- SC-7229: added basic structure for GitHub webhook events to use st logs filter and output
ac027a2
- es-output added debug option; cleaned up journald example config
f743dbb
5 March 2020
- SC-7164: Added token blacklisting for Github Webhook input
#209
- added token blacklisting to github webhook input and st events output
a7cb2c2
- refactored tokenblacklist to have less if nesting
d6b4507
- Release 3.0.23
8d4859a
4 March 2020
- Code cleanup
#208
- Issue #206
#207
- added dockerfile and run script for test config
ead88f4
- Release 3.0.22
07dc08e
- hotfix: added missing env check for LOGS_TOKEN
3e3cbc0
28 February 2020
- Make HTTP status for blacklisted tokens configurable
#205
- make HTTP status for blacklisted tokens configurable
fd0f480
- Release 3.0.21
3a703f1
27 February 2020
- update pattern file in docker image
28826ee
- add example for k8s annotations / log routing
e8ee0af
- Release 3.0.20
b7f7525
27 February 2020
- Refactoring journald stream parser for multi-line fields
#203
- Add token blacklists to HTTP receivers
#202
- fix whitelisting pods via k8s annotations
#201
- Update date-fns to 2.9.0
#200
- Edited release-it
#199
- refactoring journald stream parser for multi-line fields
64f4358
- adjust date parser to [email protected]
60e596b
- fix whitelisting pods via k8s annotations and LOGSENE_ENABLE_DEFAULT=false #191
789ae3a
21 February 2020
- Journald streaming mode
#197
- Update journald-upload-receiver.yaml
#196
- Add nodejs monitoring plugin
#198
- add streaming mode for jounrald plugin
ef4835c
- fix syslog facility value undefined, keep numeric values
e56ca35
- detect numeric fields in jounrald logs
ce3457b
19 February 2020
19 February 2020
- remove_console_log
#194
- add error handling for invalid tokens
#193
- add unix socket reader plugin, fix #176
#189
- Merge pull request #189 from sematext/add_unix_socket_plugin
#176
- move journald formatting to journald-format output plugin
d2aeccb
- use Sematext common schema, lowercase field names
88c9921
- update journald config examples
a6463c2
17 February 2020
- Fix GEOIP_FIELDS config settings
#192
- SC-7051: final touches for GitHub plugin
#188
- add role bindings in Kubernetes example
#186
- SC-7051: Added GitHub Webhook input plugin
#185
- add unix socket reader plugin, fix #176
#176
- SC-7051: added create and delete events
6a3f201
- add cli arg ---unixSocket, fix connection issue
976539e
- fix_geop_fields
a3d57e4
17 February 2020
- Emit logagent stats
#184
- Add nodejs monitoring plugin to docker image
#183
- Azure eventhub plugin
#182
- Add new pipeline event
#181
- SC-7051: converted to es class syntax
a0ffe82
- SC-7051: working event ingestion for pull_requests
78000b1
- SC-7051: functional refactor
3c833cd
6 February 2020
5 February 2020
31 January 2020
- Make log routing for containers flexible
#179
- refactoring helper functions
5e08e06
- refactoring helper functions
0f878d2
- Release 3.0.11
d729ee9
31 January 2020
31 January 2020
30 January 2020
- Release 3.0.8
46c1414
30 January 2020
- add swarm.service.name and swarm.stack.name fields
#178
- make log routing more flexible
c697139
- fix wrong log messages
3d7d0c1
- make plugin configs aware of the config section name
2487f75
15 January 2020
- Parse image to registry,name,tag,digest
#177
- fix optional digiest in image name
9ed56bb
- optimize regex
818cd50
- remove debug output
9c90b2d
26 December 2019
- add azure-event-hub input plugin
3844b84
- add eventPosition=now, partitions, closing all subscriptions
55d4f30
- fix :port prefix from registry in imageName
f1d0d1d
26 November 2019
- fix #166, add elasticsearch.type config option
#166
- update comments in example config
4b7f016
- Release 3.0.3
7c13979
- update comments in example config
9242e11
18 September 2019
18 September 2019
16 September 2019
- Add geoip plugin
#171
- Use Kubernetes annotations
#170
- Generate patterns file
#169
- cleanup code after review, use LRU cache for pod info
9c2493f
- move to [email protected], use sync reader to open maxmind DB
f07a8ab
- remove geo-ip lookup from log parser
c3b495a
30 July 2019
30 July 2019
30 July 2019
- Release 2.0.182
cebaf67
30 July 2019
- add all plugins to example.yml
1d8afdd
- Don't write to /etc/sematext/receivers.cfg
07397d3
- Don't write to /etc/sematext/receivers.cfg
2bcdc01
3 July 2019
- Release 2.0.180
7c075c1
3 July 2019
26 June 2019
- Make LA_CONFIG env variable configurable
1a6f41e
- Release 2.0.178
3fe188c
- Setting LA_CONFIG env variable disables the creation of logagent.conf
32660fd
25 June 2019
21 June 2019
21 June 2019
21 June 2019
21 June 2019
- fix: UncaughtException:TypeError: cb is not a function
1fe8942
- Release 2.0.173
142bda2
- Disable GeoIP lookups by default
8e8d4b2
31 May 2019
30 May 2019
- Release 2.0.171
86d6fa4
- add logagent binary assets
421815a
- ignore dist directory in git and npm
fb9b40d
30 May 2019
30 May 2019
- Release 2.0.169
e422627
30 May 2019
- Release 2.0.168
1b4beed
30 May 2019
30 May 2019
- add release-it changelog generation
020ce87
- update http pattern solving #168
a962d2e
- Release 2.0.166
26cf56e
24 May 2019
24 May 2019
- Release 2.0.164
7bb41ed
23 May 2019
- improve docker socket error handling
2eadeb4
- add build commands npm run build-all for nexe compiled binaries
ff14fbf
- Release 2.0.163
fccd0eb
16 May 2019
- adjust naming of container metadata to STA field names
015f36e
- adjust field names to sematext/agent field names
8dc30d5
- adjust field names to sematext/agent field names in patterns.yml
85d61f4
14 May 2019
- Convert all values to strings when creating error messages
#152
- Dockerfile for aarch64
#153
- Fix level->severity mapping
#156
- add man page for RH certification
1aec480
- add LICENENSE file for RH certification
e2d43e4
- add kuberntes audit http input-plugin
7913ff2
3 May 2019
23 April 2019
- Release 2.0.159
ecb2e0a
- update dependencies for new tail-forever release
0b5484c
- update dependencies for new tail-forever release
4005836
23 April 2019
- update zookeeper patterns in docker image
ecc5d2a
- update zookeeper patterns
80a6b60
- Release 2.0.158
e634931
15 April 2019
- add dockerEvents input
0b9e5d3
- add input-kubernetes-events
a8ab59d
- improve err handling, remove local test function
563271e
11 April 2019
- add --journald port CLI argument
9548628
- add JOUNRALD_UPLOAD_PORT option
f2d0209
- Release 2.0.156
61da405
11 April 2019
11 April 2019
- add input-plugin to receive data from systemd-journal-upload.service
dd22fdd
- Release 2.0.154
b89304d
9 April 2019
- Add ibm-cloud k8s daemonset example
ad4bdef
- add option to tag App containers with LOGS_TOKEN or LOGSENE_TOKEN (backwardw compatible)
cd841c8
- Release 2.0.153
75205a8
4 April 2019
- Release 2.0.152
3ab7fe6
4 April 2019
4 April 2019
2 April 2019
2 April 2019
2 April 2019
2 April 2019
- Release 2.0.146
3dd3109
1 April 2019
1 April 2019
1 April 2019
- Release 2.0.143
2bf5f4d
1 April 2019
- add k8s/containerd support, file based metadata from /var/log/containers
85a140e
- set originalLine: false in patterns.yml
8339763
- Release 2.0.142
48d5661
12 March 2019
- Release 2.0.141
edb50e2
12 March 2019
- Release 2.0.140
1885274
12 March 2019
- update patterns for docker image
73a2e65
- Fix level->severity mapping
cc68c46
- Release 2.0.139
8461464
8 March 2019
- add module name for syslog plugin
02c68c4
- top level 'env' section on config to set nodejs process environment variables
7b70980
- add PID to error and debug log output
b9be280
8 March 2019
- use proxy settings for pattern downloads
33a6734
- fix error handling for pattern downloads
9f12d34
- Add Dockerfile for aarch64
21e6c7a
8 February 2019
- add RedHat support
428500a
- add multi-line pattern for yandex/clickhouse
e784727
- adjust pattern file location
41fef26
18 January 2019
16 January 2019
16 January 2019
14 January 2019
- Fix confusing 'file does not exists' message in setup script
fa41b8b
- add solr patterns + don't change order of patterns
7fdbd09
- Release 2.0.132
7027d86
17 December 2018
- add more ClickHouse connect options
ec4f54a
- clickhouse connection options, fix unhandled Promise error
d13e59b
- Release 2.0.131
a1cabc9
13 December 2018
- add ARM support, Dockerfile.arm
d521613
- update node versions to test on travis-ci
59ae99a
- Make LOG_GLOB not mandatory
61a26c1
29 November 2018
28 November 2018
- Fix Layout in Docker Hub: Convert HTML table to markdown table
4c6cb24
- Reduce the DH readme to a minimum. Referring to /docs
bd31fd8
- remove rtail, because rtail is not maintained anymore and causes problems with npm audit
c758010
22 November 2018
16 November 2018
- self.terminate() on uncaught exceptions
#146
- add MQTT Broker authentication
bd118ea
- terminate on uncaught exceptions and rejections
bcf7e5f
- Release 2.0.125
0a4bc52
5 November 2018
- add ClickHouse output plugin
9b98c66
- support date pattern in AWS Elasticsearch index name
1a731d6
- Release 2.0.124
0a90e09
30 October 2018
- Add output prometheus-alertmanager
#142
- Adding new line character in ldjson format
#141
- Update README.md
3f118c3
- Delay require error
93af1af
- Fix tests for older node versions
fc68dd5
23 October 2018
- update readme with configuration parameters
efa31a5
- Update Readme
f29ca4f
- change LA_ARGUMETNS to LOGAGENT_ARGUMENTS
e6e5ec1
1 October 2018
- bugfix / http listener for influxdb did not start
84fb9ba
- Release 2.0.121
239bd56
- remove bitHound badge
d31d8d4
26 September 2018
- SC-2853 LA config improvements
#139
- SC-2853 Rename LOG_URL to LOGSENE_RECEIVER_URL
ae3b832
- performance improvements
5ec5a1a
- bugfix, not collecting files via LOG_GLOB pattern
e166dae
14 September 2018
- add kubernetes daemonset example
34b21e5
- fix log routing bug, dockerInspect info was not set in logContext
69ade0b
- Release 2.0.119
57c1f5b
13 September 2018
- trigger docker log collection via CLI instead of generating cfg file
50ba9e3
- make docker socket configurable
7bc81cc
- fix docker socket detection/LA_ARGUMENTS and readme updates
2c949c1
11 September 2018
- changes for Logagent docker image
9004a77
- set Docker Hostname from docker-info
89a6411
- Release 2.0.117
b730162
10 September 2018
- Release 2.0.116
3f68c03
7 September 2018
7 September 2018
- elasticsearch output plugin: function as config value #135
#136
- add docker logs input and enrichment plugin
7d71272
- update patterns.yml
98b1c43
- elasticsearch output plugin: config value as function #135
a57c68a
19 July 2018
- add example removing fields with SQL output filter
7117949
- Release 2.0.113
b6a4ae1
- adjust timeout for JSON parse
7cf7987
6 July 2018
4 July 2018
- Add a new pattern to match Traefik default accesslog in 'patterns.yml'
703246a
- Release 2.0.111
cca71d1
- fix version of date-fns
a103f43
26 April 2018
- Fix typo
#127
- split anonymizer plugin into separate plugins
7e28913
- add example for anonymizer plugin
c865863
- add truncate function for ipv4/v6 fields
61ef2bb
28 March 2018
- Create Cassandra CQL query input plugin #122
#126
- Start Cassandra input
3158e41
- add connection pooling configuration
537f6d5
- start cassandra input plugin
01a8228
7 March 2018
- add example elasticsearch http input to MQTT output
c8e6b94
- fix JSON detection
3ff2228
- improved error handling for empty input or invalid JSON
d96360a
6 March 2018
- fix dockerfile for DH
cde4dc7
- add output-influxdb plugin
0d88ccf
- add bulk requests + other minor changes
33a5bbf
21 February 2018
- fix #125, allow negative file postions, relative from EOF
#125
- fix #125
#125
- Release 2.0.106
a654a2a
- add options.tailStartPosition in config loader
a780cf3
- link patterns.yml in dockerhub dir
9f0f61e
1 February 2018
24 January 2018
- support global AWS credentials
70ae126
- print unhandled promise rejections
139f4d4
- fix loading AWS credentials
ac9707f
23 January 2018
21 January 2018
21 January 2018
- Add Apple device tracker input plugin
b0cfd7f
- add novaSDS011-dust-sensor plugin
49bb60e
- replace Mosca MQTT broker with Aedes MQTT lib, add websocket option
b585419
16 January 2018
15 January 2018
- remove double timestamp for error logs using consoleLogger.error function
f383580
- Make loading of ES plugin backward compatible, and add warning
bd5f80c
- Small changes to Elasticsearch slowlog parsing
7e1cb68
10 January 2018
- Fix a typo...
#118
- Zeromq in/out plugins #116
#117
- add reference to zeromq plugins
8d50597
- Release 2.0.97
0b0b87d
- Opss fix a typo
8330adb
5 January 2018
22 December 2017
- Add GELF out plugin + move alias grok filter in input filter section
#111
- optimize patterns/remove JS transforms for webserver logs, set originalLine to false
93fa49c
- cpu tuning, replacing moment.js with date-fns
0573785
- rename addr field in hosts and add example
c5cecf0
8 December 2017
8 December 2017
8 December 2017
- fix #110
#110
- add gelf output
4fc6e90
- removed duplicated pattern/ better formatting, setting types
0f54d9c
- add /ping /health and JSON parsing for message field
7d1a8a9
1 December 2017
28 November 2017
- move graygelf (having native dependencies) to optionalDependencies section
541754b
- Release 2.0.89
1c2ad46
- Update cloudflare.yml
ef949ad
23 November 2017
- Add alias for grok filter
#107
- Add a new docker image and README updates
#104
- Fix typo
#101
- Add GELF Input Plugin
#99
- Implement Elasticsearch Index API
#92
- kafka plugins are external, removed local JS files
76731f4
- apply 'standard-format -w' and fix eslint issues
acf2782
- implement dynamic response for N documents
88bc066
13 October 2017
- Release 2.0.87
7b40cd9
13 October 2017
- add Infux HTTP API input
ae21ec4
- fix HTTP return status for telegraf, add tags to separate object
c6ee6fa
- rename input-influx-http to input-influxdb-http
66418bf
6 October 2017
- add example to fetch logs from cloudflare
0f2a1da
- add and variables for command templates
5ec4a7a
- Release 2.0.85
1ea89a9
21 September 2017
- Release 2.0.84
02a7829
21 September 2017
- add aws-elasticsearch.js skeleton
54bed7e
- fix iitial bugs, add ES client tracing optiosn to config, log errors to stderr
e730c45
- add aws-elasticsearch example, support aws-config.json file
e4e940e
21 September 2017
20 September 2017
20 September 2017
20 September 2017
20 September 2017
- fix format of example config
ce31618
- add env var ENABLE_JSON_ENRICHMENT (default = true)
1349f22
- Update output-files.yml
25e2751
19 September 2017
12 September 2017
12 September 2017
- remove documentation -> sematext.com/docs/logagent
562add0
- Update example.yml
9418c20
- Cosmetics
1c52c06
22 August 2017
- add Elasticsearch slow log pattern
f67b799
- Release 2.0.74
62c98db
- fix start pos for tailing files
adddb25
9 August 2017
- Access Watch output filter
#83
- added possibility to choose different timezones and formats for query…
#82
- Use Kafka-node instead of kafka-native for in out and ssl support
#81
- added mssql-query plugin
#80
- Kafka input support with native
#77
- fix #72
#72
- added mssql-query input plugin
54e49aa
- remove wrong package file
11c0313
- first working version, augment data form client_ip and user_agent
510e5a9
6 July 2017
- add US/EU comment for setup call
8dfbb8d
- Release 2.0.72
7581316
- update dependency to logsene-js
f1858a2
5 July 2017
- postgres-query #36
#78
- Add mulitple sql statements
#76
- Add date placeholder
#74
- add producer for try plugin
457311b
- rename postgres-> postgresql, improved connection/error handling
520e1f5
- improve connection handling open/close
b1f7459
27 June 2017
27 June 2017
- add mysql-query plugin
#73
- fix #72
#72
- complete firt kafka input roundtrip
68a1895
- add example for Prometheus to Elasticsearch
3b40620
- add shhudown kafka endpoint
b60dd84
23 June 2017
- add options to setup-script for ES url (-u), glob pattern (-g) and index name (-i)
54a7c57
- Release 2.0.68
2a9230a
8 June 2017
8 June 2017
6 June 2017
- fix tailF, removing separator from constructor call
e8665b9
- Release 2.0.64
e7c80d4
- Update elasticsearch-query-input.yml
8bf57a2
9 May 2017
- fix datetime not matching on nginx
#68
- make default multi-line separator configurable
15873d7
- Release 2.0.63
3cec3aa
- use platform specific EOL
bddbc2f
28 April 2017
28 April 2017
- Re Issue #64 Logagent-setup fails to create init.d script
#66
- fix #64
#64
- update docs
2485bc2
- add slack-webhook output
f7a3d09
- add elasticsearch query input
7775b43
12 April 2017
20 March 2017
13 March 2017
7 March 2017
- typo fix for word "example"
#61
- Release 2.0.56
2e485b6
- Release 2.0.57
5c00383
- reduce memory usage using --max-old-space-size=150 as default (500MB before)
5dbe012
16 February 2017
- Release 2.0.56
c3323ea
- fix 'depcrated os.tempdir()' message
10b7449
- add precommit for standard/eslint
e01abb3
10 February 2017
- [WIP] add eslintrc config, fix various issues identified by eslint
#60
- Add support for time-based index patterns, prefer severity over level
#59
- add eslintrc config, fix various issues identified by eslint
9d65cc0
- fix standard-format warnings
bf99dee
- support time-based elasticsearch indexes, prefer severity to level
0642c6e
9 February 2017
9 February 2017
- assorted odds & ends
#58
- Bunyan log parsing
#57
- add test for bunyan log handling
bd47ff0
- fallback for filter name, initPugins -> initPlugins, outputFilterSections -> inputFilterSections, != -> !==
865f397
- properly detect bunyan log messages, remove bunyan time when after setting @timestamp
2d98571
9 February 2017
9 February 2017
- fix undefined sourceName when using command input
#55
- Release 2.0.51
bf1e21d
- add node 7 remove node 5
f3fd375
- remove node 0.10 from travis
32a6842
7 February 2017
7 February 2017
7 February 2017
7 February 2017
6 February 2017
- Revert "reset tail-forever every N minutes"
d1c5285
- reset tail-forever every N minutes
ba8193a
- fix --geoipEnabled flag
04f4491
22 January 2017
17 January 2017
- add example to store BRO ids logs in Elasticsearch
a54c1e1
- update for Elasticsearch 5 timestamp format
56c575d
- fix typo in bro-ids.yaml
fef2651
2 January 2017
12 December 2016
8 December 2016
- update example for journald
7bac233
- add command stout/sterr as input plugin 'command'
35716c4
- example for journald input
1d9c452
7 December 2016
- add timerEvents to share one timer for all multi-line parsers
f38c287
- user timerEvent in multi-line parser
03dd407
- Release 2.0.40
2a64224
6 December 2016
6 December 2016
6 December 2016
- standard format, removed debug output
d029e9f
- add windows service installer
dacbd09
- Release 2.0.37
c3ae63f
5 December 2016
2 December 2016
2 December 2016
2 December 2016
2 December 2016
15 November 2016
15 November 2016
11 November 2016
4 November 2016
- output to multiple Elasticsearch servers, terminate after stdin.close and all logs shipped
3276989
- Release 2.0.28
b29ddc3
2 November 2016
- integrate tcp-input, grep filter, update sql filter, add docs
da7a36e
- fix pattern list by source
bc4738e
- update docs
75dfcf7
2 November 2016
24 October 2016
- Release 2.0.25
1380ab1
- add module alias table, e.g. to load sql output filter with a short alias 'sql' instead of ../lib/plugins/output-filter/sql.js
4fecd56
23 October 2016
17 October 2016
17 October 2016
17 October 2016
7 October 2016
- support filter/aggregate functions, using fibers
4d9e0c5
- switch to enable JSON processing, JSON detection/parsing after pattern processing
a6ef4aa
- fix error when no settings for stdin plugin exist in config file
68ff4c1
4 October 2016
26 September 2016
23 September 2016
- make sure patterns are matched from beginning -> better performance
f253edf
- revert a00d2bf33b0f6c34a57bf44e519ef6f2f1514c1b, load always default patterns
1c02f6c
- don't load default patterns, when user configured pattern files
a00d2bf
23 September 2016
19 September 2016
13 September 2016
- add json post processing options (autohash, transform) in parser
1d5af28
- example for json post processing
b188f62
- json post process example in comments
9655907
13 September 2016
13 September 2016
13 September 2016
13 September 2016
- add putput plugin example
5476575
- move install section to the top, reference to service installer and location of default config file
bf97b4c
- link to existing plugins
6c4d369
13 September 2016
13 September 2016
- link from whats new to docs
9f7463b
- add multiple pattern files, hot reload
346d2ad
- Release 2.0.7
1899c61
13 September 2016
12 September 2016
- update docs
a348714
- fix cli without config file
6ad1a5f
- load 3rd party modules first, e.g. for nodejs monitor too hook into http functions before heroku/cf server gets loaded
1117b43
8 September 2016
- update cli options
3c58aa4
- Release 2.0.4
74b7668
- remove warning on parser errors, too verbose e.g. for empty lines
46026df
8 September 2016
- load only required plugins/modules depending on config
b2db631
- don't terminate on stdin/ EOF when other input plugins are loaded
53d63e1
- include pid in logs
e02ab45
8 September 2016
- refactoring, new dir structure, fix #35
#35
- changes for #28, move to eventemitter2, started with plugin structure
b52a22f
- refactoring, split in modules, prep. for cli tests
36ce8da
- code format, copyright statement
a93ebde
31 May 2016
- Fixed originalLine typo
#8
- fixed a typo in patterns.yml
#6
- structured logs dir
b9451c2
- initial version
3e5fe01
- add source for mkdocs
b1fe290
2 July 2016
- Allow specifying the file pattern as $2
#10
- omproved logging, add --help, moced to commander CLI option parser
02ebe51
- improved log output, scanning files for glob patterns
a249780
- Store tail position and recover on restart. Incl. indode check to start at begin of file, when inode changed
79cf001
1 June 2016
31 May 2016