2.3.4 (2024-12-19)
2.3.3 (2024-12-02)
- cmd: CLI Config Relative Imports (#279) (3b18bfe)
- message: use correct encodings for JSON Number values (#281) (d476fa5)
- playground: trim quotes from environment variables (#282) (83bd0e8)
2.3.2 (2024-11-26)
2.3.1 (2024-11-07)
2.3.0 (2024-11-04)
- added support for new substation playground command (#262) (82f39e8)
- cmd: Add tap and read Commands to CLI Tool (#269) (6149968)
- cmd: log test errors (#272) (917e29f)
- deps: Upgrade to Latest Minor Versions (#266) (9db10a8)
- message: Add Flag Support (#264) (1acc9a0)
2.2.0 (2024-10-10)
- add support for formatting jsonnet with substation cli (#250) (6cae3cd)
- cmd: Add build Command to CLI Tool (#252) (5ffe528)
- cmd: Add vet Command to CLI Tool (#253) (97fbc92)
2.1.0 (2024-10-03)
- cmd: Out of Bounds int32 Check in AWS Lambda Autoscale (#238) (bcc8108)
- cmd: Pre-Compile Demo Config (#247) (81d50b8)
- condition: Remove v1 Imports (#246) (fc22eeb)
2.0.0 (2024-09-23)
- Release v2.0.0 (#228)
1.7.1 (2024-08-05)
1.7.0 (2024-07-30)
- condition: Add MetaErr Inspector (#217) (b9c685e)
- condition: Update conditions to support source and target key comparisons (#214) (dfbc678)
- transform: Add FormatFromZip Transform (#221) (d9304ca)
- transform: Add KV Store Set Add Transform (#215) (b293b79)
- transform: Add MetaRetry Transform (#222) (eff9a98)
- transform: Add Multi-Transform Support to Meta Transforms (#213) (af44e66)
- build/config: add ID to conditional pattern (#207) (227a5d9)
- condition: Update Wrapped Error in MetaNegate Inspector (#216) (9ac1bd1)
- internal/bufio: Default Max Token Size (#220) (e3dfa47)
- transform: Remove Print in SendFile Transform (5e93e52)
- transform: Update Validation for EnrichHTTP Transforms (2fde138)
1.6.0 (2024-07-17)
- transform: Change Kinesis Payload Limit to MB (#206) (16baaa0)
- transform: Remove Temporary Files from AWS S3 (#205) (b52078d)
1.5.0 (2024-07-09)
- transform: Add Number Maximum Transform (#195) (8b391de)
- transform: Add Number Minimum Transform (#196) (ea5a592)
- transform: Add Storage Class Support to AWS S3 (#189) (63b96be)
1.4.0 (2024-06-27)
- condition: Add Number Equal To Inspector (#187) (aa1d54e)
- condition: Add Number Greater Than Inspector (#183) (ff966ba)
- condition: Add Number Less Than Inspector (#186) (b949014)
1.3.0 (2024-06-17)
- transform: Add Customizable Errors to MetaErr (#174) (3759ccc)
- transform: Add ID Settings Field (#181) (ab1a4ff)
- transform: Add Meta KV Store Lock Transform (#177) (34d2ffb)
- transform: Add Metric Freshness Transform (#178) (04ed699)
- transform: Add UtilityControl Transform for Generating Ctrl Messages (#175) (93b64cd)
1.2.2 (2024-05-06)
- kinesis: Limit Aggregated Records to 1MB (#169) (9065f1c)
- transform: Empty Aggregated Kinesis Records (#171) (7c519fe)
- transform: Empty AWS Kinesis Aggregated Records (841caa9)
1.2.1 (2024-05-03)
- kinesis: remove Kinesis aggregation size and count limits (#168) (156750b)
- transform: AWS DynamoDB Send Payload (#166) (83f71b0)
1.2.0 (2024-04-03)
1.1.2 (2024-03-23)
1.1.1 (2024-03-21)
- aws: Reduce Aggregated Kinesis Record Size (#147) (a0ef232)
- transform: Improve AggregateToArray Throughput (#150) (d730cc6)
1.1.0 (2024-03-14)
- autoscale: Dynamic Kinesis Scaling with Thresholds (#144) (079fda9)
- transform: Add Metrics Bytes Transform (#142) (d708580)
1.0.0 (2024-03-05)
cmd/development/substation
refactored intocmd/client/file/substation
condition.Inspector
is no longer in the public APIcondition
inspectors refactored into individual functions- JSON Schema inspector removed
- Inspectors no longer directly support negation
config.Capsule
refactored intomessage
packageconfig.Channel
is no longer in the public APIprocess
package refactored intotransform
package- Count processor removed
- Flatten processor removed
- IP Database processor removed
- Processors (Transfoms) no longer directly support conditions
internal/transform
package removedinternal/sink
package removedproto
removed- Secrets are now explicitly retrieved and put into the Secrets Store using the
utility_secret
transform - The
enrich_kv_store_set
transform had it's object.key and object.set_key behavior flipped (key is now the value put into the KV, set_key is now the key used in the KV) - The
send_http
transform is nowsend_http_post
- All
TTLOffset
settings are now strings instead of integers (e.g., "15m") - Removed application metrics, added
meta_metric_duration
andutility_metric_count
in transform package - Refactored
Transforms
method in substation package - Moved
cmd/file/client
application toexamples/cmd/file/client
- Renamed multiple fields based on recommendations from GitHub Copilot
- Sumo Logic support removed (replaced)
- Group processor removed (replaced)
- Added
substation
package - Added
message
package - Updated applications to use new concurrency and data processing model
- Added Kinesis Data Firehose support to
cmd/aws/lambda/substation
- Added
meta_negate
inspector tocondition
package - Added
meta_err
transform totransform
package - Added
meta_switch
transform totransform
package - Added
string_append
transform totransform
package - Added
string_uuid
transform totransform
package - Added
utility_delay
transform totransform
package - Added
utility_err
transform totransform
package - Added support for non-aggregated data to AWS Kinesis Data Stream transform
- Added region and assume role support to all AWS transforms
- Added buffering to several
send
transforms - Removed IAM modules in
build/terraform/aws/
- Added
build/scripts/config/format.sh
- Added
build/scripts/terraform/format.sh
- Added shorthand to
build/config/substation.libsonnet
- Added
build/config/substation_test.jsonnet
- Downgraded
go.mod
and development containers to Go 1.19 - Upgraded application containers to Go 1.21
- Refactored all
examples/
- Added
utility_secret
transform - All transform object handling patterns (object.key) return the input message if the retrieved key value does not exist
- Secrets Store AWS Secrets Manager backend supports AWS and retry configuration
- KV Store AWS DynamoDB backend supports AWS and retry configuration
- Added example for summarizing multiple events into a single event
- Added example for using MaxMind with the KV transform
- Added JSON array support to
meta_for_each
in condition package - Upgraded
go.mod
to Go 1.20 - Added multi-region support to Terraform modules
- Added CloudWatch Terraform modules to collect log data
- Added (refactor) Secrets Terraform module
- Added
array_zip
transform - IAM roles and policies in Terraform use randomized names
- Concurrency bug in internal/aggregate package
0.9.2 (2023-08-10)
- add bitmath inspector (#128) (4721ffa)
- Add JSON Lines Support to KV Store (#126) (667ceb3)
- add TTLKey to KV (#121) (9837287)
- Allow Multiple URL Interpolations in the HTTP Processor (#124) (f262f79)
- KV Store Processor TTL Key (#123) (0ceffc1)
- use valid path to the for_each inspector settings (#129) (65d838d)
0.9.1 (2023-05-09)
- Add Benchmark App & No-Op Features (#108) (ddfb7bc)
- Add Stream Transform & Streamer Interface (#106) (8efd82e)
- Add Zstandard & Snappy Readers (#105) (8c69907)
- AWS DynamoDB Ingest (CDC) (#109) (36c60ac)
- AWS SNS Sink (#111) (47e948f)
0.9.0 (2023-04-19)
- Add AWS AppConfig Lambda Validation app (#92)
- Add AWS AppConfig Lambda Validation app (#92) (f374137)
- add gt, lt (#98) (110253b)
- condition inspector (#86) (e1fcee6)
- Customizable Sink Files (#93) (bee2463)
- JQ Processor (#88) (0adf249)
0.8.4 (2023-03-08)
- Add Playground Demo (#82) (f519eaf)
- CLI: adds force-sink flag (#84) (cb7e697)
- HTTP Processing & Secrets Retrieval (#77) (f4e7329)
- object named groups (#78) (d5f687c)
- setkey support (#81) (5419f5e)
0.8.3 (2023-01-23)
0.8.2 (2023-01-11)
0.8.1 (2023-01-10)
0.8.0 (2023-01-04)
- Breaking Public APIs (#53)
0.7.1 (2022-12-19)
0.7.0 (2022-12-13)
- DNS and IP Database Processing (#39) (0e43886)
- process.Replace allow replacing with nothing (#42) (7aeeb44)
- ms-fontobject false positive (#46) (56016f2)
- process.IPDatabase Errors, condition.IP Type (#44) (a2cf347)
0.6.1 (2022-12-05)
0.6.0 (2022-11-30)
- Standardizing Use of io (#38)
0.5.0 (2022-10-04)
- Update App Concurrency Model (#30)
- Add Forward Compatibility for SNS (#21)
- Add Forward Compatibility for SNS (#21) (b93dc1e)
- Add Initial Support for Application Metrics (#25) (30f103d)
- AppConfig Script Updates (#28) (5261485)
- Customizable Kinesis Data Stream Autoscaling (#27) (2dd7ea7)
- Improvements to JSON Parsing (#29) (98cac69)
- Improvements to Reading and Decoding Files (#24) (e310cb5)
0.4.0 (2022-08-31)
- Encapsulation (#15)
- Add Random Condition (#18) (302f24a)
- Data Aggregation (#10) (6cab3f7)
- Encapsulation (#15) (e46e780)
- PrettyPrint Processor (#12) (fa7a8f7)
- Handling Large S3 Files (#20) (2791b91)
- Process Jsonnet Errors (#11) (9507c83)
- replace golint with staticcheck (#16) (3898992)
0.3.0 (2022-07-18)
- Migrate to Meta Processors (#7)
0.2.0 (2022-06-17)
- Pre-release Refactor (#5)