Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aws-for-fluent-bit auto_create_group option is always disabled for cloudwatchlogs plugin in fluentbit helm chart #1096

Open
pabloperfer opened this issue Apr 23, 2024 · 0 comments · May be fixed by #1168
Labels
bug Something isn't working

Comments

@pabloperfer
Copy link

Describe the bug

auto_create_group option is disabled, the pod reports this error below repeteadly, if I use cloudwatch intead of cloudwatchlogs plugin within the fluentbit helm values the log group is created, but that plugin has worst performance and has not templating options.

2024/04/23 13:37:50] [ warn] [engine] failed to flush chunk '1-1713879469.228413452.flb', retry in 10 seconds: task_id=7, input=tail.0 > output=cloudwatch_logs.1 (out_id=1)
[2024/04/23 13:37:50] [error] [output:cloudwatch_logs:cloudwatch_logs.1] Log Group /aws/eks/mycluster/aws-fluentbit-logs not found and auto_create_group disabled.
[2024/04/23 13:37:50] [error] [output:cloudwatch_logs:cloudwatch_logs.1] Failed to send events
[2024/04/23 13:37:50] [ warn] [engine] failed to flush chunk '1-1713879469.551363209.flb', retry in 10 seconds: task_id=8, input=tail.0 > output=cloudwatch_logs.1 (out_id=1)
[2024/04/23 13:37:50] [ warn] [engine] chunk '1-1713879459.223247680.flb' cannot be retried: task_id=3, input=tail.0 > output=cloudwatch_logs.1

Steps to reproduce
Just enable cloudwatchlogs, i tested different image versions so i dont think the issue is in the image.

image:
repository: public.ecr.aws/aws-observability/aws-for-fluent-bit
tag: "2.28.5"
pullPolicy: IfNotPresent

cloudWatchLogs:
autoCreateGroup: true
enabled: true
match: "*"
region: "us-east-1"
logGroupTemplate: "/aws/eks/mycluster/$kubernetes['host'].$kubernetes['namespace_name']"
logStreamTemplate: "$kubernetes['pod_name'].$kubernetes['container_name']"
logRetentionDays: 14

Expected outcome

log group should be created , only old plugin cloudwatch does but not cloudwatchlogs

APPLICATION VERSION
2.31.12.20231011

  • Chart name: aws-for-fluent-bit
  • Chart version: 0.1.32
  • Using EKS (yes/no), if so version? yes 1.29
@pabloperfer pabloperfer added the bug Something isn't working label Apr 23, 2024
@pabloperfer pabloperfer changed the title aws-for-fluent-bit auto_create_group option is always disabled aws-for-fluent-bit auto_create_group option is always disabled for cloudwatchlogs plugin in fluentbit helm chart Apr 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
1 participant