Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not forwarding S3 logs to Datadog? #40

Open
1 task done
Darwiner opened this issue May 30, 2024 · 1 comment
Open
1 task done

Not forwarding S3 logs to Datadog? #40

Darwiner opened this issue May 30, 2024 · 1 comment

Comments

@Darwiner
Copy link

Description

This might be halfway between a "bug" (because of the description) and a feature request at the same time...

The s3_log_bucket_arns variable in https://github.com/terraform-aws-modules/terraform-aws-datadog-forwarders/tree/master/modules/log_forwarder has a description that mentions:

S3 log buckets for forwarder to read and forward logs to Datadog

...yet, looking through the code (and also trying it out), is it possible that it does not take care of adding the actual forwarding of logs to Datadog?

I was expecting to see a aws_s3_bucket_notification resource, which I believe would have taken care of this part, but there does not seem to be one? Or might I be missing something?

  • ✋ I have searched the open/closed issues and my issue is not listed.

Versions

  • Module version [Required]: 6.0.1

  • Terraform version: 1.8.3

  • Provider version(s):
+ provider registry.terraform.io/datadog/datadog v3.39.0
+ provider registry.terraform.io/hashicorp/aws v5.49.0
+ provider registry.terraform.io/hashicorp/null v3.2.2
+ provider registry.terraform.io/hashicorp/random v3.6.1

Expected behavior

Lambda function being aware of new logs in S3 bucket and forwarding those to Datadog. Lambda logs/metrics showing activity. New logs appearing in Datadog.

Actual behavior

S3 logs are not getting forwarded by the lambda function. Lambda function logs are empty. Nothing appearing in Datadog logs.

@tennengabr
Copy link

@Darwiner I was also confused by this as was brought into the implementation half way through process. After reading the docs on which the module is based on (datadog-serverless-functions/aws/log_monitoring).

It appears you can either create the triggers manually using the variables exported from this module or Datadog will create them for your automatically when you setup your Datadog integrations.

Here is more information on setting up the triggers using automatic/manual approaches. Send AWS Services Logs With The Datadog Lambda Function - Set up triggers

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants