Skip to content

Add support for open-source monitoring: Loki, Prometheus, Grafana for Forge #121

@edersonbrilhante

Description

@edersonbrilhante

Description:

Currently, Forge sends logs to Splunk Cloud and metrics to Splunk Observability (O11y). To increase compatibility with open-source monitoring tools, we want to add optional support for:

  1. Logs → Loki

    • All Forge logs currently sent to Splunk Cloud should optionally be sent to Loki
    • Support multi-tenant isolation similar to current Splunk logging
  2. Metrics → Prometheus

    • All Forge metrics currently sent to O11y should optionally be exported in a Prometheus-compatible format
    • Include EC2, Kubernetes pod, and billing metrics
  3. Dashboards → Grafana

    • Build dashboards in Grafana using the Prometheus metrics and Loki logs
    • Dashboards should replicate key views currently available in Splunk (EC2, pods, billing, per-tenant/service aggregation)

This will allow Forge to be fully compatible with open-source monitoring stacks, enabling teams that do not use Splunk to monitor, alert, and visualize their Forge infrastructure.

References:

  • Existing Splunk O11y / Cloud modules:

    • /modules/integrations/splunk_o11y_aws_integration
    • /modules/integrations/splunk_aws_billing
    • /modules/integrations/splunk_cloud_conf_shared

Acceptance Criteria:

  1. Forge logs can optionally be sent to Loki.
  2. Forge metrics can optionally be exported to Prometheus.
  3. Grafana dashboards are created for EC2, Kubernetes pods, and billing metrics, replicating existing Splunk views.
  4. Multi-tenant isolation is preserved in the open-source stack.
  5. Documentation provided for setup, configuration, and usage.
  6. Deployment and configuration are automated via Terraform or CI/CD pipelines.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions