Ingest Logs from outside the Installation

[Rotfuks]

Motivation

We want our Observability Platform to be the central component for all data needs at least for the operations process at this point. For a lot of customers this operations process does not end at the boundaries of the installation. Often enough they rely and are dependent on resources from outside the installation like databases and so on. In order to connect the dots for a holistic view on data we need to enable customers to also get this relevant data ingested into the observability platform.

Stories

Beta Give feedback

1. Log-Receiver: Investigation #3567
   blocked needs/refinement team/atlas +3
   
2. Log-Receiver: Implementation #3568
   team/atlas +1
   
3. Log-Receiver: Log Forwarding #3569
   team/atlas +1
4. Sunset Fluentbit #3599
   team/atlas +1
5. https://github.com/giantswarm/giantswarm/issues/29312

Outcome

• Customers can see data from sources outside their installation
• Customers can define in self-service which sources of data they are interested in.