How can I use structlog for GCP Dataflow?

[bgalvao]

Cloud Dataflow is a service to run Apache Beam pipelines.

The most that they explain as far as logging is concerned is to import logging - which results in a stderr root logger - and Apache Beam apparently intercepts the logs and repackages them to Cloud Logging.

This however, adds no ability to use structured logging. So I am wondering what can be done here (assuming my assessment is correct).

I will give a go to this library and report back

[multani]

Hi @bgalvao,

I don't have any experience with Cloud Dataflow, so I can't help here, sorry :(

I'd be interested to hear your feedback if you try it out though!