Instrument opentelemetry

[hamersaw]

Tracking issue

NA

Describe your changes

Instrumenting Flyte with opentelemetry to more accurately profile execution performance.

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Screenshots

NA

Note to reviewers

NA

[codecov]

Codecov Report

Attention: 139 lines in your changes are missing coverage. Please review.

Comparison is base (ea72bbd) 66.81% compared to head (66606f2) 59.93%.

Files	Patch %	Lines
flytestdlib/otelutils/k8s.go	0.00%	50 Missing ⚠️
flytestdlib/otelutils/factory.go	50.00%	26 Missing and 6 partials ⚠️
flytestdlib/otelutils/config_flags.go	22.22%	21 Missing ⚠️
flytepropeller/pkg/controller/handler.go	88.80%	10 Missing and 5 partials ⚠️
flytepropeller/events/admin_eventsink.go	0.00%	8 Missing ⚠️
...ontroller/nodes/catalog/datacatalog/datacatalog.go	0.00%	7 Missing ⚠️
flytestdlib/otelutils/config.go	0.00%	6 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #4357      +/-   ##
==========================================
- Coverage   66.81%   59.93%   -6.88%     
==========================================
  Files         122      402     +280     
  Lines        7898    32828   +24930     
==========================================
+ Hits         5277    19677   +14400     
- Misses       2295    11662    +9367     
- Partials      326     1489    +1163     

Flag	Coverage Δ
unittests	59.93% <55.73%> (-6.88%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.