Create Ray Serve integration #3231
Labels
New Integration
Integrating with a new framework or library
Triaged
Has been looked at recently during old issue triage
Problem Statement
From Ray Serve's docs:
We should create a Ray Serve integration (ideally both tracing and errors). This integration was requested during a customer call with @leokster and @smeubank (internal call notes), and it would help enhance our LLM Monitoring offering.
Solution Brainstorm
Ray integrates with OTel, so we might want to wait until #2251 is implemented so we can use OTel for this integration. However, the Ray's OTel integration is no longer actively maintained, so we might need to fork it and maintain it ourselves.
Related: #2400 (Ray Remote integration)
The text was updated successfully, but these errors were encountered: