[META] Add Production-Ready Features to gRPC Transport Plugin

[finnegancarroll]

Please describe the end goal of this project

Overview

Tracking additional features needed for production readiness of experimental grpc-transport plugin.
Key areas of focus include security, extensibility, and performance optimizations.

Features

1. Integration with OpenSearch Security Plugin

• TLS for client/server connections
• Certificate management and validation
• Support for AuthN/AuthZ

4. Plugin Extensibility

• Clean interface for plugins to register protobuf definitions and gRPC services

5. Performance Optimization

• Pass-through optimizations (*Dependent on schema)
  With a specific focus on document source can we improve performance by passing document source as protobuf directly to the transport layer instead of stopping to deserialize into POJO?
• Streaming APIs (*Dependent on schema)
• Backpressure mechanisms

Supporting References

Experimental grpc-transport pr - #16534

Closely related ecosystem meta issue
Search RFC

gRPC planned support for:

• Search API
• Document API
• Index API
  

Corresponding benchmarks:

• Search API
• Index API

Issues

• [Feature Request] Security plugin integration for grpc-transport plugin  #16905

Related component

Plugins