Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Portkey AI custom endpoint in librechat.example.yaml #4625

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

siddharthsambharia-portkey

Summary

Portkey AI Custom Endpoint Integration

Added configuration for the Portkey AI custom endpoint in librechat.example.yaml. This enables LibreChat users to connect directly to the Portkey API and utilize its specialized models with settings for headers, model display, and title conversations.

Key additions:

  • Endpoint configuration for Portkey API
  • Headers for authentication with Portkey API
  • Model list and label customizations

Change Type

  • New feature (non-breaking change which adds functionality)

Testing

Tested the Portkey endpoint configuration by setting up the API connection with provided keys and verifying model fetching, header configurations, and response outputs. Validated model retrieval and display settings align with expected Portkey model responses.

Test Configuration:

  1. Set PORTKEY_API_KEY and PORTKEY_OPENAI_VIRTUAL_KEY in environment variables.
  2. Enabled caching and verified the model display label.
  3. Tested response latency and accuracy for models specified in the configuration.

Checklist

  • My code adheres to this project's style guidelines
  • I have performed a self-review of my own code
  • I have commented in any complex areas of my code
  • I have made pertinent documentation changes
  • My changes do not introduce new warnings
  • I have written tests demonstrating that my changes are effective
  • Local unit tests pass with my changes

@siddharthsambharia-portkey
Copy link
Author

Hey @danny-avila can you take a look at this? Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant