Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Droid] DBRX Truss Implementation #283

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

factory-droid[bot]
Copy link

@factory-droid factory-droid bot commented May 1, 2024

Rotor

Summary of Changes

This PR implements the DBRX truss for the Baseten platform. It includes the model.py file with the Model class that loads the DBRX model and runs inference. The requirements.txt file lists the necessary dependencies, and the config.yaml file configures the truss for Python 3.11 and specifies the use of A10G GPUs. The README.md file documents the truss's functionality and usage. This implementation follows the instructions from the DBRX model's original repository and is designed for efficient inference on the Baseten platform.

Fixes BT-10619

Tips

  • If you review this pull request, I will attempt to address your feedback by pushing an update. You may also leave a comment and tag @droid.

Copy link

linear bot commented May 1, 2024

BT-10619 Create DBRX truss

This comment has been minimized.

This comment has been minimized.

Copy link
Author

factory-droid bot commented May 1, 2024

Important

Solutions for GitHub Action Failures - 17f9d35 - 3

Droid deploy truss

The error you're encountering is due to an invalid or incorrect API key. Please follow these steps to resolve the issue:

  1. Navigate to your GitHub repository settings.
  2. Select 'Secrets' from the left sidebar.
  3. Find the 'BASETEN_API_KEY' secret and click on 'Update'.
  4. Enter the correct API key and click on 'Save changes'.

After updating the API key, re-run the GitHub Actions workflow. If the API key is correct, the workflow should run successfully.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants