Skip to content

added gemma2 9b and 27b vllm with streaming #122

added gemma2 9b and 27b vllm with streaming

added gemma2 9b and 27b vllm with streaming #122

Workflow file for this run

name: Droid deploy truss
on:
pull_request:
types: [opened, synchronize, reopened, ready_for_review]
branches:
- main
paths:
- '**/model.py'
jobs:
truss_test:
if: ${{ github.triggering_actor == 'factory-droid' || github.triggering_actor == 'factory-droid[bot]'}}
runs-on: ubuntu-latest
steps:
- name: Checkout code
uses: actions/checkout@v4
with:
fetch-depth: 0
- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: 3.11
- name: Install dependencies (if any)
run: |
python -m pip install --upgrade pip
pip install git+https://github.com/basetenlabs/truss.git requests tenacity --upgrade
- name: Run tests
env:
BASETEN_API_KEY: ${{ secrets.BASETEN_API_KEY }}
run: python bin/test_truss_deploy.py