Skip to content

Commit

Permalink
Move to org ialacol (#4)
Browse files Browse the repository at this point in the history
Signed-off-by: Hung-Han (Henry) Chen <[email protected]>
  • Loading branch information
chenhunghan authored Aug 26, 2023
1 parent 37f36fc commit f3cd89e
Show file tree
Hide file tree
Showing 4 changed files with 7 additions and 7 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,11 @@

### Run in Container

There is an image host on [ghcr.io](https://github.com/chenhunghan/text-inference-batcher/pkgs/container/text-inference-batcher-nodejs)
There is an image host on [ghcr.io](https://github.com/ialacol/text-inference-batcher/pkgs/container/text-inference-batcher-nodejs)

```sh
export UPSTREAMS="http://localhost:8080,http://localhost:8081" # List of OpenAI-compatible upstreams separated by comma
docker run --rm -it -p 8000:8000 -e UPSTREAMS=$UPSTREAMS ghcr.io/chenhunghan/text-inference-batcher-nodejs:latest # node.js version
docker run --rm -it -p 8000:8000 -e UPSTREAMS=$UPSTREAMS ghcr.io/ialacol/text-inference-batcher-nodejs:latest # node.js version
```

### Kubernetes
Expand Down Expand Up @@ -42,7 +42,7 @@ helm install stable-platypus2 ialacol/ialacol \
Add `text-inference-batcher` pointing to upstreams.

```sh
helm repo add text-inference-batcher <https://chenhunghan.github.io/text-inference-batcher>
helm repo add text-inference-batcher <https://ialacol.github.io/text-inference-batcher>
helm repo update
helm install tib text-inference-batcher/text-inference-batcher-nodejs \
--set deployment.env.UPSTREAMS="http://llama-2:8000,http://orca-mini:8000,http://stable-platypus2:8000"
Expand Down
4 changes: 2 additions & 2 deletions charts/text-inference-batcher-nodejs/Chart.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
apiVersion: v2
appVersion: 0.0.1
appVersion: 0.0.2
description: A Helm chart for text-inference-batcher with node.js runtime
name: text-inference-batcher-nodejs
type: application
version: 0.0.1
version: 0.0.2
2 changes: 1 addition & 1 deletion charts/text-inference-batcher-nodejs/values.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
replicas: 1

deployment:
image: ghcr.io/chenhunghan/text-inference-batcher-nodejs:latest
image: ghcr.io/ialacol/text-inference-batcher-nodejs:latest
env:
# upstream url separated by comman. e.g. "http://llama-2-7b-0:8000,http://llama-2-7b-1:8000,http://llama-2-13b-0:8000"
UPSTREAMS: ""
Expand Down
2 changes: 1 addition & 1 deletion package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

0 comments on commit f3cd89e

Please sign in to comment.