Skip to content

Commit

Permalink
add section on deployment framework
Browse files Browse the repository at this point in the history
  • Loading branch information
raymondng76 committed Apr 4, 2024
1 parent ff4e878 commit 7c3e00f
Showing 1 changed file with 11 additions and 1 deletion.
12 changes: 11 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -131,6 +131,16 @@ The configuration used for pre-training and an overview guide is provided [here]
The SEA-LION models can be fine-tuned using the HuggingFace TRL library.
An overview guide and sample configurations are provided [here](examples/fine-tuning/README.md).

## Deployment Framework

### Text-Generation-Inference (TGI)

SEA-LION is natively supported in TGI from [v1.4.0](https://github.com/huggingface/text-generation-inference/releases/tag/v1.4.0).

### vLLM

For SEA-LION vLLM intergration, please refer to this [guide for instructions](https://github.com/aisingapore/sealion/tree/vllm/vllm).

## Contributing

We welcome contributions to SEA-LION! Check out the [contributing guide](CONTRIBUTING.md) to get started.
Expand Down Expand Up @@ -168,7 +178,7 @@ Any opinion, finding, conclusion or recommendation expressed in this material ar

For questions, comments, or issues, please open a GitHub issue or contact us via this [SEA-LION Inquiry Form](https://forms.gle/sLCUVb95wmGf43hi6).

## Citations
## References

```bibtex
@misc{lowphansirikul2021wangchanberta,
Expand Down

0 comments on commit 7c3e00f

Please sign in to comment.