Skip to content

Commit

Permalink
Add links to Outlines' supporter
Browse files Browse the repository at this point in the history
  • Loading branch information
rlouf committed Feb 20, 2024
1 parent e99d92d commit 2dbc279
Show file tree
Hide file tree
Showing 7 changed files with 56 additions and 3 deletions.
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,8 @@
</div>

Made with ❤👷️ by the team at [.txt](https://dottxt.co).
We'd love to have your [feedback][discord]!

Looking for an API that returns valid JSON? [Give .json a try](https://h1xbpbfsf0w.typeform.com/to/ZgBCvJHF)

``` bash
pip install outlines
Expand Down
Binary file added docs/assets/images/dottxt.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
1 change: 1 addition & 0 deletions docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,7 @@ hide:
<h2 class="subtitle">Robust prompting & (structured) text generation</h2>
[:fontawesome-solid-bolt: Get started](welcome.md){ .md-button .md-button--primary }
[:fontawesome-brands-discord: Join the Community](https://discord.gg/ZxBxyWmW5n){ .md-button }
[:fontawesome-solid-wifi: API](https://form.typeform.com/to/ZgBCvJHF){ .md-button }

<div class="index-pre-code">
```bash
Expand Down
4 changes: 4 additions & 0 deletions docs/reference/vllm.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,9 @@
# Serve with vLLM

!!! tip "Would rather not self-host?"

If you want to get started quickly with JSON-structured generaton you can call instead [.json](https://h1xbpbfsf0w.typeform.com/to/ZgBCvJHF), a [.txt](http://dottxt.co) API that guarantees valid JSON.

Outlines can be deployed as an LLM service using the vLLM inference engine and a FastAPI server. vLLM is not installed by default so will need to install Outlines with:

```bash
Expand Down
11 changes: 11 additions & 0 deletions docs/welcome.md
Original file line number Diff line number Diff line change
Expand Up @@ -81,12 +81,23 @@ via the next-token logits.

## Acknowledgements

<div class="grid" markdown>

<figure markdown>

<figure markdown>
<a href="http://www.dottxt.co">
![Normal Computing logo](assets/images/dottxt.png){ width="150" }
</a>
</figure>

<a href="https://www.normalcomputing.ai">
![Normal Computing logo](assets/images/normal_computing.jpg){ width="150" }
</a>
</figure>

</div>

Outlines was originally developed at [@NormalComputing](https://twitter.com/NormalComputing) by [@remilouf](https://twitter.com/remilouf) and [@BrandonTWillard](https://twitter.com/BrandonTWillard). It is now maintained by [.txt](https://dottxt.co).

[discord]: https://discord.gg/R9DSu34mGd
Expand Down
14 changes: 13 additions & 1 deletion outlines/serve/serve.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,17 @@
# _______________________________
# / Don't want to self-host? \
# \ Try .json at http://dottxt.co /
# -------------------------------
# \ ^__^
# \ (oo)\_______
# (__)\ )\/\
# ||----w |
# || ||
#
#
# Copyright 2024- the Outlines developers
# Copyright 2023 the vLLM developers

#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
Expand Down
26 changes: 25 additions & 1 deletion outlines/serve/vllm.py
Original file line number Diff line number Diff line change
@@ -1,4 +1,28 @@
"""Make vLLM compatible with Outlines' structured generation."""
# Make vLLM compatible with Outlines' structured generation.
#
# _______________________________
# / Don't want to self-host? \
# \ Try .json at http://dottxt.co /
# -------------------------------
# \ ^__^
# \ (oo)\_______
# (__)\ )\/\
# ||----w |
# || ||
#
# Copyright 2024- the Outlines developers
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at

# http://www.apache.org/licenses/LICENSE-2.0

# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
import json
import math
from collections import defaultdict
Expand Down

0 comments on commit 2dbc279

Please sign in to comment.