vllm API- add regex support #474
-
The JSON implementation for vllm API is fantastic! I am opening this discussion to suggest adding regex support since I believe it will be equally useful. IMO one place where local llms really shine is running data ETL/NLP tasks around the clock. This requires guaranteed output structure provided by regex/outlines. For example, something I am working on right now in my RAG pipeline is to add structured/curated metadata derived from text which can be used to drastically reduce the search space. Regex support is crucial for extraction tasks like dates, emails, phone numbers etc. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Implemented by #481 |
Beta Was this translation helpful? Give feedback.
Implemented by #481