v0.0.30
🧠 Smarter LLMQA
with modifier
Arg
As described in blendsql-by-example.ipynb, LLMQA
can now generate constrained lists. This means the following query is valid:
SELECT * FROM People
WHERE People.Name IN {{LLMQA('First 3 presidents of the U.S?')}}
Or, even pseudo-agent-based processing like this:
WITH letter_agent_output AS (
SELECT * FROM (VALUES {{LLMQA('List some greek letters', modifier='{3}')}})
) SELECT {{
LLMQA(
'What is the first letter of the alphabet?',
options=(SELECT * FROM letter_agent_output)
)}}
Additionally, the AzurePhi
model allows for easy constrained decoding with a larger model, powered by guidance's server-side Azure AI integration: https://github.com/guidance-ai/guidance?tab=readme-ov-file#azure-ai
What's Changed
Full Changelog: v0.0.29...v0.0.30