Skip to content

v0.0.30

Compare
Choose a tag to compare
@parkervg parkervg released this 26 Oct 21:17
· 2 commits to main since this release

🧠 Smarter LLMQA with modifier Arg

As described in blendsql-by-example.ipynb, LLMQA can now generate constrained lists. This means the following query is valid:

SELECT * FROM People
WHERE People.Name IN {{LLMQA('First 3 presidents of the U.S?')}}

Or, even pseudo-agent-based processing like this:

WITH letter_agent_output AS (
    SELECT * FROM (VALUES {{LLMQA('List some greek letters', modifier='{3}')}})
) SELECT {{
LLMQA(
    'What is the first letter of the alphabet?', 
    options=(SELECT * FROM letter_agent_output)
)}}

Additionally, the AzurePhi model allows for easy constrained decoding with a larger model, powered by guidance's server-side Azure AI integration: https://github.com/guidance-ai/guidance?tab=readme-ov-file#azure-ai

What's Changed

  • _dialect.py Re-Work, modifier Argument for LLMQA, Documentation updates by @parkervg in #35

Full Changelog: v0.0.29...v0.0.30