Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Survey automation #444

Open
wants to merge 13 commits into
base: main
Choose a base branch
from
Open

Conversation

dimits-ts
Copy link
Collaborator

@dimits-ts dimits-ts commented Feb 7, 2025

Fixes #413

Added basic support for LLM participants to answer surveys.

Features:

  • Prompt structure for each question type
  • Basic unit tests that ensure all relevant information stays included in the prompt (useful to avoid bugs during refactoring)
  • Connected implementation with @vivtsai 's experimental agent testing function

The implementation currently does not validate the LLM output nor does it coerce it to a type readable by the backend. Let me know if this is within the scope of this PR, and I'll add it.

  • Tests pass
  • Appropriate changes to documentation are included in the PR

Tested with llama3.2-1B. If it runs correctly with such a small model, I reckon it's safe to assume much larger LLMs won't have any issues.

@vivtsai
Copy link
Collaborator

vivtsai commented Feb 11, 2025

The implementation currently does not validate the LLM output nor does it coerce it to a type readable by the backend. Let me know if this is within the scope of this PR, and I'll add it.

This is within scope, so feel free to add here or in a follow-up PR! :) @dimits-ts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Create base prompt allowing agent participants to answer surveys
2 participants