Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ArchonConvert Operator (generators -> critic -> fuser) #161

Open
wants to merge 6 commits into
base: dev
Choose a base branch
from

Conversation

yash94404
Copy link
Collaborator

  • Created new ArchonConvert operator that runs a convert prompt through a layer of multiple generators, which have all their outputs critiqued in the critic layer, and fused together into an optimal response in the fuser layer
  • Implemented ArchonConvert class, new prompt strategies for Archon operations, new prompts for Archon
  • Integrated into optimizer with ArchonConvertRule, allowing the optimizer to use any subset of models for the generator layer (can modify LLM architecture if needed)

Next Steps:

  • Modifying LLM Architecture to support multiple critics/fusers, adding verifier/ranker?
  • Correspondingly to above, improving optimizer using DAG approach talked about with Siva
  • Any other ideas!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant