Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reginald production workflow #127

Open
5 of 6 tasks
rchan26 opened this issue Nov 1, 2023 · 0 comments
Open
5 of 6 tasks

Reginald production workflow #127

rchan26 opened this issue Nov 1, 2023 · 0 comments
Assignees
Labels
priority Issue needs to be prioritised

Comments

@rchan26
Copy link
Collaborator

rchan26 commented Nov 1, 2023

Aim is to have two models running:

  • llama-index-llama-cpp running on a VM accessible via API call and host slackbot on Azure running with all_data index
  • llama-index-azure-gpt running on Azure with public index

Tasks:

  • Set up pulumi to host slack bot (Update pulumi script(s) #113)
    • Set API_URL environment variable
  • Set up VM to turn on and off at set times
    • Write a startup script that VM runs on startup to start listening for calls
  • Write in some logic in slack bot for how to respond if the VM is off (using try/excepts)
  • Update current hackweek Slack bot to use updated "public" indices?
  • Build indices on Azure container that save to a file share which the VM can access
@rchan26 rchan26 added the priority Issue needs to be prioritised label Nov 1, 2023
This was referenced Jan 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority Issue needs to be prioritised
Projects
None yet
Development

No branches or pull requests

2 participants