Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updated to use the latest ollama models and pinned versions #7

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

Otterwerks
Copy link

Changes

  • Pinned package versions to latest stable releases
  • Specified Python 3.11.8 as the required version
  • Updated model handling code to be compatible with latest ollama package

Notes

The project needed updates to work with the latest versions of its dependencies, particularly the ollama package which has had significant updates. These changes ensure reproducible environments and compatibility with current package versions.

@asciimo
Copy link

asciimo commented Dec 23, 2024

I tested this PR and it works great. Thank you!

Until this is merged, a lazy workaround is pinning ollama==0.1.8 in requirements.txt, to get benchmark.py running as originally intended.

Copy link

@bigmessydata bigmessydata left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great patch! works great on llama 3.3

@adamj34
Copy link

adamj34 commented Jan 3, 2025

I also tested this PR locally and everything worked properly. Tested on Alibaba's QWQ model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants