Skip to content

Updated to use the latest ollama models and pinned versions#7

Open
Otterwerks wants to merge 1 commit intoMinhNgyuen:masterfrom
Otterwerks:maintenance/package-updates
Open

Updated to use the latest ollama models and pinned versions#7
Otterwerks wants to merge 1 commit intoMinhNgyuen:masterfrom
Otterwerks:maintenance/package-updates

Conversation

@Otterwerks
Copy link
Copy Markdown

Changes

  • Pinned package versions to latest stable releases
  • Specified Python 3.11.8 as the required version
  • Updated model handling code to be compatible with latest ollama package

Notes

The project needed updates to work with the latest versions of its dependencies, particularly the ollama package which has had significant updates. These changes ensure reproducible environments and compatibility with current package versions.

@asciimo
Copy link
Copy Markdown

asciimo commented Dec 23, 2024

I tested this PR and it works great. Thank you!

Until this is merged, a lazy workaround is pinning ollama==0.1.8 in requirements.txt, to get benchmark.py running as originally intended.

Copy link
Copy Markdown

@bigmessydata bigmessydata left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great patch! works great on llama 3.3

@adamj34
Copy link
Copy Markdown

adamj34 commented Jan 3, 2025

I also tested this PR locally and everything worked properly. Tested on Alibaba's QWQ model.

@mykytahordia
Copy link
Copy Markdown

Works good on my machine. Thanks for update, I wish to see it in original repo, because the error was annoying.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants