New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: vram estimates for new gguf metadata #118

Merged

sammcj merged 2 commits into main from fix/estimates

Sep 21, 2024

Owner

sammcj commented Sep 21, 2024

fix: 🐞 Bug: aram estimate issue with gemma2 Ollama model #117
feat: add --vram-to-nth to specify context size to calculate out to

sammcj added 2 commits

September 21, 2024 16:22


          fix: vram estimates for new gguf metadata

df0bd8e


          fix: vram estimates for new gguf metadata

e02290c

sammcj self-assigned this

unfurl-links bot mentioned this pull request

🐞 Bug: aram estimate issue with gemma2 Ollama model #117

Closed

1 task

sammcj merged commit 7600ce3 into main

3 checks passed

sammcj deleted the fix/estimates branch

September 21, 2024 06:50

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet