Skip to content

Issues: EricLBuehler/mistral.rs

Model Wishlist
#156 opened Apr 16, 2024 by EricLBuehler
Open 97
Tracking: Metal performance vs. MLX, llama.cpp
#903 opened Nov 10, 2024 by EricLBuehler
Open 6
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

71 Open 230 Closed
71 Open 230 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Llama 3.2 interactive mode fails after second message bug Something isn't working
#1016 opened Dec 31, 2024 by dozingcat
BitNet support new feature New feature or request optimization
#1013 opened Dec 28, 2024 by EricLBuehler
1
Model cannot terminate itself when running single GGUF/GGML model bug Something isn't working
#1012 opened Dec 28, 2024 by guoqingbao
OAI compat endpoint w/ Images? bug Something isn't working
#1008 opened Dec 27, 2024 by bioshazard
6
0.3.4 #992 - #998 doesn't build bug Something isn't working build Issues relating to building mistral.rs
#999 opened Dec 20, 2024 by misureaudio
3
How do I finetune/train models with this? new feature New feature or request
#980 opened Dec 9, 2024 by Tameflame
[Feature Request] -- EfficientQAT (Omniquant Successor) and/or ISTA-DASLab Higgs Quant. Models/Formatting new feature New feature or request
#977 opened Dec 7, 2024 by BuildBackBuehler
1
create_ordering.py not supported with llama 3 loras bug Something isn't working
#976 opened Dec 7, 2024 by kkailaasa
1
KV Cache Quantization new feature New feature or request
#971 opened Dec 4, 2024 by dinerburger
7
fast-forward tokens with llguidance new feature New feature or request
#965 opened Dec 2, 2024 by mmoskal
parallel computation of mask in constrained sampling new feature New feature or request
#964 opened Dec 2, 2024 by mmoskal
rejection sampling for top_p etc bug Something isn't working
#963 opened Dec 2, 2024 by mmoskal
Possible problem with candle 0.8.0 - doesn't build on a GTX1650 (CI 75) nor a GTX1070 (CI 61) bug Something isn't working build Issues relating to building mistral.rs
#954 opened Dec 1, 2024 by misureaudio
2
Create and load standalone quantized UQFF models new feature New feature or request
#947 opened Nov 29, 2024 by FishiaT
6
DiffusionArchitecture not found in python package bug Something isn't working build Issues relating to building mistral.rs resolved
#943 opened Nov 28, 2024 by Manojbhat09
5
Flash Attention not building bug Something isn't working build Issues relating to building mistral.rs triaged This error has been reproduced or otherwise triaged.
#941 opened Nov 27, 2024 by Aveline67
13
Couldnt run any vision model bug Something isn't working
#935 opened Nov 26, 2024 by GraphicalDot
17
Error: Enable to run Lora - Adapter files are empty bug Something isn't working
#929 opened Nov 23, 2024 by kkailaasa
1
Confusion around loading a GGUF locally
#922 opened Nov 20, 2024 by mojadem
2
Speculative decoding support for mistralrs-server new feature New feature or request
#912 opened Nov 16, 2024 by PkmX
Tracking: Metal performance vs. MLX, llama.cpp optimization
#903 opened Nov 10, 2024 by EricLBuehler
6
Add gemma2 architecture support for GGUF models Additions to model or architectures new feature New feature or request
#901 opened Nov 9, 2024 by grpathak22
How can I use two NVIDIA RTX 4090 GPUs with mistral.rs? new feature New feature or request
#892 opened Oct 28, 2024 by ricesin888
1
Text Completion/Raw Input support? new feature New feature or request
#890 opened Oct 27, 2024 by oofdere
1
Feature Request 「plz support InternLM2.5」 new feature New feature or request
#876 opened Oct 23, 2024 by boshallen
ProTip! Follow long discussions with comments:>50.