Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
mistralai.Mistral Nemo Instruct 2407
Mistral · DevQuasar-9
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
mistral ko 7b wiki neft i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Captain Eris Violet Mistralified 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
openbuddy-mistral-7b-v17.1-32k
Mistral · RichardErkhov
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral lr1e 5 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenAssisted English Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Maya Hermes 2.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
shleeeee mistral ko exo mrc v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ja-ck/Mistral-instruct-Y24-v5
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hercules 1.0 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral 7B Discord 0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Devstral Small 2
Mistral · freddm
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingTool use
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 31 layer
Mistral · mradermacher
Params7.02B
Context32K
Q4_K_M4.2 GB
GGUF
MI
Mixtral 8x7B v0.1 Top3
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
mistral 7b dpo v6 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
nbeerbower mistral nemo gutenberg 12B v2
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · grapevine-AI
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mixtral 7Bx2 truthy
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Synatra Mixtral 8x7B
Mistral · LoneStriker
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral v0.1 Italian SAVA Instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
flammenai/Mahou-1.2a-mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral NeuralDPO v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-11B-AirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
Mistral nemo 3b unhealed
Mistral · mradermacher
Params5.43B
Context128K
Q4_K_M3.4 GB
GGUF
MI
Tess 2.0 Mixtral 8x7B v0.2
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC Q3 K M
Mistral · MishraNepali
Params12.2B
Context1000K
Smallest6.1 GB
ReasoningRoleplay
MI
shleeeee mistral ko OpenOrca Platypus v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Metis 0.4 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Flammades Mistral Nemo 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing