Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
mlfoundations dev hp ablations mistral epoch2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Bio Mistral 7B Slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral RealworldQA v0.2 7b SFT i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Marcoroni neural chat 7B v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 2x24B MOE Magistral 2506 Devstral 2507 1.1 Coder Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
CodingReasoning
MI
Mistral CyberLawyer 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin 2.6 Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Hyperion 2.1 Mistral 7B
Mistral · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Fireball Mistral Nemo Base 2407 Instruct v1 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Ae Calem Mistral 7b v0.1
Mistral · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 24B Instruct Jbliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
mistral pl owca
Mistral · JonaszPotoniec
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo MCAI SFT DPO i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
openbuddy mistral 7b v13 base Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · pravdin
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
MistralHermes CodePro 7B v1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B KNUT v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2 Function Calling
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
DeepHermes 3 Mistral 24B Preview
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
ReasoningRoleplayTool use
MI
japanese stablelm base gamma 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Large Instruct 2411
Mistral · Quant-Cartel
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
MI
Mistral Trismegistus 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Limamono Mistral 7B v0.50
Mistral · lemonilia
Params7.24B
Context32K
Smallest3.1 GB
GGUF
MI
Hyperion 2.0 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
mistral nemo bophades 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Mistral 7B Instruct v0.2 new1 uinsa
Mistral · mni15
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephykor ko beta 7b chang Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2 Neural Story
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Candle Nous Hermes 2 Mistral 7B DPO
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
MI
PiVoT 10.7B Mistral v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing