Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
mlfoundations dev hp ablations mistral epoch2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Bio Mistral 7B Slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral RealworldQA v0.2 7b SFT i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Marcoroni neural chat 7B v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 2x24B MOE Magistral 2506 Devstral 2507 1.1 Coder Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
MI
Mistral CyberLawyer 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin 2.6 Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hyperion 2.1 Mistral 7B
Mistral · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Fireball Mistral Nemo Base 2407 Instruct v1 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Ae Calem Mistral 7b v0.1
Mistral · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 24B Instruct Jbliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
mistral pl owca
Mistral · JonaszPotoniec
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo MCAI SFT DPO i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
openbuddy mistral 7b v13 base Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3
Mistral · pravdin
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MistralHermes CodePro 7B v1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B KNUT v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2 Function Calling
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
DeepHermes 3 Mistral 24B Preview
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
japanese stablelm base gamma 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Large Instruct 2411
Mistral · Quant-Cartel
Params123B
Context128K
Q4_K_M73.2 GB
MI
Mistral Trismegistus 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Limamono Mistral 7B v0.50
Mistral · lemonilia
Params7.24B
Context32K
Smallest3.1 GB
MI
Hyperion 2.0 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral nemo bophades 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral 7B Instruct v0.2 new1 uinsa
Mistral · mni15
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephykor ko beta 7b chang Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2 Neural Story
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Candle Nous Hermes 2 Mistral 7B DPO
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
MI
PiVoT 10.7B Mistral v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB