Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Locutusque Hyperion 2.0 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407 Absolute Heresy
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
mistral 7b grok
Mistral · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral nemo 12b reasoning psychology
Mistral · jtatman
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
MI
Mini Mistral
Mistral · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
Mistral Nemo Instruct 2407 Heretic
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
ewqr2130 mistral inst v02 dpo
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MistralHermes CodePro 7B v1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
cognitivecomputations dolphin 2.1 mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
bartleby v0.1
Mistral · felix-red-panda
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
clowman openchat mistral 7b reproduce
Mistral · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
pszemraj Mistral v0.3 6B
Mistral · RichardErkhov
Params5.94B
Context32K
Q4_K_M3.6 GB
GGUF
MI
Mistral 7B Instruct v0.1 Dpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 8B maker v2
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
vicgalle Configurable Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
cais HarmBench Mistral 7b val cls
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
StructLM-7B-Mistral
Mistral · Monor
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistralai.Mistral 7B Instruct v0.1
Mistral · DevQuasar-8
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · CISCai
Params12.2B
Context1000K
Smallest3.0 GB
Tool use
MI
Llava Med v1.5 Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Vision
MI
WebraftAI synapsellm 7b mistral v0.5 preview2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral lr5e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dragon Mistral 7b v0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CatMacaroni Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Trismegistus 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DPO Kimlan Mistral 7B Tw
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
models--mergekit-community--mergekit-slerp-gmjabaw
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Shastra Mistral Math SFT I
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
KafkaLM Mixtral 8x7B V0.2 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Isotonic Hermes 2 Pro Mixtral 4x7B
Mistral · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
Tool use

Keep browsing