Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Locutusque Hyperion 2.0 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407 Absolute Heresy
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
mistral 7b grok
Mistral · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral nemo 12b reasoning psychology
Mistral · jtatman
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mini Mistral
Mistral · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
Mistral Nemo Instruct 2407 Heretic
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
ewqr2130 mistral inst v02 dpo
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MistralHermes CodePro 7B v1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
cognitivecomputations dolphin 2.1 mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
bartleby v0.1
Mistral · felix-red-panda
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
clowman openchat mistral 7b reproduce
Mistral · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
pszemraj Mistral v0.3 6B
Mistral · RichardErkhov
Params5.94B
Context32K
Q4_K_M3.6 GB
MI
Mistral 7B Instruct v0.1 Dpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 8B maker v2
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
vicgalle Configurable Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
cais HarmBench Mistral 7b val cls
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
StructLM-7B-Mistral
Mistral · Monor
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistralai.Mistral 7B Instruct v0.1
Mistral · DevQuasar-8
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407
Mistral · CISCai
Params12.2B
Context1000K
Smallest3.0 GB
MI
Llava Med v1.5 Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
WebraftAI synapsellm 7b mistral v0.5 preview2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral lr5e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dragon Mistral 7b v0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CatMacaroni Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Trismegistus 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
DPO Kimlan Mistral 7B Tw
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-gmjabaw
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Shastra Mistral Math SFT I
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
KafkaLM Mixtral 8x7B V0.2 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Isotonic Hermes 2 Pro Mixtral 4x7B
Mistral · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB