Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral 7B Instruct KhanAcademy v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
MI
Ministral 3 3B Instruct 2512
Mistral · ggml-org
Params3.43B
Context256K
Smallest3.7 GB
MI
Mistralai Shieldstral 1.0 3B
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Magistral Small 2507
Mistral · bartowski
Params23.6B
Context40K
Q4_K_M14.3 GB
MI
Writing_Partner_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Open StarLake Swap 7B
Mistral · Aryanne
Params7.24B
Context32K
Smallest4.1 GB
MI
cognitive-hacker-gguf-0.2
Mistral · ebowwa
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 24B Instruct 2501 Heretic
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · InferenceIllusionist
Params22.2B
Context64K
Q4_K_M13.3 GB
MI
General Stories Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral NeuralDPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
MI
Mistraldouble 7B task
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
MI
Mixtral AI AlphaTron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
KawaiiMahou-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin3.0 R1 Mistral 24B
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
MI
failspy Codestral 22B v0.1 abliterated v3
Mistral · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
NSFW DPO Noromaid 7b Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
AmeerH Mistral Math 2x7b mix
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
open-orca_mixtral-slimorca-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral Nemo NT Ko 12B sft i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Nous-Hermes-2-Mixtral-8x7B-DPO
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Devstral Small 2 24B Instruct Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
MI
Nous-Hermes-2-Mixtral-8x7B-SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral 7B Instruct v0.3 Heretic
Mistral · saidutta69
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB