Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B Instruct KhanAcademy v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
CodingTool use
MI
Ministral 3 3B Instruct 2512
Mistral · ggml-org
Params3.43B
Context256K
Smallest3.7 GB
Vision
MI
Mistralai Shieldstral 1.0 3B
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
MI
Magistral Small 2507
Mistral · bartowski
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
MI
Writing_Partner_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Open StarLake Swap 7B
Mistral · Aryanne
Params7.24B
Context32K
Smallest4.1 GB
Tool use
MI
cognitive-hacker-gguf-0.2
Mistral · ebowwa
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 24B Instruct 2501 Heretic
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · InferenceIllusionist
Params22.2B
Context64K
Q4_K_M13.3 GB
CodingTool use
MI
General Stories Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral NeuralDPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingVision
MI
Mistraldouble 7B task
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
MI
Mixtral AI AlphaTron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
KawaiiMahou-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin3.0 R1 Mistral 24B
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
Reasoning
MI
failspy Codestral 22B v0.1 abliterated v3
Mistral · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
NSFW DPO Noromaid 7b Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Roleplay
MI
AmeerH Mistral Math 2x7b mix
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
open-orca_mixtral-slimorca-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1
Mistral · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral Nemo NT Ko 12B sft i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
CodingRoleplay
MI
Nous-Hermes-2-Mixtral-8x7B-DPO
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
Devstral Small 2 24B Instruct Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
MI
Nous-Hermes-2-Mixtral-8x7B-SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
Mistral 7B Instruct v0.3 Heretic
Mistral · saidutta69
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing