Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Dolphin3.0 R1 Mistral 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated
Mistral · maerong3
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Ministral-3-14B-Reasoning-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
cognitivecomputations_dolphin-2.6-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B
Mistral · DavidAU
Params24.2B
Context32K
Q4_K_M14.7 GB
MI
nousresearch_nous-hermes-2-mixtral-8x7b-dpo
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Rocinante XL 16B v1
Mistral · TheDrummer
Params16.1B
Context128K
Q4_K_M9.7 GB
MI
dolphin 2.9.3 mistral nemo 12b
Mistral · dphn
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
devstral-small-2507
Mistral · mistralai
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Devstral-2-123B-Instruct-2512
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Codestral-22B-v0.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
teknium_openhermes-2-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · mistralai
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
maywell Mistral ko 7B v0.1
Mistral · RichardErkhov
Params1.5B
Context—
Q4_K_M0.0 GB
MI
Mistral Small 4 119B ROCmFP4
Mistral · kingjones777
Params119B
Context1024K
Smallest67.7 GB
MI
ehartford_dolphin-2.2.1-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Abliterated Dolphin3.0 R1 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Skyfall 31B v4.2
Mistral · TheDrummer
Params31.4B
Context128K
Q4_K_M19.0 GB
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Magistral-Small-2509
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Nemo Instruct 2407
Mistral · lmstudio-community
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Ministral 3 14B Instruct 2512
Mistral · bartowski
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Mistral Small 24B Instruct 2501
Mistral · unsloth
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
dolphin 2.8 mistral 7b v02
Mistral · lmstudio-community
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MegaBeam Mistral 7B 512k
Mistral · bartowski
Params7.24B
Context512K
Q4_K_M4.4 GB
MI
ehartford_dolphin-2.1-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small Instruct 2409
Mistral · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
MI
magistral-small-2509
Mistral · mistralai
Params23.6B
Context40K
Q4_K_M14.3 GB