Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral 7B v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
llava 1.6 mistral 7b
Mistral · cjpais
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral 7B Instruct v0.3
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 8B Reasoning 2512
Mistral · mistralai
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral Heretica 12B
Mistral · AnkitAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral-Large-4-1T-A52B-DSpark
Mistral · unsloth
Params1050B
Context1024K
Smallest2.2 GB
MI
Codestral 22B v0.1 IMat
Mistral · legraphista
Params22.2B
Context32K
Smallest4.8 GB
MI
Ministral 3 14B Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Devstral-Small-2505
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Magidonia 24B v4.3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
argilla_capybarahermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ehartford_dolphin-2.0-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Helcyon Mercury 12b v3.2 Absolute Heresy
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Ministral 3 3B Reasoning 2512
Mistral · mistralai
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
sciphi_sciphi-mistral-7b-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Codestral-22B-v0.1
Mistral · lmstudio-community
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Mistral Large Instruct 2411
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
MI
mistralai_Ministral 3 8B Instruct 2512 BF16
Mistral · lmstudio-community
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Air Striker Mixtral 8x7B ZLoss i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
migtissera_synthia-moe-v3-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Devstral Small 2 24B Instruct 2512
Mistral · ggml-org
Params23.6B
Context384K
Smallest25.1 GB
MI
Ministral 3 8B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Ministral 3 8B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407 abliterated
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Voxtral Mini 3B 2507
Mistral · bartowski
Params4.01B
Context128K
Q4_K_M2.5 GB
MI
Ministral 3 8B Instruct 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB