Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
llava 1.6 mistral 7b
Mistral · cjpais
Params7.24B
Context32K
Q4_K_M4.4 GB
Vision
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Reasoning 2512
Mistral · mistralai
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
MI
Mistral Heretica 12B
Mistral · AnkitAI
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Mistral-Large-4-1T-A52B-DSpark
Mistral · unsloth
Params1050B
Context1024K
Smallest2.2 GB
ReasoningTool useVision
MI
Codestral 22B v0.1 IMat
Mistral · legraphista
Params22.2B
Context32K
Smallest4.8 GB
Coding
MI
Ministral 3 14B Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool use
MI
Devstral-Small-2505
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
MI
Magidonia 24B v4.3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
argilla_capybarahermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
ehartford_dolphin-2.0-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Helcyon Mercury 12b v3.2 Absolute Heresy
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MI
Ministral 3 3B Reasoning 2512
Mistral · mistralai
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
MI
sciphi_sciphi-mistral-7b-32k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Codestral-22B-v0.1
Mistral · lmstudio-community
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Mistral Large Instruct 2411
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
MI
mistralai_Ministral 3 8B Instruct 2512 BF16
Mistral · lmstudio-community
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
MI
Air Striker Mixtral 8x7B ZLoss i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
migtissera_synthia-moe-v3-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
Devstral Small 2 24B Instruct 2512
Mistral · ggml-org
Params23.6B
Context384K
Smallest25.1 GB
CodingVision
MI
Ministral 3 8B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Reasoning
MI
Ministral 3 8B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Reasoning
MI
Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407 abliterated
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Voxtral Mini 3B 2507
Mistral · bartowski
Params4.01B
Context128K
Q4_K_M2.5 GB
Vision
MI
Ministral 3 8B Instruct 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision

Keep browsing