Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
mistralai_Ministral 3 14B Reasoning 2512
Mistral · lmstudio-community
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision
MI
avemio digital mistral 7b Sft pretrain 6000 steps merge
Mistral · RichardErkhov
Params7.24B
Context—
Q4_K_M0.1 GB
GGUF
MI
mistralai_Ministral 3 3B Instruct 2512 BF16
Mistral · lmstudio-community
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
MI
mistralai_mixtral-8x7b-instruct-v0.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
Devstral Small 2 24B Instruct 2512
Mistral · bartowski
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
MI
MistralRP Noromaid NSFW Mistral 7B
Mistral · Ttimofeyka
Params7.24B
Context32K
Smallest4.1 GB
GGUF
MI
Models Mistralai Ministral 3 14B Reasoning 2512
Mistral · MaziyarPanahi
Params13.5B
Context256K
Q4_K_M8.2 GB
Reasoning
MI
Mistral-Small-4-119B-2603
Mistral · unsloth
Params119B
Context1024K
Q4_K_M73.8 GB
Vision
MI
Ministral 3 3B Instruct 2512
Mistral · bartowski
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
MI
Ministral-3-8B-Instruct-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
Mistral Small 4 119B 2603
Mistral · bartowski
Params119B
Context1024K
Q4_K_M72.6 GB
Vision
MI
Mistral Small Instruct 2409
Mistral · mradermacher
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
MI
open-orca_mistral-7b-openorca
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin Mistral 24B Venice Edition
Mistral · douganger
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Ministral-3-14B-Instruct-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
MI
Ministral-3-8B-Reasoning-2512
Mistral · unsloth
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
MI
ehartford_dolphin-2.5-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingTool use
MI
Mistral 7B Instruct v0.2 llamafile
Mistral · mozilla-ai
Params7.24B
Context32K
Smallest14.5 GB
GGUF
MI
Mistral Small 4 119B 2603 Heretic
Mistral · Rioky
Params119B
Context1024K
Q4_K_M72.2 GB
Vision
MI
Ministral-3-3B-Reasoning-2512
Mistral · unsloth
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
MI
Ministral 8B Instruct 2410 TEST
Mistral · bartowski
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
MI
mistralai_mistral-7b-v0.1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407 12B Thinking M Claude Opus High Reasoning
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
Mistral-Medium-3.5-128B
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
Vision
MI
Mistral-7B-Instruct-v0.3
Mistral · lmstudio-community
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
cognitivecomputations_dolphin-2.7-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CodingTool use
MI
teknium_openhermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Devstral-Small-2507
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
MI
mistralai_mixtral-8x7b-v0.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF

Keep browsing