Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
chihoonlee10 T3Q EN DPO Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Helcyon Mercury 12b v3.2 Absolute Heresy
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MI
T3Q DPO Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
mistral 7b anthropic i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mini Mixtral v0.2 i1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Mistral Nemo Instruct 2407 12B Thinking HI Claude Opus High Reasoning
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
Gukbap Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 119B 2603 ik
Mistral · AlexanderKyng
Params119B
Context1024K
Smallest67.2 GB
Tool useVision
MI
mistral v2 sec dolphin
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral7B PairRM SPPO Iter2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Typhon Mixtral v1 iMat
Mistral · InferenceIllusionist
Params46.7B
Context32K
Smallest12.6 GB
GGUF
MI
Ministral-3-14B-Nymphaea-RP
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
RoleplayTool useVision
MI
Helcyon Solara 2 14b v2.1
Mistral · XeyonAI
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningRoleplayTool use
MI
Hercules 2.0 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Genma Shiranui Canon
Mistral · TxsQT35
Params12.2B
Context128K
Smallest10.1 GB
GGUF
MI
Mistral 2x24B MOE Magistral 2506 Devstral 2507 1.1 Coder Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
CodingReasoning
MI
Mistral Large 4 1T A52B NVFP4
Mistral · ggml-org
Params1050B
Context1024K
Smallest4.2 GB
ReasoningTool useVision
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Darwin 7b v0.1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DeepHermes 3 Mistral 24B Preview
Mistral · NousResearch
Params23.6B
Context32K
Smallest13.4 GB
ReasoningRoleplayTool use
MI
Ministral 3 8B Reasoning 2512 Uncensored
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
Devstral Small 2507 Rebased Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool useVision
MI
Mistral Narwhal 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Uncensored
Mistral · torchsnow
Params8.49B
Context256K
Smallest5.9 GB
Vision
MI
Ministral 3 8B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · Medvedko
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
ministral 3 8b reasoning 2512
Mistral · nile-academy
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
SauerkrautLM Mixtral 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Hyperion 3.0 Mixtral 3x7B
Mistral · mradermacher
Params18.5B
Context32K
Q4_K_M11.4 GB
GGUF
MI
mistralai_Devstral Small 2505
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding

Keep browsing