Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Nexus IKM Hermes 2 Pro Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Small Gutenberg Doppel 22B i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
MI
Ministral 8B Instruct heretic
Mistral · saidutta69
Params8.02B
Context32K
Q4_K_M4.9 GB
RoleplayTool use
MI
Mistral-7B-Instruct-v0.3
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
GGUF
MI
Devstral Small 2505
Mistral · eaddario
Params23.6B
Context128K
Q4_K_M12.5 GB
GGUF
MI
Ministral 3 8B Reasoning 2512 Uncensored
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct Aya 101
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Ministral 3 3B Reasoning 2512 Heretic
Mistral · coder3101
Params3.43B
Context256K
Q4_K_M2.1 GB
CodingReasoningTool use
MI
jisukim8873 mistral 7B alpaca 1 epoch
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
BlackSheep Mistral RP 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
dphn.Dolphin Mistral 24B Venice Edition
Mistral · DevQuasar
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
LeChatonFat Final
Mistral · squ11z1
Params3.43B
Context256K
Q4_K_M2.1 GB
Tool use
MI
mistral-orthogonalized
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MN Helcyon GPT 4o 12b v4.5
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Mistral 7B v0.2 none DepressionDetection v2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Merge Mistral Prometheus 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral-seed-pollux-v0.1
Mistral · mradermacher
Params520M
Context128K
Q4_K_M0.3 GB
GGUF
MI
Mistral Small Instruct 2409 Abliterated
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
MI
NeuralHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Ministral 3 14B Nymphaea RP heretic
Mistral · Yingyaeliae
Params13.5B
Context256K
Q4_K_M8.2 GB
RoleplayTool use
MI
cognitive-hacker-gguf
Mistral · ebowwa
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B ProXMath
Mistral · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Reasoning 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Reasoning
MI
m8than mistral 7b instruct 0.2
Mistral · RichardErkhov
Params7.24B
Context—
Q4_K_M1.1 GB
GGUF
MI
Mistral 7B Instruct KhanAcademy v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Super Slop Machina RP XXL Small 3B 2608
Mistral · Indexnusrefather
Params3.43B
Context256K
Q4_K_M2.1 GB
RoleplayTool useVision
MI
Mistral Nemo Gutenberg Doppel 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · mistral-experimental
Params4B
Context—
Smallest3.1 GB
GGUF

Keep browsing