Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Nexus IKM Hermes 2 Pro Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small Gutenberg Doppel 22B i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Ministral 8B Instruct heretic
Mistral · saidutta69
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
MI
Devstral Small 2505
Mistral · eaddario
Params23.6B
Context128K
Q4_K_M12.5 GB
MI
Ministral 3 8B Reasoning 2512 Uncensored
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct Aya 101
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Ministral 3 3B Reasoning 2512 Heretic
Mistral · coder3101
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
jisukim8873 mistral 7B alpaca 1 epoch
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
BlackSheep Mistral RP 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dphn.Dolphin Mistral 24B Venice Edition
Mistral · DevQuasar
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
LeChatonFat Final
Mistral · squ11z1
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
mistral-orthogonalized
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MN Helcyon GPT 4o 12b v4.5
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral 7B v0.2 none DepressionDetection v2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Merge Mistral Prometheus 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral-seed-pollux-v0.1
Mistral · mradermacher
Params520M
Context128K
Q4_K_M0.3 GB
MI
Mistral Small Instruct 2409 Abliterated
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
NeuralHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 14B Nymphaea RP heretic
Mistral · Yingyaeliae
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
cognitive-hacker-gguf
Mistral · ebowwa
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B ProXMath
Mistral · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
MI
Ministral 3 8B Reasoning 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
m8than mistral 7b instruct 0.2
Mistral · RichardErkhov
Params7.24B
Context—
Q4_K_M1.1 GB
MI
Mistral 7B Instruct KhanAcademy v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Super Slop Machina RP XXL Small 3B 2608
Mistral · Indexnusrefather
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mistral Nemo Gutenberg Doppel 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · mistral-experimental
Params4B
Context—
Smallest3.1 GB