Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Codestral-RAG-19B-Pruned
Mistral · mradermacher
Params19.1B
Context32K
Q4_K_M11.5 GB
Coding
MI
SciPhi Mistral 7B 32k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DavidAU.Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B
Mistral · DevQuasar-9
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
Mistral 7B Sunda v1.0
Mistral · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Fwizzer R1 3B ZH v2
Mistral · fwizzer1
Params3.43B
Context256K
Smallest2.1 GB
CodingReasoningVision
MI
mistralai Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hermes Trismegistus Mistral 7B
Mistral · afrideva
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Nemo Punisher Carnage V2
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Mistral 7b Instruct v0.2 Heretic
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Pantheon Rp 1.6 12b Nemo
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MI
skunkworksai_mistralic-7b-1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MistralThinker v1.1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
ReasoningRoleplay
MI
kunoichi-lemon-royale-v2-32K-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-llfrpky
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Nemo Instruct MCAI SFT DPO revision only i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
MI
Mistral Large Instruct
Mistral · InferenceIllusionist
Params123B
Context32K
Q4_K_M73.2 GB
GGUF
MI
Mistral Large 3 675B Instruct 2512 BF16
Mistral · mradermacher
Params673B
Context288K
Q4_K_M405.8 GB
Tool use
MI
Ape Fiction 2 Mistral Nemo
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-xxzrbzh
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
CleverBoi Nemo 12B v2
Mistral · theprint
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Codestral-22B-v0.1-hf
Mistral · second-state
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
mistral nemo bophades3 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
MI
mistral nemo bophades 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
OpenMed SynthVision MedVL AIO
Mistral · prithivMLmods
Params3.43B
Context256K
Smallest2.0 GB
Tool useVision
MI
Ministral 3 8B Instruct 2512
Mistral · ggml-org
Params8.49B
Context256K
Smallest9.0 GB
Tool useVision
MI
Mistral Small 24B Instruct 2501
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
test help steer filtered orig Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Candle Mistral Trismegistus 7B
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
MI
NousResearch/Nous-Hermes-2-Mistral-7B-DPO
Mistral · DevQuasar-12
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Tiamat 24B Magistral PaperWitch Heresy
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningRoleplayTool use

Keep browsing