Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mixtral AI MegaTron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mamba gpt 7b v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MetaMath Mistral 2x7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Harbinger-24B
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
MI
Codestral 22B v0.1 iMat
Mistral · qwp4w3hyb
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Trinity 2 Codestral 22B i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
mistral small instruct 2501 clstlclms
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral Chimera Pro 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool use
MI
Voxtral Small 24B 2507
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool use
MI
jackalope 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mini Mistral
Mistral · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
Mistral Devstral 2507 CODER Brainstorm20x 34B
Mistral · mradermacher
Params34.1B
Context128K
Q4_K_M20.7 GB
CodingTool use
MI
Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Delta NAS Mistral 7B
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Mistral 11B OmniMix9 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MetaMath Cybertron Starling Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Pixtral Large Instruct 2411
Mistral · EnlistedGhost
Params123B
Context128K
Smallest46.7 GB
Vision
MI
Mistral Military 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
mistral nemo wissenschaft 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Lily Cybersecurity 7B v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b indian university guidance
Mistral · millat
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Linkbricks Horizon AI Korean Advanced 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
dolphin 2.2.1 mistral 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
LogicFlow Mistral Small 24B Reasoning
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoning
MI
RAG KO Mixtral 7Bx2 v1.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
mistral nemo gutenberg 12B v3
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Ministral 3 14B Reasoning 2512
Mistral · EnlistedGhost
Params13.5B
Context256K
Q4_K_M9.2 GB
ReasoningVision
MI
Codestral-22B-v0.1
Mistral · duyntnet
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
models--automerger--Strangemerges_32T3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hyperion 3.0 Mistral 7B DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF

Keep browsing