Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mixtral AI MegaTron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mamba gpt 7b v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Mistral 2x7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Harbinger-24B
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Codestral 22B v0.1 iMat
Mistral · qwp4w3hyb
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Trinity 2 Codestral 22B i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
mistral small instruct 2501 clstlclms
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral Chimera Pro 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Voxtral Small 24B 2507
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
jackalope 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mini Mistral
Mistral · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
Mistral Devstral 2507 CODER Brainstorm20x 34B
Mistral · mradermacher
Params34.1B
Context128K
Q4_K_M20.7 GB
MI
Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Delta NAS Mistral 7B
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral 11B OmniMix9 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Cybertron Starling Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Pixtral Large Instruct 2411
Mistral · EnlistedGhost
Params123B
Context128K
Smallest46.7 GB
MI
Mistral Military 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
mistral nemo wissenschaft 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Lily Cybersecurity 7B v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b indian university guidance
Mistral · millat
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Linkbricks Horizon AI Korean Advanced 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
dolphin 2.2.1 mistral 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
LogicFlow Mistral Small 24B Reasoning
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
RAG KO Mixtral 7Bx2 v1.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
mistral nemo gutenberg 12B v3
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · EnlistedGhost
Params13.5B
Context256K
Q4_K_M9.2 GB
MI
Codestral-22B-v0.1
Mistral · duyntnet
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
models--automerger--Strangemerges_32T3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hyperion 3.0 Mistral 7B DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB