Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral Nemo Instruct bellman 12b i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
dolphin-2.1-mistral-7b-snr-math-laser
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B V3 asstr i1
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Autolycus-Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
cgato_thespis-mistral-7b-v0.5
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin 2.0 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenMath-Mistral-7B-v0.1-hf
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Scar 8B
Mistral · ItzRustam
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
mistral ocr2json v3 chatml
Mistral · mychen76
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Cydonia 24B v3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral v0.1 Italian SAVA Instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
saul mistral instruct v0.1 7b ties i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3_2 24B Instruct 2506 Antislop.V2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral 7B Parasite
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Bitnet-Mistral.0.2-330m-v0.2-grokfast-v2.9
Mistral · RichardErkhov
Params330M
Context4K
Q4_K_M0.2 GB
MI
Seraph 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
speechless code mistral 7b v1.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin 2.6 Mistral 7b Dpo Laser
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MathGenie Mixtral 8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral Instruct Mcqa Circuit Broken
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 3B Medical Reasoning
Mistral · xtools-at
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
splade disco human mistral i1
Mistral · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
MI
Samantha 1.2 Mistral 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
AZERG T3 Mistral i1
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Candle MistralTrix v1
Mistral · DanielClough
Params8.99B
Context—
Smallest2.9 GB
MI
Ministral 3 3B Instruct 2512 Heresy Unfiltered
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mistral 7B v0.2 Hf
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
koOpenChat sft Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
flammen15 mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB