Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Nemo Instruct bellman 12b i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
dolphin-2.1-mistral-7b-snr-math-laser
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral 7B V3 asstr i1
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Autolycus-Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
cgato_thespis-mistral-7b-v0.5
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.0 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenMath-Mistral-7B-v0.1-hf
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Scar 8B
Mistral · ItzRustam
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
MI
mistral ocr2json v3 chatml
Mistral · mychen76
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Cydonia 24B v3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral v0.1 Italian SAVA Instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
saul mistral instruct v0.1 7b ties i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3_2 24B Instruct 2506 Antislop.V2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool useVision
MI
Mistral 7B Parasite
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Bitnet-Mistral.0.2-330m-v0.2-grokfast-v2.9
Mistral · RichardErkhov
Params330M
Context4K
Q4_K_M0.2 GB
GGUF
MI
Seraph 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
speechless code mistral 7b v1.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Dolphin 2.6 Mistral 7b Dpo Laser
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
MathGenie Mixtral 8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Coding
MI
Mistral Instruct Mcqa Circuit Broken
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 3B Medical Reasoning
Mistral · xtools-at
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
MI
splade disco human mistral i1
Mistral · mradermacher
Params109M
Context512
Q4_K_M0.1 GB
GGUF
MI
Samantha 1.2 Mistral 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
AZERG T3 Mistral i1
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Candle MistralTrix v1
Mistral · DanielClough
Params8.99B
Context—
Smallest2.9 GB
GGUF
MI
Ministral 3 3B Instruct 2512 Heresy Unfiltered
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
MI
Mistral 7B v0.2 Hf
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
koOpenChat sft Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
flammen15 mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral NeMo Minitron 8B Base
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF

Keep browsing