Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
RenCoder Ministral 8B Instruct 2410
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
CodingTool use
MI
Tess 3 Mistral Large 2 123B
Mistral · xxris
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
MI
MistralLite
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Mistral 7B Instruct RRHF
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MistralInstructLongish Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
GraySwanAI Mistral 7B Instruct RR
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct RR Abliterated
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nexus IKM Mistral Instruct v0.2 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral RealworldQA v0.2 7b SFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral nemo kartoffel 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Magistral 2509 24B Animus V12.1
Mistral · Darkhn-Quants
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningRoleplayTool use
MI
Mistral Playwright v1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Megamerge Dare 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Mistral 7B Instruct IPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 11B Instruct v0.2
Mistral · Artefact2
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
OpenHermes 2.5 Mistral Ca Es 7B
Mistral · xaviviro
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B Instruct v0.3 Parasite
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
zubr mini 1.9 8b
Mistral · alekringtonnn-ai
Params8.49B
Context256K
Smallest3.1 GB
Tool useVision
MI
KoboldAI Mistral 7B Erebus v3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hyperion 3.0 Mistral 7B DPO
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SciPhi Self RAG Mistral 7B 32k i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 8B Instruct 2410
Mistral · QuantFactory
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
openchat 3.5 0106 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
T3Q Platypus Mistral7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
PiVoT 0.1 early Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Devstral Vision Small 2507
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
MI
Ministral 8B Instruct
Mistral · DuoNeural
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
Rabbit 7B DPO Chat Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Vezora Mistral 14b Merge Base
Mistral · RichardErkhov
Params14.2B
Context32K
Q4_K_M8.6 GB
GGUF

Keep browsing