Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
bophades mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DoppelPotato
Mistral · mradermacher
Params13.3B
Context1000K
Q4_K_M8.1 GB
GGUF
MI
Air Striker Mixtral 8x7B ZLoss
Mistral · LoneStriker
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Ministral-3-3B-Instruct-2512
Mistral · erics465
Params3.43B
Context256K
Q4_K_M2.1 GB
Tool useVision
MI
Apple.Sage Ft Mixtral 8x7b
Mistral · DevQuasar
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral 7B Discord 0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Linkbricks Horizon AI Korean Advanced 12B
Mistral · Saxo
Params12.2B
Context1000K
Smallest7.5 GB
Tool use
MI
flammenai flammen12 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Starling LM 11B alpha Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Chronos Gold 12B 1.0
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MI
kolibri mistral 0427
Mistral · kaleinaNyan
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
German Mistral7B merge tests
Mistral · Blizado
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Voicecraft Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Yarn Mistral 7b 128k
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 2 From Mixtral 8x7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.6 GB
GGUF
MI
nbeerbower/mistral-nemo-wissenschaft-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Tess 2.0 Mixtral 8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
PIXMELT Mistral 7B Instruct v0.2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
synapsellm-7b-mistral-v0.3-preview
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral Small 2509 Ultra Uncensored Heretic v1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
MI
Mistral-11B-v0.3
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
Locutusque Hercules 3.1 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral modelstock 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-urmzxzt
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
MetaMath Tulpar 7b v2 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 14B DeLERP 0.9 Instruct
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool use

Keep browsing