Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
bophades mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
DoppelPotato
Mistral · mradermacher
Params13.3B
Context1000K
Q4_K_M8.1 GB
MI
Air Striker Mixtral 8x7B ZLoss
Mistral · LoneStriker
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral-3-3B-Instruct-2512
Mistral · erics465
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Apple.Sage Ft Mixtral 8x7b
Mistral · DevQuasar
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral 7B Discord 0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Linkbricks Horizon AI Korean Advanced 12B
Mistral · Saxo
Params12.2B
Context1000K
Smallest7.5 GB
MI
flammenai flammen12 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Starling LM 11B alpha Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Chronos Gold 12B 1.0
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
kolibri mistral 0427
Mistral · kaleinaNyan
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
German Mistral7B merge tests
Mistral · Blizado
Params7.24B
Context32K
Smallest7.7 GB
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Voicecraft Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Yarn Mistral 7b 128k
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 2 From Mixtral 8x7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.6 GB
MI
nbeerbower/mistral-nemo-wissenschaft-12B
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Tess 2.0 Mixtral 8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
PIXMELT Mistral 7B Instruct v0.2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
synapsellm-7b-mistral-v0.3-preview
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral Small 2509 Ultra Uncensored Heretic v1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral-11B-v0.3
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
Locutusque Hercules 3.1 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral modelstock 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
models--mergekit-community--mergekit-slerp-urmzxzt
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Tulpar 7b v2 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 14B DeLERP 0.9 Instruct
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB