Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
unsloth.Devstral Small 2505
Mistral · DevQuasar
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Small 24B Base 2501
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
BlackSheep Mistral RP 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
nbeerbower bophades v2 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Shisa v2 Mistral Small 24b
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mixtral 13Bx2 MOE 22B i1
Mistral · mradermacher
Params21.5B
Context4K
Q4_K_M13.0 GB
MI
Zero-Mistral
Mistral · ZeroAgency
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
style aware paraphraser mistral7b Q6 K
Mistral · n0kovo
Params7.25B
Context32K
Smallest5.9 GB
MI
Mistral Heretica 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Devstral Small 2507
Mistral · brittlewis12
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral 7b MoEified 8x
Mistral · kalomaze
Params7.24B
Context32K
Smallest14.5 GB
MI
Magidonia 24B v4.2.0
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Synatra V0.1 7B Instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openbuddy mistral 7b v13.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenZephyrChat Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Fantastica 7b Instruct 0.2 Italian
Mistral · scribis
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
agiin 13.6B v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 2x24B MOE Power Magistral Devstral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
MI
Mixtral_AI_CyberCoder_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-model_stock-qykbest
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MN Helcyon GPT 5.6 Sol 12b v1.0
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
mistral 7b wiki i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral Small 2509 Text Only
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · gaianet
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Flammen
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.2 46B The Brilliant Raconteur II Instruct 2506
Mistral · mradermacher
Params45.2B
Context128K
Q4_K_M27.4 GB
MI
sqlcoder 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Discord 0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral grammar
Mistral · mzbac
Params7.24B
Context32K
Smallest5.1 GB