Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
unsloth.Devstral Small 2505
Mistral · DevQuasar
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
MI
Mistral Small 24B Base 2501
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
BlackSheep Mistral RP 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
nbeerbower bophades v2 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Shisa v2 Mistral Small 24b
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mixtral 13Bx2 MOE 22B i1
Mistral · mradermacher
Params21.5B
Context4K
Q4_K_M13.0 GB
GGUF
MI
Zero-Mistral
Mistral · ZeroAgency
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
style aware paraphraser mistral7b Q6 K
Mistral · n0kovo
Params7.25B
Context32K
Smallest5.9 GB
GGUF
MI
Mistral Heretica 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Devstral Small 2507
Mistral · brittlewis12
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
MI
Mistral 7b MoEified 8x
Mistral · kalomaze
Params7.24B
Context32K
Smallest14.5 GB
GGUF
MI
Magidonia 24B v4.2.0
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
MI
Synatra V0.1 7B Instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openbuddy mistral 7b v13.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenZephyrChat Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Fantastica 7b Instruct 0.2 Italian
Mistral · scribis
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
agiin 13.6B v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 2x24B MOE Power Magistral Devstral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
CodingReasoning
MI
Mixtral_AI_CyberCoder_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
models--mergekit-community--mergekit-model_stock-qykbest
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MN Helcyon GPT 5.6 Sol 12b v1.0
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
mistral 7b wiki i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral Small 2509 Text Only
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · gaianet
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Dolphin Mistral 24B Venice Edition
Mistral · Lucy-in-the-Sky
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Flammen
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.2 46B The Brilliant Raconteur II Instruct 2506
Mistral · mradermacher
Params45.2B
Context128K
Q4_K_M27.4 GB
ReasoningRoleplay
MI
sqlcoder 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral 7B Discord 0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral grammar
Mistral · mzbac
Params7.24B
Context32K
Smallest5.1 GB
GGUF

Keep browsing