Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Dolphin3.0 R1 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoningTool use
MI
herman555_dolphin-2.2.1-ashhlimarp-mistral-7b-gguf
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin 2.6 Mistral 7b Dpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Schreiber Mistral Nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
go bruins v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Tess 3 Mistral Nemo 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Instruct Orca Slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Hermes Support Ties
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mamba gpt 7b v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
weyaxi_metamath-neuralhermes-2.5-mistral-7b-linear
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B golden Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral-Small-2506-abliterated
Mistral · Mungert
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
MI
K2S3 Mistral 7b v1.0
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
MI
shisa base 7b v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Holodeck 1 Instruct 32k i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Helcyon Solara 2 14b v2.0
Mistral · XeyonAI
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningRoleplay
MI
models--mergekit-community--mergekit-slerp-ghxdzjf
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral NeMo Minitron 8B Instruct
Mistral · duyntnet
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
MI
Mistral Magistral Devstral Instruct FUSED CODER Reasoning 36B
Mistral · mradermacher
Params35.8B
Context128K
Q4_K_M21.7 GB
CodingReasoning
MI
Codestral-21B-Pruned
Mistral · mradermacher
Params21.5B
Context32K
Q4_K_M12.8 GB
Coding
MI
Mistral Small 3.2 24B Instruct 2506 Text Only Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Tess R1 Ballad Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Reasoning
MI
Gutensuppe mistral nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Ministral 3 14B Reasoning 2512
Mistral · eaddario
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningTool use
MI
Mistral 11b Slimorca
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
Mistral Nemo abliterated Nemo Pro v2 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
dolphin 2.0 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral Small 2509 Heretic v1.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
MI
Mistral Small 3.1 24B Base 2503
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
openbuddy zephyr 7b v14.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing