Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Dolphin3.0 R1 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
herman555_dolphin-2.2.1-ashhlimarp-mistral-7b-gguf
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin 2.6 Mistral 7b Dpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Schreiber Mistral Nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
go bruins v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Tess 3 Mistral Nemo 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Instruct Orca Slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Hermes Support Ties
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mamba gpt 7b v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
weyaxi_metamath-neuralhermes-2.5-mistral-7b-linear
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B golden Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral-Small-2506-abliterated
Mistral · Mungert
Params23.6B
Context40K
Q4_K_M14.3 GB
MI
K2S3 Mistral 7b v1.0
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
MI
shisa base 7b v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Holodeck 1 Instruct 32k i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Helcyon Solara 2 14b v2.0
Mistral · XeyonAI
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
models--mergekit-community--mergekit-slerp-ghxdzjf
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · duyntnet
Params8.41B
Context8K
Q4_K_M5.1 GB
MI
Mistral Magistral Devstral Instruct FUSED CODER Reasoning 36B
Mistral · mradermacher
Params35.8B
Context128K
Q4_K_M21.7 GB
MI
Codestral-21B-Pruned
Mistral · mradermacher
Params21.5B
Context32K
Q4_K_M12.8 GB
MI
Mistral Small 3.2 24B Instruct 2506 Text Only Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Tess R1 Ballad Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
MI
Gutensuppe mistral nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Ministral 3 14B Reasoning 2512
Mistral · eaddario
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Mistral 11b Slimorca
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
Mistral Nemo abliterated Nemo Pro v2 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
dolphin 2.0 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral Small 2509 Heretic v1.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Small 3.1 24B Base 2503
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
openbuddy zephyr 7b v14.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB