Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Ministral 3 14B Reasoning 2512
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral 2x24B MOE Power Devstral Magistral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
MI
Mistral 7b Instruct v0.2 Heretic
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated v2
Mistral · noctrex
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral 7B Instruct RR Abliterated
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openbuddy_openbuddy-mistral-7b-v13
Mistral · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
MI
Mistral dolphin 2.8 grok instract 2 7B slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Mistral 22B v0.2
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
HannaHermes 2.5 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 3B Instruct 2512 Heresy Unfiltered
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Huihui Ministral 3 3B Reasoning 2512 Abliterated
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
models--mergekit-community--mergekit-slerp-zonivkr
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
grok oss 7B
Mistral · DeviantArtist031
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Infinity Instruct 7M 0729 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-Holodeck-1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral NeMo Minitron 8B Base CODE Python i1
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
MI
mistral 7b uncensored
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ektome Mistral 7B Instruct v0.2 PristinelyUncensored
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Lite-Mistral-150M-v2-Instruct
Mistral · mradermacher
Params157M
Context2K
Q4_K_M0.1 GB
MI
Hermes 2 Pro Mistral 7B GodCoder
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
llmware_dragon-mistral-7b-v0
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-xqswkgn
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-Small-4-119B-2603
Mistral · lmstudio-community
Params119B
Context1024K
Q4_K_M72.2 GB
MI
Mistral 2x24B MOE Power Magistral Devstral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
MI
dolphin-2.8-mistral-v02-2x7b
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Mistral 7B Instruct v0.1 16k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Snorkel Mistral PairRM DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB