Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Ministral 3 14B Reasoning 2512
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Reasoning
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral 2x24B MOE Power Devstral Magistral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
CodingReasoningTool use
MI
Mistral 7b Instruct v0.2 Heretic
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated v2
Mistral · noctrex
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Mistral 7B Instruct RR Abliterated
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openbuddy_openbuddy-mistral-7b-v13
Mistral · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral dolphin 2.8 grok instract 2 7B slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Mistral 22B v0.2
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
HannaHermes 2.5 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Ministral 3 3B Instruct 2512 Heresy Unfiltered
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
MI
Huihui Ministral 3 3B Reasoning 2512 Abliterated
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Reasoning
MI
models--mergekit-community--mergekit-slerp-zonivkr
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
grok oss 7B
Mistral · DeviantArtist031
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Infinity Instruct 7M 0729 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-Holodeck-1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral NeMo Minitron 8B Base CODE Python i1
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
Coding
MI
mistral 7b uncensored
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ektome Mistral 7B Instruct v0.2 PristinelyUncensored
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Lite-Mistral-150M-v2-Instruct
Mistral · mradermacher
Params157M
Context2K
Q4_K_M0.1 GB
GGUF
MI
Hermes 2 Pro Mistral 7B GodCoder
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
llmware_dragon-mistral-7b-v0
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-xqswkgn
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-Small-4-119B-2603
Mistral · lmstudio-community
Params119B
Context1024K
Q4_K_M72.2 GB
Vision
MI
Mistral 2x24B MOE Power Magistral Devstral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
CodingReasoning
MI
dolphin-2.8-mistral-v02-2x7b
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Mistral 7B Instruct v0.1 16k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Snorkel Mistral PairRM DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing