Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
finetuned mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
WikiHow Mistral Instruct 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
typhoon 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Base SFT SimPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · Chuncho32
Params12.2B
Context1000K
Smallest13.0 GB
ReasoningRoleplay
MI
Merge Mixtral Prometheus 8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Ministral 3 8B Instruct 2512 PaperWitch Heresy
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Tool useVision
MI
Mistral 7B Instruct v0.2 8bit Abliterated
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Instruct 2512 Tainted Heresy
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Tool use
MI
Mistral Crab DPO
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Erebus v3
Mistral · KoboldAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 8B Instruct 2410 Abliterated
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
dolphin-2.9.2-mixtral-8x22b
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
CodingTool use
MI
Ministral 3 3B Reasoning 2512
Mistral · ggml-org
Params3.43B
Context256K
Smallest3.7 GB
ReasoningTool useVision
MI
Mistral 7B Instruct v0.2
Mistral · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral Small 2509 Vision
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M12.6 GB
ReasoningTool useVision
MI
Mistral Large Instruct 2407
Mistral · lmstudio-community
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Hyperion 2.0 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral Nemo Storywriter 12b 241015
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Mistral 7B Discord 0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
BagelMIsteryTour v2 8x7B
Mistral · ycros
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
airoboros m 7b 3.1.2 dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hyperion 2.1 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Huihui Ministral 3 3B Reasoning 2512 Abliterated
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Reasoning
MI
mistral 7b grok i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral_Pro_8B_v0.1
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
MI
typhoon 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Yarn Mistral 7b 128k
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SciPhi Mistral 7B 32k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing