Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Ministral 3 3B Instruct 2512 Roleplay Tuned ERP Tolerant
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
RoleplayTool use
MI
fpham_karen_theeditor_v2_strict_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenAssisted English Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mahou-1.3d-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
math shepherd mistral 7b prm
Mistral · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B compressed i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.3 Jbliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
ReasoningRoleplay
MI
Mistral 7B OpenOrca
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.2 24B Instruct 2506 Text Only Heretic v1.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mixtral AI CyberLAW
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Codestral 22B v0.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Ministral 3 14B Reasoning 2512 Uncensored Final
Mistral · ccharnkij
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningTool useVision
MI
Hermes 2 Pro Mistral 7B iMat
Mistral · qwp4w3hyb
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mixtral 8x7B Instruct v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral 7B Holodeck 1
Mistral · KoboldAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo BlackWidow Agony V1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Mistral Ita 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Huihui Ministral 3B Instruct 2512 abliterated
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · second-state
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 14B Reasoning 2512 PlumEsper1.1
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
CodingReasoningTool use
MI
Helcyon Claude Mythic 14b v2.0
Mistral · XeyonAI
Params13.5B
Context256K
Q4_K_M8.2 GB
RoleplayTool use
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · gabriellarson
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Ministral 3 3B Medical Reasoning
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
MI
Dolphin3.0 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingTool use
MI
Infinity Instruct 7M Gen mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3B Heresy Unfiltered
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
MI
Ministral 3 3B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB
GGUF

Keep browsing