Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Ministral 3 3B Instruct 2512 Roleplay Tuned ERP Tolerant
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
fpham_karen_theeditor_v2_strict_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenAssisted English Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mahou-1.3d-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
math shepherd mistral 7b prm
Mistral · QuantFactory
Params7.24B
Context4K
Q4_K_M4.4 GB
MI
Mistral 7B compressed i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3 Jbliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral 7B OpenOrca
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.2 24B Instruct 2506 Text Only Heretic v1.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mixtral AI CyberLAW
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Codestral 22B v0.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Ministral 3 14B Reasoning 2512 Uncensored Final
Mistral · ccharnkij
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Hermes 2 Pro Mistral 7B iMat
Mistral · qwp4w3hyb
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral 7B Holodeck 1
Mistral · KoboldAI
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo BlackWidow Agony V1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral Ita 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Huihui Ministral 3B Instruct 2512 abliterated
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · second-state
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 14B Reasoning 2512 PlumEsper1.1
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Helcyon Claude Mythic 14b v2.0
Mistral · XeyonAI
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · gabriellarson
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Ministral 3 3B Medical Reasoning
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Dolphin3.0 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Infinity Instruct 7M Gen mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3B Heresy Unfiltered
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Ministral 3 3B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mistral Nemo Instruct 2407
Mistral · NikolayKozloff
Params12.2B
Context1000K
Smallest13.0 GB