Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mahou 1.5 mistral nemo 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Ministral 3 8B Reasoning 2512 Absolute Heresy
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
OpenHermes 2.5 AshhLimaRP Mistral 7B
Mistral · Herman555
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Locutusque.deeplm mistral v0.1 8B stage1
Mistral · DevQuasar
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Punisher Carnage V1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral Small NovusKyver
Mistral · Quant-Cartel
Params22.2B
Context128K
Q4_K_M13.3 GB
MI
Tess 2.0 Mixtral v0.2
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · gaianet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MyAlee-Mistral-Instruct-v2-32k-v3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b v0.2 layla v4 GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral7B Bartending Recipe v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b v0.1 layla v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistralv0.2 StarlingLM FrankenMaid 10.5B
Mistral · mradermacher
Params10.5B
Context32K
Q4_K_M6.5 GB
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · kryp1234
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Speechless Thoughts Mistral 7b v1.0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral-4x1.1B-TinyDolphin-2.8-1.1b_oasst2_chatML_Cluster
Mistral · RichardErkhov
Params3.38B
Context4K
Q4_K_M2.0 GB
MI
VAGOsolutions SauerkrautLM Mixtral 8x7B Instruct
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral 7B SFT Only
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral 24BContinued
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Undi95 Mistral PetroLimaRP v3 12B
Mistral · RichardErkhov
Params11.2B
Context32K
Q4_K_M6.7 GB
MI
mistralai Mathstral 7B v0.1
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · Artefact2
Params46.7B
Context32K
Smallest12.3 GB
MI
MN Helcyon Mythic 12b v1.0
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Karen TheEditor V2 CREATIVE Mistral 7B absolute heresy
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mini Mistral 1.0
Mistral · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
Mixtral-8x7B-MoE-RP-Story
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
DrNicefellow/Mistral-8-from-Mixtral-8x7B-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.6 GB
MI
K2S3 Mistral 7b v1.3
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB