Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mahou 1.5 mistral nemo 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Ministral 3 8B Reasoning 2512 Absolute Heresy
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
OpenHermes 2.5 AshhLimaRP Mistral 7B
Mistral · Herman555
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Locutusque.deeplm mistral v0.1 8B stage1
Mistral · DevQuasar
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Nemo Punisher Carnage V1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Mistral Small NovusKyver
Mistral · Quant-Cartel
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
MI
Tess 2.0 Mixtral v0.2
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · gaianet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MyAlee-Mistral-Instruct-v2-32k-v3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b v0.2 layla v4 GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral7B Bartending Recipe v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b v0.1 layla v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistralv0.2 StarlingLM FrankenMaid 10.5B
Mistral · mradermacher
Params10.5B
Context32K
Q4_K_M6.5 GB
GGUF
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · kryp1234
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
Speechless Thoughts Mistral 7b v1.0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral-4x1.1B-TinyDolphin-2.8-1.1b_oasst2_chatML_Cluster
Mistral · RichardErkhov
Params3.38B
Context4K
Q4_K_M2.0 GB
GGUF
MI
VAGOsolutions SauerkrautLM Mixtral 8x7B Instruct
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral 7B SFT Only
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 24BContinued
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Undi95 Mistral PetroLimaRP v3 12B
Mistral · RichardErkhov
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
MI
mistralai Mathstral 7B v0.1
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · Artefact2
Params46.7B
Context32K
Smallest12.3 GB
GGUF
MI
MN Helcyon Mythic 12b v1.0
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Karen TheEditor V2 CREATIVE Mistral 7B absolute heresy
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mini Mistral 1.0
Mistral · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
Mixtral-8x7B-MoE-RP-Story
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
Roleplay
MI
DrNicefellow/Mistral-8-from-Mixtral-8x7B-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.6 GB
GGUF
MI
K2S3 Mistral 7b v1.3
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF

Keep browsing