Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
ToxicHermes 2.5 Mistral 7B
Mistral · tsunemoto
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Crab SFT
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
BagelMIsteryTour 8x7B
Mistral · ycros
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
bellman mistral 7b instruct v0.3 i1
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
bellman
Mistral · neph1
Params7.24B
Context32K
Smallest5.1 GB
GGUF
MI
Walter Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
saiga mistral 7b
Mistral · IlyaGusev
Params7.24B
Context32K
Smallest3.1 GB
GGUF
MI
TowerInstruct Mistral 7B v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NyakuraV2.1 m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Devstral Small 2507 Rebased Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool useVision
MI
Speechless Mistral Dolphin Orca Platypus Samantha 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
AlexeyRyzhikov mistral7b text to json v4.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DPO_mistral_v01_7b_ultra_0130_1k
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral AI MasterMind II
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Candle Snorkel Mistral PairRM DPO
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
MI
EulerMath Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b beta
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CollectiveCognition v1.1 Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 12.25B Instruct v0.2
Mistral · mradermacher
Params12.5B
Context32K
Q4_K_M7.7 GB
GGUF
MI
dolphin 2.0 mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Helcyon Solara 14b v1.0
Mistral · XeyonAI
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningRoleplayTool use
MI
Mistral 7B Instruct v0.3 Parasite
Mistral · ApolloRaines
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Karen_TheEditor_V2_STRICT_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · Alohadance1
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
mistral nemo gutenberg 12B v3 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
NeuralHermes 2.5 Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Locutusque Hyperion 1.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ferret 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing