Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
ministral 3 14b reasoning 2512 gguf Q4 K M
Mistral · pbhappliedsystems
Params13.5B
Context256K
Smallest8.2 GB
ReasoningTool use
MI
mlfoundations dev hp ablations mistral scheduler linear warmup0.05
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Base SFT RDPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
avemio digital mistral 7b Sft orpo 3000 steps merge
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Atlas 2.1 Small
Mistral · AeroAIAviation
Params3.43B
Context256K
Q4_K_M2.1 GB
Tool useVision
MI
LeoScorpius 7B Chat DPO Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7b v0.1 Layla v4
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3_2 24B Instruct 2506 Antislop
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Linkbricks Horizon AI Korean Mistral Nemo sft dpo 12B
Mistral · Saxo
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
dolphin-2.6-mistral-7b-dpo-orca
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Elysia Trismegistus Mistral 7B v02
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
hydra project ChatHercules 2.5 Mistral 7B
Mistral · RichardErkhov
Params470M
Context—
Q4_K_M0.3 GB
GGUF
MI
Mistral 7B Base SFT RRHF
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
QI mistral 7B slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MN Helcyon 4o 12b v4.0
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MI
Multilingual mistral
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral Large 3 675B Instruct 2512 i1
Mistral · mradermacher
Params673B
Context288K
Smallest0.6 GB
GGUF
MI
mistral nemo cc 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
mlfoundations dev mistral alpaca sft sample 4
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3b instruct uncensoredContinuedFine
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
speechless-mistral-7b-dare-0.85
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
shisa base 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
abhishek autotrain mixtral7x8b math
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
MetaMath Mistral 2x7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.2 Ko Y24_v2.0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
rana shahroz mistral openorca openplatypus
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MistralSmall Creative 24B Realist i1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
MelloGPT Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing