Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
ministral 3 14b reasoning 2512 gguf Q4 K M
Mistral · pbhappliedsystems
Params13.5B
Context256K
Smallest8.2 GB
MI
mlfoundations dev hp ablations mistral scheduler linear warmup0.05
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Base SFT RDPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
avemio digital mistral 7b Sft orpo 3000 steps merge
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Atlas 2.1 Small
Mistral · AeroAIAviation
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
LeoScorpius 7B Chat DPO Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7b v0.1 Layla v4
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3_2 24B Instruct 2506 Antislop
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Linkbricks Horizon AI Korean Mistral Nemo sft dpo 12B
Mistral · Saxo
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
dolphin-2.6-mistral-7b-dpo-orca
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Elysia Trismegistus Mistral 7B v02
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
hydra project ChatHercules 2.5 Mistral 7B
Mistral · RichardErkhov
Params470M
Context—
Q4_K_M0.3 GB
MI
Mistral 7B Base SFT RRHF
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
QI mistral 7B slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MN Helcyon 4o 12b v4.0
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Multilingual mistral
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral Large 3 675B Instruct 2512 i1
Mistral · mradermacher
Params673B
Context288K
Smallest0.6 GB
MI
mistral nemo cc 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
mlfoundations dev mistral alpaca sft sample 4
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3b instruct uncensoredContinuedFine
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
speechless-mistral-7b-dare-0.85
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
shisa base 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
abhishek autotrain mixtral7x8b math
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
MetaMath Mistral 2x7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.2 Ko Y24_v2.0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
rana shahroz mistral openorca openplatypus
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MistralSmall Creative 24B Realist i1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
MelloGPT Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB