Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Hemispheres 7B Left
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3b instruct i1
Mistral · mradermacher
Params3.32B
Context128K
Q4_K_M2.0 GB
GGUF
MI
Mixtral 8x7B MoE RP Story i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Roleplay
MI
Mistral Small 3 Reasoner s1
Mistral · lemonilia
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
sedrickkeh mistral alpaca sft sample
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mini DPO test02 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-AEZAKMI-v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b finetuned orca dpo v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3b instruct
Mistral · tensorblock
Params3.32B
Context128K
Smallest1.3 GB
GGUF
MI
dvilasuero NeuralHermes 2.5 Mistral 7B distilabel
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 3 From Mixtral 8x7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.6 GB
GGUF
MI
vercel doc mistral
Mistral · psin23
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Nemo Prism 12B v7
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
MI
MistralNemoMegaV1_rev
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
HarmBench Mistral 7b val cls i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 24B Enlgish
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · matrixdose
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
MI
Cerebrum-1.0-8x7b
Mistral · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral 7B OpenOrca
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--automerger--T3qM7-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
teknium OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
nbeerbower Mistral Nemo Gutenberg Doppel 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Ernie Image Prompt Enhancer Ministral
Mistral · Green-Sky
Params3.83B
Context256K
Q4_K_M2.4 GB
GGUF
MI
Quattro Formaggi 12B Logistics v0.1
Mistral · MikhailSAI
Params12.2B
Context128K
Smallest10.1 GB
Tool use
MI
Mistral 7b Portuguese V0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
chihoonlee10/T3Q-EN-DPO-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral AI Cyber 5.0 SFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
OpenHermesV2 PTBR portuguese brazil
Mistral · BornSaint
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistral-7b-v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing