Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
cloudyu Mixtral 7Bx2 MoE 13B
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Mistral Small 22B ArliAI RPMax Diluted
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
arnavgrg mistral 7b nf4 fp16 upscaled
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · ArliAI
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
Dans 07YahooAnswers 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Gutenberg Encore 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Candle Mistral Pro 8B v0.1
Mistral · DanielClough
Params8.99B
Context—
Smallest2.9 GB
GGUF
MI
Hemispheres 7B Final
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B v0.1
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral_Pro_8B_v0.1
Mistral · RichardErkhov
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
MI
WizardMath 7B V1.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.3 3MPER0RR Abliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mlfoundations dev hp ablations mistral adambeta1 0.85 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations grid mistral bsz512 lr2e 6 scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MetaMath Cybertron Starling Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Base 2407 RP Merge
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MI
c64 ministral 3 8b thinking c64 reasoning
Mistral · ibitato
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool use
MI
zephyr 7b alpha sharded Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mathstral-7B-v0.1
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
GGUF
MI
Mistral NeMo Minitron 8B Base
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
MI
Mixtral 8x7B v0.1 instruct l2 norm post SFT pruned 4 experts
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 minlr5e 7 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Reasoning 2512 DASHQ Q2
Mistral · jkim96
Params8.49B
Context256K
Smallest2.6 GB
ReasoningTool use
MI
neural chat 7b v3 1
Mistral · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
pic 7B mistral Full v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mlfoundations dev hp ablations mistral epoch5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral grok instract 2 7B slerp
Mistral · Ziaxer
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 minlr1e 6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler constant
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing