Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
cloudyu Mixtral 7Bx2 MoE 13B
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Mistral Small 22B ArliAI RPMax Diluted
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
arnavgrg mistral 7b nf4 fp16 upscaled
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · ArliAI
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Dans 07YahooAnswers 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Gutenberg Encore 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Candle Mistral Pro 8B v0.1
Mistral · DanielClough
Params8.99B
Context—
Smallest2.9 GB
MI
Hemispheres 7B Final
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B v0.1
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral_Pro_8B_v0.1
Mistral · RichardErkhov
Params8.99B
Context32K
Q4_K_M5.4 GB
MI
WizardMath 7B V1.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.3 3MPER0RR Abliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral adambeta1 0.85 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations grid mistral bsz512 lr2e 6 scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Cybertron Starling Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Base 2407 RP Merge
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
c64 ministral 3 8b thinking c64 reasoning
Mistral · ibitato
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
zephyr 7b alpha sharded Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mathstral-7B-v0.1
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
MI
Mixtral 8x7B v0.1 instruct l2 norm post SFT pruned 4 experts
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 minlr5e 7 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 8B Reasoning 2512 DASHQ Q2
Mistral · jkim96
Params8.49B
Context256K
Smallest2.6 GB
MI
neural chat 7b v3 1
Mistral · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
pic 7B mistral Full v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral epoch5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral grok instract 2 7B slerp
Mistral · Ziaxer
Params7.24B
Context32K
Smallest7.7 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 minlr1e 6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral scheduler constant
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB