Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
TechniqueRAG Reflection Ministral 8B
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
MistralLite 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Cypher Laser Mixtral 2x1.8B v0.1
Mistral · mradermacher
Params3.11B
Context16K
Q4_K_M1.9 GB
MI
laser dolphin mixtral 4x7b dpo i1
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
Nexus IKM Mistral Instruct v0.2 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mamba gpt 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Voxtral Mini 4B Realtime 2602
Mistral · Bercraft
Params4.43B
Context—
Smallest1.5 GB
MI
shleeeee mistral ko OpenOrca Platypus v2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct SLiC HF
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 minlr1e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CollectiveCognition v1 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral_Tv Neural Marconroni
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ANIMA Phi Neptune Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations grid mistral bsz2048 lr2e 6 scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B ProXMath
Mistral · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2 Expanded
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
MI
Snorkel Mistral PairRM DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mrfakename.Mistral Small 3.1 24b Base 2503 Hf
Mistral · DevQuasar-10
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral 7B Parasite
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mini Synatra SFT Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Wayfarer Eris Noctis Mistralified 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
harshitv804 MetaMath Mistral 2x7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral orpo mix i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
vikash06/mistral_v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Prism 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral 7B compressed
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 minlr1e 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Amaretto 3B
Mistral · AmarettoLabs
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
dolphin-2.1-mistral-7b-snr-laser
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB