Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
TechniqueRAG Reflection Ministral 8B
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
MistralLite 7B
Mistral · second-state
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Cypher Laser Mixtral 2x1.8B v0.1
Mistral · mradermacher
Params3.11B
Context16K
Q4_K_M1.9 GB
GGUF
MI
laser dolphin mixtral 4x7b dpo i1
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
Nexus IKM Mistral Instruct v0.2 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mamba gpt 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Voxtral Mini 4B Realtime 2602
Mistral · Bercraft
Params4.43B
Context—
Smallest1.5 GB
GGUF
MI
shleeeee mistral ko OpenOrca Platypus v2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct SLiC HF
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 minlr1e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CollectiveCognition v1 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral_Tv Neural Marconroni
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
ANIMA Phi Neptune Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations grid mistral bsz2048 lr2e 6 scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B ProXMath
Mistral · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2 Expanded
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
MI
Snorkel Mistral PairRM DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mrfakename.Mistral Small 3.1 24b Base 2503 Hf
Mistral · DevQuasar-10
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral 7B Parasite
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mini Synatra SFT Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Wayfarer Eris Noctis Mistralified 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
harshitv804 MetaMath Mistral 2x7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral orpo mix i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
vikash06/mistral_v1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Prism 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral 7B compressed
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 minlr1e 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Amaretto 3B
Mistral · AmarettoLabs
Params3.43B
Context256K
Q4_K_M2.1 GB
Tool use
MI
dolphin-2.1-mistral-7b-snr-laser
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing