Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Nondzu Mistral 7B codealpaca lora
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Shastra Mistral Math Commonsense TIES
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
DopeorNope Mistralopithecus v0.1 10.8B
Mistral · RichardErkhov
Params10.8B
Context32K
Q4_K_M6.5 GB
MI
magistral-small-2507
Mistral · mistralai
Params23.6B
Context40K
Q4_K_M14.3 GB
MI
cognitivecomputations.Dolphin Mistral 24B Venice Edition
Mistral · DevQuasar
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Teeny Tiny Mixtral
Mistral · mradermacher
Params3.16B
Context32K
Q4_K_M1.9 GB
MI
mistral 7B navigation
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NousResearch Nous Hermes 2 Mixtral 8x7B DPO
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mixtral 4x7B Instruct v0.1
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
LeroyDyer/Mixtral_AI_Cyber_Matrix_2_0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
German RAG MISTRAL 7B v3.0 SFT HESSIAN AI
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
smartyplats 7b v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mindy 7b v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hyperion 2.0 Mistral 7B
Mistral · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Blockrank Msmarco Mistral 7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral NeMo Minitron 8B Chat
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
MI
Mixtral_AI_CyberTron_Ultra
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CapybaraHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Codestral-22B-v0.1-hf
Mistral · gaianet
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
cognitivecomputations dolphin 2.6 mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
LMCocktail Mistral 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 14B Nymphaea RP Heretic
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral epoch2 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.1 24b Instruct 2503 Jackterated Hf
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
mlfoundations dev hp ablations mistral bsz1024
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Mcqa Circuit Broken
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral GQA 400m v4 4096 i1
Mistral · mradermacher
Params2.01B
Context4K
Q4_K_M1.2 GB
MI
Openbuddy Mixtral 7bx8 v18.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.5 GB