Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
OpenMia Indo Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Codestral-25B-pass
Mistral · mradermacher
Params19.1B
Context32K
Q4_K_M11.5 GB
MI
Devstral Small 2505 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · RichardErkhov
Params22.2B
Context64K
Q4_K_M13.3 GB
MI
nbeerbower Mistral Nemo Gutenberg Doppel 12B v2
Mistral · RichardErkhov
Params12B
Context1000K
Q4_K_M7.5 GB
MI
Ministral 3B Medical v1
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
mistralai.Mistral 7B v0.1
Mistral · DevQuasar-7
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
airoboros m 7b 3.1.2 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral T5 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
PiVoT-10.7B-Mistral-v0.2
Mistral · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
MaziyarPanahi Mistral 7B Instruct Aya 101
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 4 119B 2603
Mistral · AesSedai
Params119B
Context1024K
Smallest0.1 GB
MI
Mistral_7B_Guanaco
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 22B ArliAI RPMax Diluted i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
K2S3 Mistral 7b v1.1
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
MI
DPO_mistral_7b_alpaca_0124_v1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral bsz512
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Tess 2.0 Mixtral i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
Openbuddy Mixtral 7bx8 v17.3
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.5 GB
MI
mlfoundations dev hp ablations mistral adambeta2 0.99 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral NeMo Minitron Upscale v1
Mistral · mradermacher
Params12.5B
Context8K
Q4_K_M7.5 GB
MI
AVA Mistral 7B V2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
LeroyDyer/Mixtral_AI_CyberCoder
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CleverBoi Mistral 0.3 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Kurdish Instruct
Mistral · nazimali
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Candle MistralLite
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
MI
sanchit gandhi Mistral 1.5B v0.1
Mistral · RichardErkhov
Params1.57B
Context32K
Q4_K_M1.0 GB
MI
Aethora 7b V1 e 1
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB