Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
OpenMia Indo Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Codestral-25B-pass
Mistral · mradermacher
Params19.1B
Context32K
Q4_K_M11.5 GB
Coding
MI
Devstral Small 2505 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
CodingTool use
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · RichardErkhov
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
MI
nbeerbower Mistral Nemo Gutenberg Doppel 12B v2
Mistral · RichardErkhov
Params12B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Ministral 3B Medical v1
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Tool useVision
MI
mistralai.Mistral 7B v0.1
Mistral · DevQuasar-7
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
airoboros m 7b 3.1.2 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral T5 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
PiVoT-10.7B-Mistral-v0.2
Mistral · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
MaziyarPanahi Mistral 7B Instruct Aya 101
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 4 119B 2603
Mistral · AesSedai
Params119B
Context1024K
Smallest0.1 GB
GGUF
MI
Mistral_7B_Guanaco
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 22B ArliAI RPMax Diluted i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
K2S3 Mistral 7b v1.1
Mistral · mradermacher
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
MI
DPO_mistral_7b_alpaca_0124_v1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mlfoundations dev hp ablations mistral bsz512
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Tess 2.0 Mixtral i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
Openbuddy Mixtral 7bx8 v17.3
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.5 GB
GGUF
MI
mlfoundations dev hp ablations mistral adambeta2 0.99 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral NeMo Minitron Upscale v1
Mistral · mradermacher
Params12.5B
Context8K
Q4_K_M7.5 GB
GGUF
MI
AVA Mistral 7B V2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
LeroyDyer/Mixtral_AI_CyberCoder
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
CleverBoi Mistral 0.3 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Nemo Kurdish Instruct
Mistral · nazimali
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Candle MistralLite
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
MI
sanchit gandhi Mistral 1.5B v0.1
Mistral · RichardErkhov
Params1.57B
Context32K
Q4_K_M1.0 GB
GGUF
MI
Aethora 7b V1 e 1
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing