Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Locutusque Hyperion 2.1 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 minlr1e 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
blossom v4 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral lr2e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · muranAI
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Mistral Nemo Batman Venom V8
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
openchat 3.5 0106
Mistral · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
mistral_28B
Mistral · mradermacher
Params28.2B
Context32K
Q4_K_M16.9 GB
GGUF
MI
lmlab-mistral-1b-untrained
Mistral · RichardErkhov
Params1.13B
Context32K
Q4_K_M0.7 GB
GGUF
MI
Ferret 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral adambeta2 0.95 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct KTO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Tess 2.0 Mixtral 8x7B
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-rzooeoj
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
OpenHermes Mixtral 8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
RAG KO Mixtral 7Bx2 v1.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
martyn mixtral megamerge dare 8x7b v2
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M9.4 GB
GGUF
MI
Einstein v5 v0.2 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
OpenMia Indo Mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Chinese Mixtral 8x7B
Mistral · mradermacher
Params46.9B
Context32K
Q4_K_M28.6 GB
GGUF
MI
Relay v0.1 Mistral Nemo 2407
Mistral · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
GGUF
MI
MetaMath OpenHermes 2.5 neural chat v3 3 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Danish Mistral Nemo Base
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral_Tv Neural Marconroni
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral nemo gutenberg3 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
notus 7b v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Base SFT DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral adambeta2 0.98 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
mistral 7b v0.1 layla v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing