Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
EDIATH Q4 K M
Mistral · user052
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
klcsp mistral 7b 0.3 gpt4o 100k classification fft
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hermes2 Gutenberg2 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mixtral Instruct i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 Reasoning 2512 AIO
Mistral · prithivMLmods
Params13.5B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
MI
Mistral Nemo Instruct 12B Philosophy Math
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
mistral-7B-test-v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nexus IKM Mistral 7B
Mistral · Severian
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 minlr5e 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mini synatra 7b 03 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1 Sculpt Balanced
Mistral · mradermacher
Params5.58B
Context32K
Q4_K_M3.6 GB
GGUF
MI
dolphin 2.1 mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Kurdish Instruct i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Mistral Gutenberg Doppel 7B FFT i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1 upscaled i1
Mistral · mradermacher
Params81.5B
Context32K
Smallest16.7 GB
GGUF
MI
dolphin-2.6-mistral-7b-dpo-orca-v2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
HanningZhang Mistral MetaMath 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Velara Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.3 Heretic
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
RAG KO Mixtral 7Bx2 v2.1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Blossom V3_1 Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral AI Vision 128k 7b
Mistral · LeroyDyer
Params7.24B
Context128K
Smallest7.7 GB
CodingVision
MI
Mistral Nemo Prism 12B v4
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1
Mistral · Lucy-in-the-Sky
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Magistral Small 2506
Mistral · Mungert
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
OpenMath Mistral 7B v0.1 hf
Mistral · nold
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Infinity Instruct 3M 0625 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mixtral 4x3B v1
Mistral · mradermacher
Params10.4B
Context32K
Q4_K_M6.3 GB
Tool use
MI
Ministral 3 14B DeLERP LimaRP
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool use

Keep browsing