Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
CodeActAgent Mistral 7b v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Azure99 Blossom v4 Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Mistral Small 3.2 46B The Brilliant Raconteur Instruct 2506
Mistral · mradermacher
Params45.2B
Context128K
Q4_K_M27.4 GB
ReasoningRoleplayVision
MI
arshadshk Mistral Hinglish 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Cerebrum-1.0-8x7b
Mistral · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mixtral GQA 400m v2
Mistral · afrideva
Params2.01B
Context4K
Q4_K_M1.2 GB
GGUF
MI
ANIMA Nectar v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 neural chat v3 3 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Speechless Mistral Moloras 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2 expanded sec 1.6B tokens
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
MI
mistralai Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7b Dpo Merge v1.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · merterbak
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
shleeeee mistral ko exo wiki quiz v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hercules 3.0 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Writing_Partner_Mistral_7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 4 119B 2603
Mistral · noctrex
Params119B
Context1024K
Smallest67.7 GB
Tool useVision
MI
Locutusque/Hyperion-2.1-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistralai.Mixtral 8x22B v0.1
Mistral · DevQuasar-4
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
MI
Mistralai Mistral 7B Instruct v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
RESMPDEV Wukong 0.1 Mistral 7B v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
mistral nemo kartoffel PRUNE3
Mistral · mradermacher
Params8.43B
Context1000K
Q4_K_M5.2 GB
GGUF
MI
mistralopithecus-v3-dpo-7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
laser dolphin mixtral 2x7b dpo i1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
mistralopithecus v1 dpo 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
ChatHercules 2.5 Mistral 7B
Mistral · nold
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral epoch3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
unsloth/Mistral-Nemo-Base-2407
Mistral · featherless-ai-quants
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Small 3.2 24B Instruct 2506 Text Only Heretic v1.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Marcoroni neural chat 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing