Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B Instruct v0.1
Mistral · DhruvalLabs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin 2.6 Mistral 7b Dpo Chat
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Hermes 2 Pro Mixtral 4x7B i1
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
Tool use
MI
Mistral Nemo Base 2407 Uncensored
Mistral · AlSamCur123
Params12.2B
Context128K
Smallest7.1 GB
GGUF
MI
InnerILLM OpenPipe Nous Yarn Mistral optimized 1228 7B slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7b Arc
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Prism 12B v2 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
self-reflect_ministral8Bit_mg_star-dpo_2ep
Mistral · RichardErkhov
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Synatra 7B Instruct v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 14B Abliterated Aggressive
Mistral · jenerallee78
Params13.5B
Context256K
Smallest14.4 GB
Tool useVision
MI
Delcos airoboros mistral2.2 Starling 11b
Mistral · RichardErkhov
Params11.4B
Context32K
Q4_K_M6.8 GB
GGUF
MI
Speechless Mistral Hermes Code 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Mistral NeuralDPO v0.4
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
models--mergekit-community--mergekit-slerp-ijnxdha
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
PiVoT 0.1 early Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
FoxyzGPT 1.1 7B
Mistral · Flexan
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mahou 1.5 Mistral Nemo 12B
Mistral · mradermacher
Params10.1B
Context1000K
Q4_K_M6.2 GB
GGUF
MI
ChatHercules 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Komt Mistral 7b v1 Dpo Osy v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
TechniqueRAG FS Ministral 8B
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
NousResearch Genstruct 7B only
Mistral · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.2 Hf
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 10.7B v0.2
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
Mistral Small R1 Tensopolis
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
Elysia Trismegistus Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hemispheres 7B Combiner
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
jackalope 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral_7Bx2_MoE
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Mistral Large Instruct 2407
Mistral · gaianet
Params123B
Context128K
Q4_K_M73.2 GB
GGUF

Keep browsing