Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral v0.1 Italian CLP
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
nbeerbower Stella mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Helcyon Mercury 12b v3.2
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Voxtral Mini 4B Realtime 2602
Mistral · mradermacher
Params3.43B
Context128K
Q4_K_M2.2 GB
Vision
MI
Nebula v2 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Base 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Ministral 3 14B Reasoning 2512 ShiningValiant3
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
CodingReasoningTool use
MI
mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 14B Janus Abliterated V2
Mistral · SOMEHOTMEAL
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool useVision
MI
Malaysian Mistral Small 3.1 24B Instruct 2503
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
nbeerbower mistral nemo wissenschaft 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Ae Calem Mistral 7b v0.1
Mistral · RichardErkhov
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407 Heretic v2
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Vezora Mistral 22B v0.2
Mistral · RichardErkhov
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
MI
go bruins v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Large Instruct 2407
Mistral · mradermacher
Params123B
Context32K
Smallest26.0 GB
GGUF
MI
Noromaid v0.1 mixtral 8x7b Instruct v3 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mahou 1.5 mistral nemo 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
OpenHermes 2.5 neural chat 7b v3 1 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
MN Helcyon Mercury 12b v3.0
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Mistral Nemo Gutenberg Vitus 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
uukuguy_collectivecognition-v1.1-mistral-7b-dare-0.85
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
japanese stablelm instruct gamma 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
WikiHow Mistral Instruct 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.3 v2
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
tosilos 24b 2512 opsB
Mistral · nesilabs
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
MI
Mistral 7B Instruct v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.6 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
ministral 3 14b instruct 2512 gguf Q8 0
Mistral · pbhappliedsystems
Params13.5B
Context256K
Smallest14.4 GB
Tool use
MI
mistralai_Devstral 2 123B Instruct 2512
Mistral · lmstudio-community
Params125B
Context256K
Q4_K_M74.9 GB
CodingTool use

Keep browsing