Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
CleverBoi Mistral 0.3 7B
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Pixtral
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
MI
Mistral Small 3.1 24B Base 2503 SFT
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
RAG KO Mixtral 7Bx2 v2.0
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Mistral Small 24B ArliAI RPMax v1.4
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Ministral 3 3B Reasoning 2512
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
MI
Devstral Small 2507 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
CodingTool use
MI
Cyber Dolphin 2.9.3 Mistral Nemo 12b Reason
Mistral · HagalazAI
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Playwright v1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Devstral 2505 CODER Brainstorm20x 34B
Mistral · mradermacher
Params34.1B
Context128K
Q4_K_M20.7 GB
CodingTool use
MI
Mahou-1.3c-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B Yes Instruct LimaRP
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Ministral 3 14B Base 2512
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
GGUF
MI
dolphin-2.9.3-mistral-7B-32k
Mistral · huggingkot
Params7.25B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Ministral 3 8B Reasoning 2512 It
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
Mistral-7B-Instruct-v0.3
Mistral · jfer1015
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Docsgpt 7b Mistral
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mamba Codestral 7B v0.1
Mistral · viniciusianni
Params7.29B
Context1024K
Q4_K_M4.1 GB
Coding
MI
Mahou-1.3d-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral small 24b
Mistral · cortexso
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Dolphin Mistral 24B Venice Edition
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M12.4 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
mistral 24b ru uncensored
Mistral · aiplatforms
Params23.6B
Context32K
Smallest13.4 GB
Roleplay
MI
MetaMath Tulpar 7b v2 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral_12B_Sft_Roleplay
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
MI
Ministral 3 8B Base 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
MI
Mistralai Devstral Small 2 24B Instruct 2512
Mistral · sigmanih
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingTool use
MI
Mixtral_7Bx4_MOE_24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
Mistral-7B-OpenOrca
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small Gutenberg Doppel 22B
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use

Keep browsing