Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · bartowski
Params22.2B
Context64K
Q4_K_M13.3 GB
CodingTool use
MI
Ministral 3 8B Instruct 2512 PaperWitch Heresy
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Tool use
MI
Trinity 2 Codestral 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Dolphin Mistral 24B Venice Fp16
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Ministral 3 14B Reasoning 2512 PlumEsper1.1
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
CodingReasoningTool use
MI
Mistral 7B Merge 14 v0.1
Mistral · LiteLLMs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral-8x22B-v0.1
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
MI
M1NDB0T 0M3G4 23B Mistral Small 2504
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Huihui Ministral 3 14B Reasoning 2512 Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningTool use
MI
Mistral-7B-Instruct-v0.1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503 HF
Mistral · mmnga
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
speechless-instruct-mistral-7b-v0.2
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Magistral Small 2509 Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool useVision
MI
dolphin 2.6 mistral 7b
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Clinical BR Mistral 7B v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openbuddy zephyr 7b v14.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · andrijdavid
Params4.43B
Context—
Q4_K_M2.9 GB
GGUF
MI
speechlessai_speechless-mistral-7b-dare-0.85
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Instruct 2512
Mistral · EnlistedGhost
Params8.49B
Context256K
Smallest3.9 GB
Vision
MI
Huihui Ai Mistral Small 24B Instruct 2501 Abliterated
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
GGUF
MI
mistralai.Mistral Small 4 119B 2603 BF16
Mistral · DevQuasar
Params119B
Context1024K
Q4_K_M72.2 GB
Tool use
MI
Mistral Nemo Instruct 2407 Heretic v2
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Mistral Nemo Punisher Carnage V1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Ektome Mistral 7B Instruct v0.2 PristinelyUncensored
Mistral · Zynerji
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral Small 2509 Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool useVision
MI
Elysia Trismegistus Mistral 7B
Mistral · HagalazAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B claude instruct Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Fireball Mistral Nemo Instruct 24B merge v1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
General-Stories-Mistral-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
undi95_mistral-claudelimarp-v3-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing