Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · bartowski
Params22.2B
Context64K
Q4_K_M13.3 GB
MI
Ministral 3 8B Instruct 2512 PaperWitch Heresy
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Trinity 2 Codestral 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Dolphin Mistral 24B Venice Fp16
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Ministral 3 14B Reasoning 2512 PlumEsper1.1
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Mistral 7B Merge 14 v0.1
Mistral · LiteLLMs
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral-8x22B-v0.1
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
MI
M1NDB0T 0M3G4 23B Mistral Small 2504
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Huihui Ministral 3 14B Reasoning 2512 Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Mistral-7B-Instruct-v0.1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.1 24B Instruct 2503 HF
Mistral · mmnga
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
speechless-instruct-mistral-7b-v0.2
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral Small 2509 Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
dolphin 2.6 mistral 7b
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Clinical BR Mistral 7B v0.2
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openbuddy zephyr 7b v14.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Voxtral-Mini-4B-Realtime-2602
Mistral · andrijdavid
Params4.43B
Context—
Q4_K_M2.9 GB
MI
speechlessai_speechless-mistral-7b-dare-0.85
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 8B Instruct 2512
Mistral · EnlistedGhost
Params8.49B
Context256K
Smallest3.9 GB
MI
Huihui Ai Mistral Small 24B Instruct 2501 Abliterated
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
MI
mistralai.Mistral Small 4 119B 2603 BF16
Mistral · DevQuasar
Params119B
Context1024K
Q4_K_M72.2 GB
MI
Mistral Nemo Instruct 2407 Heretic v2
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral Nemo Punisher Carnage V1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Ektome Mistral 7B Instruct v0.2 PristinelyUncensored
Mistral · Zynerji
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral Small 2509 Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Elysia Trismegistus Mistral 7B
Mistral · HagalazAI
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B claude instruct Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Fireball Mistral Nemo Instruct 24B merge v1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
General-Stories-Mistral-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
undi95_mistral-claudelimarp-v3-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB