Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Nemo 12B CY
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · mradermacher
Params16.4B
Context32K
Q4_K_M9.9 GB
Tool use
MI
Ministral 3 14B Reasoning 2512 Uncensored
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningTool useVision
MI
Elysia Trismegistus Mistral 7B v02
Mistral · HagalazAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Shisa v2 Mistral Small 24b
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Denker Mistral Nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
CodingReasoningTool use
MI
Young-Children-Storyteller-Mistral-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Devstral-Small-2505
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
MI
Mistral Nemo Gutenberg Vitus 12B
Mistral · duyntnet
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
Roleplay No System
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
mixtral megamerge dare 8x7b v2
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
chargoddard_mixtralnt-4x7b-test
Mistral · TheBloke
Params24.2B
Context32K
Q4_K_M13.6 GB
GGUF
MI
Genstruct
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OGSQL Mistral7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
shisa-v2-mistral-nemo-12b
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
NeuralHermes 2.5 Mistral 7B laser imatrix
Mistral · Bakanayatsu
Params7.24B
Context32K
Smallest2.0 GB
Tool use
MI
Mistral Small 24B Instruct Jbliterated
Mistral · ApolloRaines
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Ministral 3 8B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
CodingReasoningTool use
MI
Mistral v0.3 7B ORPO
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
japanese mistral 300m base
Mistral · afrideva
Params355M
Context4K
Q4_K_M0.2 GB
GGUF
MI
Hermes 2 Pro Mistral 10.7B
Mistral · bartowski
Params10.7B
Context32K
Q4_K_M6.5 GB
Tool use
MI
Magistral Small 2506 Abliterated
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
MI
OpenHermes 2.5 Strix Philosophy Mistral 7B LoRA i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B v0.3 OBLITERATED
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral v0.3 7B ORPO
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407 13B
Mistral · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
mistral 7b medical assistance
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Nous Hermes 2 Mixtral 8x7B DPO iMat
Mistral · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
Ministral 3 3B Reasoning 2512 Absolute Heresy
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision

Keep browsing