Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
VeriPrefer Mistral 7B v0.2
Mistral · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · qwp4w3hyb
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Tiamat 24B Magistral
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningRoleplayTool use
MI
Mistral Small 3.1 24B Instruct 2503 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
GGUF
MI
mistral 7b v0.1 layla v4 GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Mistral 7B Instruct v0.1 Full Final
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B claude instruct i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · QuantFactory
Params22.2B
Context128K
Q4_K_M13.3 GB
Tool use
MI
Ministral 3 14B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
CodingReasoningTool use
MI
shisa-v2-mistral-nemo-12b
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Mistral Small 3.2 24B Instruct 2506 Heretic v1.2 2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral 7B Instruct v0.2 sliced 24 layer i1
Mistral · mradermacher
Params5.5B
Context32K
Q4_K_M3.3 GB
GGUF
MI
Ministral 3 3B Base 2512
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
MI
RenCoder Ministral 3 8B Instruct 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
CodingTool use
MI
Liberalis Cogitator Mistral 3 8B
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
GGUF
MI
mixtral
Mistral · hfl
Params46.7B
Context32K
Smallest9.5 GB
GGUF
MI
Bigstral 12b 32k
Mistral · QuantFactory
Params12.5B
Context32K
Q4_K_M7.5 GB
GGUF
MI
Hercules 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Tess 3 Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
MI
Ministral 3 3B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Tool use
MI
Ministral 3 3B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
CodingReasoningTool use
MI
mistral nemo gutenberg 12B v4
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Mistral Nemo Japanese Instruct 2408
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool useVision
MI
Karasu-Mixtral-8x22B-v0.1
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
GGUF
MI
models--automerger--YamshadowT3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
fpham_free_sydney_v2_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
speechless code mistral 7b v1.0 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mixtral 34Bx2 MoE 60B i1
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
MI
Mistral v0.3 6B i1
Mistral · mradermacher
Params5.94B
Context32K
Q4_K_M3.6 GB
GGUF

Keep browsing