Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
VeriPrefer Mistral 7B v0.2
Mistral · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
Mistral Nemo Instruct 2407
Mistral · qwp4w3hyb
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Tiamat 24B Magistral
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Small 3.1 24B Instruct 2503 DASHQ Q2
Mistral · jkim96
Params23.6B
Context128K
Smallest6.8 GB
MI
mistral 7b v0.1 layla v4 GGUF IQ Imatrix
Mistral · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.1 Full Final
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B claude instruct i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small Instruct 2409
Mistral · QuantFactory
Params22.2B
Context128K
Q4_K_M13.3 GB
MI
Ministral 3 14B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
shisa-v2-mistral-nemo-12b
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral Small 3.2 24B Instruct 2506 Heretic v1.2 2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral 7B Instruct v0.2 sliced 24 layer i1
Mistral · mradermacher
Params5.5B
Context32K
Q4_K_M3.3 GB
MI
Ministral 3 3B Base 2512
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
RenCoder Ministral 3 8B Instruct 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Liberalis Cogitator Mistral 3 8B
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
mixtral
Mistral · hfl
Params46.7B
Context32K
Smallest9.5 GB
MI
Bigstral 12b 32k
Mistral · QuantFactory
Params12.5B
Context32K
Q4_K_M7.5 GB
MI
Hercules 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Tess 3 Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
MI
Ministral 3 3B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Ministral 3 3B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
mistral nemo gutenberg 12B v4
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Nemo Japanese Instruct 2408
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Karasu-Mixtral-8x22B-v0.1
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
MI
models--automerger--YamshadowT3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
fpham_free_sydney_v2_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
speechless code mistral 7b v1.0 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 34Bx2 MoE 60B i1
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
MI
Mistral v0.3 6B i1
Mistral · mradermacher
Params5.94B
Context32K
Q4_K_M3.6 GB