Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Codestral-RAG-19B-Pruned
Mistral · mradermacher
Params19.1B
Context32K
Q4_K_M11.5 GB
MI
SciPhi Mistral 7B 32k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
DavidAU.Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B
Mistral · DevQuasar-9
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
Mistral 7B Sunda v1.0
Mistral · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Fwizzer R1 3B ZH v2
Mistral · fwizzer1
Params3.43B
Context256K
Smallest2.1 GB
MI
mistralai Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hermes Trismegistus Mistral 7B
Mistral · afrideva
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Punisher Carnage V2
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral 7b Instruct v0.2 Heretic
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Pantheon Rp 1.6 12b Nemo
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
skunkworksai_mistralic-7b-1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MistralThinker v1.1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
kunoichi-lemon-royale-v2-32K-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-llfrpky
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct MCAI SFT DPO revision only i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Large Instruct
Mistral · InferenceIllusionist
Params123B
Context32K
Q4_K_M73.2 GB
MI
Mistral Large 3 675B Instruct 2512 BF16
Mistral · mradermacher
Params673B
Context288K
Q4_K_M405.8 GB
MI
Ape Fiction 2 Mistral Nemo
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
models--mergekit-community--mergekit-slerp-xxzrbzh
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CleverBoi Nemo 12B v2
Mistral · theprint
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Codestral-22B-v0.1-hf
Mistral · second-state
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
mistral nemo bophades3 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
mistral nemo bophades 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
OpenMed SynthVision MedVL AIO
Mistral · prithivMLmods
Params3.43B
Context256K
Smallest2.0 GB
MI
Ministral 3 8B Instruct 2512
Mistral · ggml-org
Params8.49B
Context256K
Smallest9.0 GB
MI
Mistral Small 24B Instruct 2501
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
test help steer filtered orig Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Candle Mistral Trismegistus 7B
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
MI
NousResearch/Nous-Hermes-2-Mistral-7B-DPO
Mistral · DevQuasar-12
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Tiamat 24B Magistral PaperWitch Heresy
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB