Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Genshin_Impact_Mistral_v3_Plot_Chat_roleplay_chat_merged
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 8B Reasoning 2512 Uncensored
Mistral · ccharnkij
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Speechless Mistral Hermes Code 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Distilabeled Hermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Conversely Mistral 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral_Nemo_Instruct_2407
Mistral · pbhappliedsystems
Params12.2B
Context128K
Smallest8.7 GB
MI
yjwon mp mistral7b sft1 b512 lr5e 6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MAmmoTH-7B-Mistral-MFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
BFS Search mistral multi rel I2B2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Samantha PL AG Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephyr 7b alpha imatrix
Mistral · liodon-ai
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistralai/Mistral-Nemo-Instruct-2407
Mistral · featherless-ai-quants
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
mlfoundations dev mistral alpaca sft sample 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 24B Instruct 2501 Continued
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
models--mergekit-community--mergekit-slerp-sictdhe
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dcug pdf mixtral nemo base 12b
Mistral · Bingdo
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Nemo InstructContinuedFine
Mistral · AlSamCur123
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
ministral uncensored
Mistral · virtuehearts
Params3.43B
Context32K
Q4_K_M2.1 GB
MI
Vivacem/Mistral-7B-MMIQC
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 7Bx2 truthy i1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Magistral Small 2506
Mistral · mistralai
Params23.6B
Context40K
Smallest25.1 GB
MI
ministral Ministral 3b instruct
Mistral · RichardErkhov
Params3.32B
Context128K
Q4_K_M2.0 GB
MI
Mixtral AI Cyber Matrix 2 0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Codestral 22B v0.1
Mistral · DevQuasar-4
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Oh Mistral bs4096_lr5_00E 06_schedulerconstant_warmup1_00E 01_minlr
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Candle tiny mistral
Mistral · DanielClough
Params214M
Context—
Smallest0.1 GB
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mixtral_7Bx4_MOE_24B
Mistral · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
mistralai.Magistral Small 2509
Mistral · DevQuasar
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
OpenHermes 7B Symbolic Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB