Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Genshin_Impact_Mistral_v3_Plot_Chat_roleplay_chat_merged
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Ministral 3 8B Reasoning 2512 Uncensored
Mistral · ccharnkij
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
Speechless Mistral Hermes Code 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Distilabeled Hermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Conversely Mistral 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral_Nemo_Instruct_2407
Mistral · pbhappliedsystems
Params12.2B
Context128K
Smallest8.7 GB
Tool use
MI
yjwon mp mistral7b sft1 b512 lr5e 6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MAmmoTH-7B-Mistral-MFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
BFS Search mistral multi rel I2B2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Samantha PL AG Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b alpha imatrix
Mistral · liodon-ai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistralai/Mistral-Nemo-Instruct-2407
Mistral · featherless-ai-quants
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
mlfoundations dev mistral alpaca sft sample 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 24B Instruct 2501 Continued
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-sictdhe
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
dcug pdf mixtral nemo base 12b
Mistral · Bingdo
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Nemo InstructContinuedFine
Mistral · AlSamCur123
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
ministral uncensored
Mistral · virtuehearts
Params3.43B
Context32K
Q4_K_M2.1 GB
GGUF
MI
Vivacem/Mistral-7B-MMIQC
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 7Bx2 truthy i1
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Magistral Small 2506
Mistral · mistralai
Params23.6B
Context40K
Smallest25.1 GB
Reasoning
MI
ministral Ministral 3b instruct
Mistral · RichardErkhov
Params3.32B
Context128K
Q4_K_M2.0 GB
GGUF
MI
Mixtral AI Cyber Matrix 2 0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Coding
MI
Codestral 22B v0.1
Mistral · DevQuasar-4
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Oh Mistral bs4096_lr5_00E 06_schedulerconstant_warmup1_00E 01_minlr
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Candle tiny mistral
Mistral · DanielClough
Params214M
Context—
Smallest0.1 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MI
Mixtral_7Bx4_MOE_24B
Mistral · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
mistralai.Magistral Small 2509
Mistral · DevQuasar
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
MI
OpenHermes 7B Symbolic Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing