Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Bitnet Mistral.0.2 47m v0.2 Grokfast1
Mistral · RichardErkhov
Params330M
Context4K
Q4_K_M0.2 GB
GGUF
MI
MistralCreative 24B Instruct i1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral 7B Instruct v0.2 expanded sec 1.6B tokens i1
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
MI
go bruins v2.1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-qzxjuip
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
dolphin 2.2.1 AshhLimaRP Mistral 7B
Mistral · Herman555
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct Ukrainian i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC
Mistral · fairy322
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
Mistral 7B v0.3 Chinese Chat
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 24B Enlgish
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Mistralai Mistral Nemo Instruct 2407 Extensive BP Abliteration 12B
Mistral · xs7david
Params12.2B
Context128K
Smallest7.1 GB
Tool use
MI
Mistral NeMo Minitron 8B Chat i1
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
Tool use
MI
Prox MistralHermes 7B GGUF IQ Imatrix Request
Mistral · LWDCLS
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mixtral 8x7B Instruct v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
CodeActAgent Mistral 7b v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
doktor Mistral trendyol 7b
Mistral · mradermacher
Params7.34B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
smol 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Gutensuppe mistral nemo 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Mistral NeuralDPO v0.5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Synatra 7B v0.3 RP Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
CleverBoi 7B v2
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-lnhotro
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mixtral 8x7B Instruct v0.1 Custom
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Mistral-7B-Instruct-v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nexus IKM Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · ipsarkar
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Samantha PL AG Mistral 7B v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
v1olet marcoroni go bruins merge 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing