Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
mlfoundations dev hp ablations mistral lr2e 6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Portuguese Luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
TriplePotato Mistral Nemo 15B i1
Mistral · mradermacher
Params15B
Context1000K
Q4_K_M9.1 GB
GGUF
MI
Mistral 7B SFT DPO v0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Tess 3 Mistral Nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
smelborp_mixtralorochi8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
Mistral NeMo Minitron 8B Instruct
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
MI
Noromaid 7b v0.1.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Synatra 7B v0.3 dpo Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B DFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
Mistral 7B Reasoning Phased
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
MI
Mistral 7B Merge 14 v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
MI
Noromaid-v0.1-mixtral-8x7b-Instruct-v3
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
Dolphin3.0 Mistral 24B
Mistral · DevQuasar-7
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Mistral 7B Holodeck 1 Instruct 32k
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Devstral Small 2505
Mistral · Antigma
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
MI
GML Mistral merged v1 i1
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
MI
Nous Hermes 2 DPO into Dolphin Mistral 2.8 v02
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
OpenMia Indo Mistral 7b v3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openbuddy-mixtral-7bx8-v18.1-32k
Mistral · LoneStriker
Params46.7B
Context32K
Q4_K_M28.5 GB
GGUF
MI
Wukong 0.1 Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Mistral7B PairRM SPPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
diffnamehard/Mistral-CatMacaroni-slerp-uncensored-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Radiantloom Mixtral 8x7b Fusion
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
K2S3 Mistral 7b v1.47
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Mistral NeMo 12B Unslopper FR v1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Mistral Instruct DPO Y24 v2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing