Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
mlfoundations dev hp ablations mistral lr2e 6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Portuguese Luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
TriplePotato Mistral Nemo 15B i1
Mistral · mradermacher
Params15B
Context1000K
Q4_K_M9.1 GB
MI
Mistral 7B SFT DPO v0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Tess 3 Mistral Nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
smelborp_mixtralorochi8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
MI
Noromaid 7b v0.1.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Synatra 7B v0.3 dpo Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B DFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Mistral 7B Reasoning Phased
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Merge 14 v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Noromaid-v0.1-mixtral-8x7b-Instruct-v3
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Dolphin3.0 Mistral 24B
Mistral · DevQuasar-7
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Holodeck 1 Instruct 32k
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Devstral Small 2505
Mistral · Antigma
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
GML Mistral merged v1 i1
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
MI
Nous Hermes 2 DPO into Dolphin Mistral 2.8 v02
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenMia Indo Mistral 7b v3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openbuddy-mixtral-7bx8-v18.1-32k
Mistral · LoneStriker
Params46.7B
Context32K
Q4_K_M28.5 GB
MI
Wukong 0.1 Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral7B PairRM SPPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
diffnamehard/Mistral-CatMacaroni-slerp-uncensored-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Radiantloom Mixtral 8x7b Fusion
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
K2S3 Mistral 7b v1.47
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
MI
Mistral NeMo 12B Unslopper FR v1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral Instruct DPO Y24 v2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB