Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
models--mergekit-community--mergekit-slerp-wvyefgo
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral-Small-2509
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
mesolitica malaysian mistral 7b 32k instructions v4
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral scheduler linear warmup0.05 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral lr1e 6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Openai_Gsm8K_Finetune_Mistral7B_
Mistral · sematemur
Params7.25B
Context32K
Smallest7.7 GB
MI
voxtral tts q4
Mistral · TrevorJS
Params4B
Context—
Smallest2.9 GB
MI
Mistral Instruct Y24 DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nous Hermes 2 Mistral 7B DPO iMat
Mistral · qwp4w3hyb
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1 Kyrgyz Text Completion
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
open s1 mistral small 7b zh
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B Instruct v0.1 Parasite
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
bagel 7b v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 8 From Mixtral 8x7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.6 GB
MI
mistralai.Ministral 3 3B Reasoning 2512
Mistral · DevQuasar
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Pixel Rave_babe 1111 Mistral 23b
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Khushi Business Ai
Mistral · UX4567
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
openchat 3.5 0106 Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
alexshengzhili mistral 3 0908 preference 4 conference shuffled 2023 sft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Turkish Mistral NeMo 12B Instruct
Mistral · mehmettozlu
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral 7B Heretic V2
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-vhzhpmg
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mixtral 8x7b instruct compacted conservative
Mistral · continuum-ai
Params35.4B
Context32K
Q4_K_M21.4 GB
MI
Mistral 7B Discord 0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
KnutJaegersberg/Walter-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
yjwon mpg27 mistral7bv3 sft dpo beta5e 2 epoch3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
zephyr 7b alpha dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CollectiveCognition v1.1 Mistral 7B dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
WebraftAI synapsellm 7b mistral v0.5 preview
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Locutusque/Hyperion-1.5-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB