Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral 7B claude instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Tiamat 24B Magistral PaperWitch Heresy
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Nemo Instruct 2407 13.35B BRAINSTORM 5x FORM 11
Mistral · DavidAU
Params13.3B
Context1000K
Q4_K_M8.1 GB
MI
Mistral 7b v0.1 Layla v4
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
rfp instruct model Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral small 3.1 24b instruct 2503
Mistral · mrfakename
Params23.6B
Context32K
Smallest8.9 GB
MI
speechless mistral six in one 7b orth 1.0 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
Hercules 1.0 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Roci Maxx v2
Mistral · QuantFactory
Params10.3B
Context1000K
Q4_K_M6.3 GB
MI
japanese stablelm base gamma 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Forest Dpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.1 Documentazione 64k
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Ministral 3 14B Sft P1 ORPO
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
ConfTuner Ministral
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
mlfoundations dev hp ablations mistral scheduler inverse sqrt
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 11Bx2 MoE 19B i1
Mistral · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
MI
Venomia 1.1 m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Rp 24b Karcher
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral7B PairRM SPPO ExPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
shenzhi wang Mistral 7B v0.3 Chinese Chat
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Speechless Mistral 7B v0.2 Mixed 1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · openfree
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
samantha mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral T5 7B v1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ontology 0.1 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b roleplay alpaca merge
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Speechless Instruct Mistral 7b v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB