Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B claude instruct Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Tiamat 24B Magistral PaperWitch Heresy
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningRoleplayTool use
MI
Mistral Nemo Instruct 2407 13.35B BRAINSTORM 5x FORM 11
Mistral · DavidAU
Params13.3B
Context1000K
Q4_K_M8.1 GB
Roleplay
MI
Mistral 7b v0.1 Layla v4
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
rfp instruct model Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral small 3.1 24b instruct 2503
Mistral · mrfakename
Params23.6B
Context32K
Smallest8.9 GB
GGUF
MI
speechless mistral six in one 7b orth 1.0 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
Hercules 1.0 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Roci Maxx v2
Mistral · QuantFactory
Params10.3B
Context1000K
Q4_K_M6.3 GB
GGUF
MI
japanese stablelm base gamma 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Forest Dpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.1 Documentazione 64k
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool useVision
MI
Ministral 3 14B Sft P1 ORPO
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool use
MI
ConfTuner Ministral
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
mlfoundations dev hp ablations mistral scheduler inverse sqrt
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 11Bx2 MoE 19B i1
Mistral · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
GGUF
MI
Venomia 1.1 m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Rp 24b Karcher
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
MI
Mistral7B PairRM SPPO ExPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
shenzhi wang Mistral 7B v0.3 Chinese Chat
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Speechless Mistral 7B v0.2 Mixed 1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · openfree
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
samantha mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral T5 7B v1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ontology 0.1 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b roleplay alpaca merge
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Speechless Instruct Mistral 7b v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding

Keep browsing