Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
mistral 7b ielts evaluator q4
Mistral · chillies
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.6 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Devstral Small 2 24B Instruct 2512
Mistral · backpack-run
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingTool useVision
MI
Mistral Small 3.1 24B Base 2503
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral Nemo 12B ArliAI RPMax v1.3
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
Mistral Nemo Batman Venom V9
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Mistral 7B claude chat i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-22B-v0.2
Mistral · bartowski
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
MI
aloobun_bun_mistral_7b_v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
japanese stablelm instruct gamma 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b sft full Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Amaretto 14B
Mistral · AmarettoLabs
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool use
MI
Llama 3.1 Nemotron 70B Instruct HF
Mistral · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M13.3 GB
Tool use
MI
Synatra V0.1 7B Instruct Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Uncensored
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Tool useVision
MI
Mistral-7B-sarcasm-scrolls-v2
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ft Mistral 7b Instruct v0.2 Sorry Bench 202406
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
J.O.S.I.E.3 Beta5 slerp
Mistral · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1
Mistral · mradermacher
Params7.39B
Context32K
Q4_K_M4.5 GB
GGUF
MI
trithemius-mistral-0.3-7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OculusMind-ToolCall-8B-v2 (Pico V2)
Mistral · OculusMindAI
Params8.49B
Context256K
Smallest9.0 GB
Tool use
MI
mistral ft optimized 1218
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Riva Translate 4B Instruct v2 imatrix
Mistral · liodon-ai
Params4.2B
Context8K
Q4_K_M2.8 GB
GGUF
MI
Mathstral 7B v0.1
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407 GGUF iamlemec
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · EnlistedGhost
Params23.6B
Context128K
Q4_K_M15.0 GB
Vision
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Mistral Nemo 12B R1 v0.4
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Reasoning
MI
Mistral nemo ja rp v0.2
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
MI
mistral-yuki-7B
Mistral · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF

Keep browsing