Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistralai Mixtral 8x7B Instruct v0.1
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
MI
Mistral RP 24b Karcher Pro
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
MI
Mistral 7B v0.1 Sculpt Balanced
Mistral · mradermacher
Params5.58B
Context32K
Q4_K_M3.6 GB
GGUF
MI
Ko Mistral 7B Markr Wizard v2.4 Epoch2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
malaysian mistral 1.1B 4096
Mistral · afrideva
Params1.12B
Context32K
Q4_K_M0.7 GB
GGUF
MI
MegaBeam Mistral 7B 512k
Mistral · mradermacher
Params7.24B
Context512K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Reasoning 2512
Mistral · EnlistedGhost
Params8.49B
Context256K
Q4_K_M5.5 GB
ReasoningVision
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Dolphin 2.7 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
MI
Magistral Small 2509 Text Only
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
MI
ministral 3 3b reasoning 2512
Mistral · nile-academy
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
MI
Ministral 3 3B Base 2512
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
MI
Magistral 24B Full2x Ablit
Mistral · BeaverAI
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
neural chat 11b v3 2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MelloGPT Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Walter Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-ophtalmology
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1 Parasite
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · backyardai
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Luau Devstral 24B Instruct v0.1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
MI
Mistral Nemo 12B ArliAI RPMax v1.3
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
jointpreferences mistral 7b sft helpful
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral Small 2506 Abliterated
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
MI
Mistral Small 4 119B 2603
Mistral · AaryanK
Params119B
Context1024K
Q4_K_M72.2 GB
ReasoningTool useVision
MI
Mistral Nemo Instruct 2407 Heretic
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
ANIMA Cognitive Mistral v1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Codestral 22B v0.1 OBLITERATED
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Mistral Nemo Batman Venom V8
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Mixtral AI CyberBrain 3 0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF

Keep browsing