Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Magistral Small 2507 Rebased Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool useVision
MI
Lyra Gutenberg mistral nemo 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Helcyon Grok
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MI
Noromaid-v0.1-mixtral-8x7b
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
Yarn Mistral 7b 64k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mixtral AI Chat 1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Berthier Mistral Military 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Mistral 7B Instruct SQL Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Instruct 2512 DASHQ Q2
Mistral · jkim96
Params8.49B
Context256K
Smallest2.6 GB
Tool use
MI
Rabbit 7B DPO Chat Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
macadeliccc Mistral 7B v0.2 OpenHermes
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mixtral Uphill Crush Crest v0.4
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
NSFW DPO Noromaid 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
chlee10 T3Q Merge Mistral7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NeuralPipe 7B slerp v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Gutensuppe mistral nemo 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Mistral Small 3.2 46B The Brilliant Raconteur Instruct 2506
Mistral · mradermacher
Params45.2B
Context128K
Q4_K_M27.4 GB
ReasoningRoleplay
MI
speechless code mistral 7b v2.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mixtral BioMedical i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
HX-Mistral-3B_v0.1
Mistral · duyntnet
Params3.75B
Context32K
Q4_K_M2.3 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · pravdin
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
mistral orpo capybara 7k
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Luau Devstral 24B Instruct v0.1
Mistral · TorpedoSoftware
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
MI
Multilingual mistral i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
eldogbbhed NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral 7B Instruct v0.3 Abliterated
Mistral · noctrex
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Vikhr Nemo 12B Instruct R 21 09 24
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral 7b Test Merged
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing