Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Magistral Small 2507 Rebased Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Lyra Gutenberg mistral nemo 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Helcyon Grok
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Noromaid-v0.1-mixtral-8x7b
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Yarn Mistral 7b 64k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral AI Chat 1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Berthier Mistral Military 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral 7B Instruct SQL Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 8B Instruct 2512 DASHQ Q2
Mistral · jkim96
Params8.49B
Context256K
Smallest2.6 GB
MI
Rabbit 7B DPO Chat Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
macadeliccc Mistral 7B v0.2 OpenHermes
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral Uphill Crush Crest v0.4
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
NSFW DPO Noromaid 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
chlee10 T3Q Merge Mistral7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NeuralPipe 7B slerp v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Gutensuppe mistral nemo 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Small 3.2 46B The Brilliant Raconteur Instruct 2506
Mistral · mradermacher
Params45.2B
Context128K
Q4_K_M27.4 GB
MI
speechless code mistral 7b v2.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral BioMedical i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
HX-Mistral-3B_v0.1
Mistral · duyntnet
Params3.75B
Context32K
Q4_K_M2.3 GB
MI
Mistral Nemo Instruct 2407
Mistral · pravdin
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · NeverSleep
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
mistral orpo capybara 7k
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Luau Devstral 24B Instruct v0.1
Mistral · TorpedoSoftware
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Multilingual mistral i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
eldogbbhed NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3 Abliterated
Mistral · noctrex
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Vikhr Nemo 12B Instruct R 21 09 24
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral 7b Test Merged
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB