Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Synthia MoE v3 Mixtral 8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
NeuralHermes 2.5 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Generate_Question_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mirai-Nova-Mistral-LocalAI-7B-v0.1
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mixtral 8x7B Instruct v0.1
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral Nemo 12B R1 v0.4.1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Reasoning
MI
Karen_TheEditor_V2_CREATIVE_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-instruct-7B-V2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Nous Hermes 2 Mistral 7B DPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Heretica 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Mistralai Shieldstral 1.0 3B
Mistral · noctrex
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
MI
Mixtral_AI_MasterMind_RP
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
nbeerbower Gutensuppe mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · eaddario
Params22.5B
Context128K
Q4_K_M12.5 GB
GGUF
MI
Luau Devstral 24B Instruct v0.2
Mistral · TorpedoSoftware
Params23.6B
Context128K
Smallest0.0 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-kxeioog
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct Heretic
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Mistral Large Instruct 2407
Mistral · legraphista
Params123B
Context32K
Smallest26.0 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · sayi50
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Mistral-7B-Instruct-v0.3
Mistral · LiteLLMs
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Generate_Question_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Gutenberg Encore 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
mathstral-7B-v0.1
Mistral · InferenceIllusionist
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Reasoning 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
Dans-PersonalityEngine-V1.3.0-24b
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingRoleplay
MI
Nous Hermes 2 Mixtral 8x7B DPO
Mistral · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
Codestral-22B-v0.1
Mistral · SanctumAI
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Commonsense QA Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing