Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Synthia MoE v3 Mixtral 8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
NeuralHermes 2.5 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Generate_Question_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mirai-Nova-Mistral-LocalAI-7B-v0.1
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral Nemo 12B R1 v0.4.1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Karen_TheEditor_V2_CREATIVE_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-instruct-7B-V2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nous Hermes 2 Mistral 7B DPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Heretica 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistralai Shieldstral 1.0 3B
Mistral · noctrex
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mixtral_AI_MasterMind_RP
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
nbeerbower Gutensuppe mistral nemo 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · eaddario
Params22.5B
Context128K
Q4_K_M12.5 GB
MI
Luau Devstral 24B Instruct v0.2
Mistral · TorpedoSoftware
Params23.6B
Context128K
Smallest0.0 GB
MI
models--mergekit-community--mergekit-slerp-kxeioog
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct Heretic
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral Large Instruct 2407
Mistral · legraphista
Params123B
Context32K
Smallest26.0 GB
MI
Mistral Nemo Instruct 2407
Mistral · sayi50
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · LiteLLMs
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Generate_Question_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Gutenberg Encore 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
mathstral-7B-v0.1
Mistral · InferenceIllusionist
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 8B Reasoning 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Dans-PersonalityEngine-V1.3.0-24b
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Nous Hermes 2 Mixtral 8x7B DPO
Mistral · second-state
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Codestral-22B-v0.1
Mistral · SanctumAI
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Commonsense QA Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB