Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral Reddit 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Vezora Mistral 22B v0.1
Mistral · mmnga
Params22.2B
Context64K
Q4_K_M13.3 GB
MI
Mistral 7B Instruct V0.2_Bio Tutor_Dpo
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Air Striker Mixtral 8x7B Instruct ZLoss
Mistral · LoneStriker
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Tess 3 Mistral Nemo i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
causallm_8x7b-moe-test-not-mixtral
Mistral · TheBloke
Params38B
Context32K
Q4_K_M22.1 GB
MI
Mistral 7B ScaleQuest
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.2 24B Instruct 2506 Text Only Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
cognitivecomputations_fc-dolphin-2.6-mistral-7b-dpo-laser
Mistral · dagbs
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nous Hermes 2 Mistral 7B DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NousResearch Nous Hermes 2 Vision
Mistral · PsiPi
Params7.24B
Context32K
Smallest3.1 GB
MI
Mistral 2.5 Prima Hercules Fusion 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
WEBGEN Devstral 24B
Mistral · smirki
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
dolphin 2.2 mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MistralBase 4x7B MoE ECE PRYMMAL Martial i1
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
Dolphin3.0 R1 Mistral 24B Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · professorf
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral 2x22B MOE Power Codestral Ultimate 39B
Mistral · mradermacher
Params39.2B
Context32K
Q4_K_M23.6 GB
MI
Mistral 7B Instruct Aya 101
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Noromaid 7b v0.1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--Superevolution
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
BeaverAI_Fallen Mistral Small 3.1 24B V1E_Textonly
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral 7B Instruct v0.2 Neural Story
Mistral · nold
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral Instruct 2410 8B DPO RP
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
Mistral Nemo 2407 Instruct 12B Deep Thinking Claude Gemini GPT5.2
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Voxtral Mini 3B 2507
Mistral · mradermacher
Params4.01B
Context128K
Q4_K_M2.5 GB
MI
Amaretto 8B
Mistral · AmarettoLabs
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
MythoMist 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Redteam Mistral 7b v1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MyAlee-Mistral-Instruct-v2-32k-v2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB