Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Reddit 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Vezora Mistral 22B v0.1
Mistral · mmnga
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
MI
Mistral 7B Instruct V0.2_Bio Tutor_Dpo
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Air Striker Mixtral 8x7B Instruct ZLoss
Mistral · LoneStriker
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Tess 3 Mistral Nemo i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
causallm_8x7b-moe-test-not-mixtral
Mistral · TheBloke
Params38B
Context32K
Q4_K_M22.1 GB
GGUF
MI
Mistral 7B ScaleQuest
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.2 24B Instruct 2506 Text Only Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
cognitivecomputations_fc-dolphin-2.6-mistral-7b-dpo-laser
Mistral · dagbs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nous Hermes 2 Mistral 7B DPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
NousResearch Nous Hermes 2 Vision
Mistral · PsiPi
Params7.24B
Context32K
Smallest3.1 GB
Tool useVision
MI
Mistral 2.5 Prima Hercules Fusion 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
WEBGEN Devstral 24B
Mistral · smirki
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
MI
dolphin 2.2 mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MistralBase 4x7B MoE ECE PRYMMAL Martial i1
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
Dolphin3.0 R1 Mistral 24B Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
Dolphin Mistral 24B Venice Edition
Mistral · professorf
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral 2x22B MOE Power Codestral Ultimate 39B
Mistral · mradermacher
Params39.2B
Context32K
Q4_K_M23.6 GB
Coding
MI
Mistral 7B Instruct Aya 101
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Noromaid 7b v0.1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--Superevolution
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
BeaverAI_Fallen Mistral Small 3.1 24B V1E_Textonly
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral 7B Instruct v0.2 Neural Story
Mistral · nold
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral Instruct 2410 8B DPO RP
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
RoleplayTool use
MI
Mistral Nemo 2407 Instruct 12B Deep Thinking Claude Gemini GPT5.2
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
Voxtral Mini 3B 2507
Mistral · mradermacher
Params4.01B
Context128K
Q4_K_M2.5 GB
Tool use
MI
Amaretto 8B
Mistral · AmarettoLabs
Params8.49B
Context256K
Q4_K_M5.2 GB
Tool use
MI
MythoMist 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Redteam Mistral 7b v1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MyAlee-Mistral-Instruct-v2-32k-v2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing