Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Syndicate 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin Mistral 24B Venice Edition Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Hermes 2 Pro Mistral 10.7B
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.6 GB
Tool use
MI
Devstral-Small-2-24B-Instruct-2512
Mistral · byteshape
Params23.6B
Context384K
Smallest6.9 GB
CodingVision
MI
Mistral-7B-Instruct-v0.3
Mistral · SanctumAI
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
orangetin_fennec-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
Tool use
MI
dolphin 2.2.1 mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 4 119B 2603 NVFP4
Mistral · FedericoFB
Params119B
Context1024K
Smallest70.0 GB
Vision
MI
Ministral 3 8B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
openpipe_mistral-ft-optimized-1218
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nous Hermes 2 Mistral 7B DPO i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
dolphin-2.9.3-mistral-7B-32k
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Small 3.2 24B Instruct 2506 Heretic v1.2 2
Mistral · grayarea
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistralai Mistral Nemo Instruct 2407 Extensive BP Abliteration 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-tejngyg
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mixtral AI Cyber 2.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Coding
MI
Mistral Large 3 675B Instruct 2512
Mistral · bartowski
Params673B
Context288K
Q4_K_M411.4 GB
Tool useVision
MI
DeepHermes 3 Mistral 24B Preview i1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
ReasoningRoleplayTool use
MI
Mixtral 8x22B v0.1 iMat
Mistral · InferenceIllusionist
Params141B
Context32K
Q4_K_M85.6 GB
GGUF
MI
Hebrew Mistral 7B
Mistral · mradermacher
Params7.5B
Context32K
Q4_K_M4.6 GB
GGUF
MI
Merge Mistral Prometheus 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 14B Reasoning 2512 heretic
Mistral · coder3101
Params13.5B
Context256K
Q4_K_M8.2 GB
CodingReasoningTool use
MI
Ministral 3 8B Claude Opus Reasoning Distilled
Mistral · xtools-at
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
MathCoder2 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
grimjim Mistral Starling merge trial3 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-Holodeck-1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 24B Roleplay V6
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
MI
philosophy mistral
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.1 24B RP
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay

Keep browsing