Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Ministral 3 14B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
CodingReasoningTool use
MI
Mistral Small 24B LOC L1 v1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
maywell_pivot-10.7b-mistral-v0.2
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
Dolphin 2.7 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
MI
Mistral Portuguese Luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral Small 2509 Ultra Uncensored Heretic v1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool useVision
MI
ANITA NEXT 24B Magistral 2506 VISION ITA
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningVision
MI
Wukong-0.1-Mistral-7B-v0.2
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · ArliAI
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Dragon Mistral 7b v0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · duyntnet
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
KAI 7B Instruct v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral MOE 4X7B Dark MultiVerse 24B
Mistral · DavidAU
Params24.2B
Context32K
Q4_K_M14.6 GB
Roleplay
MI
mixtral-8x22b-instruct-oh
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
Tool use
MI
Mistral 2x22B MOE Power Codestral Ultimate 39B
Mistral · mradermacher
Params39.2B
Context32K
Q4_K_M23.6 GB
Coding
MI
Mistral 7B Instruct v0.2 Neural Story
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
trithemius-mistral-0.3-7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1 Half Naive A
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b instruct v0.3.Q4 K M uncensored
Mistral · iimadouu
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Nous Hermes 2 Mixtral 8x7B SFT Alpaca
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
Pixtral
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
MI
ministral 3 14b instruct 2512 gguf Q4 K M
Mistral · pbhappliedsystems
Params13.5B
Context256K
Smallest8.2 GB
Tool use
MI
Asclepius-Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Wukong 0.1 Mistral 7B v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
piano medley 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Normistral 11b
Mistral · ltg
Params11.4B
Context1000K
Q4_K_M6.9 GB
GGUF
MI
Mistral NeMo Minitron 8B Base
Mistral · RichardErkhov
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
MI
Mistral Nemo Gutenberg Doppel 12B v2 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Tess 3 7B SFT
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mamba Codestral 7B v0.1
Mistral · gabriellarson
Params7.29B
Context1024K
Smallest1.5 GB
Coding

Keep browsing