Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Ministral 3 14B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Mistral Small 24B LOC L1 v1
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
maywell_pivot-10.7b-mistral-v0.2
Mistral · TheBloke
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
Dolphin 2.7 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral Portuguese Luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral Small 2509 Ultra Uncensored Heretic v1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
ANITA NEXT 24B Magistral 2506 VISION ITA
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Wukong-0.1-Mistral-7B-v0.2
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · ArliAI
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Dragon Mistral 7b v0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 24B Instruct 2501
Mistral · duyntnet
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
KAI 7B Instruct v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral MOE 4X7B Dark MultiVerse 24B
Mistral · DavidAU
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
mixtral-8x22b-instruct-oh
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
MI
Mistral 2x22B MOE Power Codestral Ultimate 39B
Mistral · mradermacher
Params39.2B
Context32K
Q4_K_M23.6 GB
MI
Mistral 7B Instruct v0.2 Neural Story
Mistral · LoneStriker
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
trithemius-mistral-0.3-7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1 Half Naive A
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b instruct v0.3.Q4 K M uncensored
Mistral · iimadouu
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT Alpaca
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Pixtral
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
ministral 3 14b instruct 2512 gguf Q4 K M
Mistral · pbhappliedsystems
Params13.5B
Context256K
Smallest8.2 GB
MI
Asclepius-Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Wukong 0.1 Mistral 7B v0.2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
piano medley 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Normistral 11b
Mistral · ltg
Params11.4B
Context1000K
Q4_K_M6.9 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · RichardErkhov
Params8.41B
Context8K
Q4_K_M5.1 GB
MI
Mistral Nemo Gutenberg Doppel 12B v2 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Tess 3 7B SFT
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mamba Codestral 7B v0.1
Mistral · gabriellarson
Params7.29B
Context1024K
Smallest1.5 GB