Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B v0.2 ko Y24 v1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Shieldstral 1.0 3B
Mistral · Metabaron6
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
MI
Mistral Small 3.1 24B Base 2503 SFT
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Candle Hermes 2 Pro Mistral 7B
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Samanthav3 MIXTRALDOLPHIN LORA i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral CatMacaroni slerp uncensored 7B
Mistral · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-utpztvu
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1
Mistral · mradermacher
Params7.39B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Liberalis Cogitator Mistral 3 8B
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
GGUF
MI
Mistral Nemo Gutenberg Doppel 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
mlfoundations dev hp ablations mistral epoch5 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
skymizer mistral 7B v0.1 csft relufication stage 1 on slim orca
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 14B Reasoning 2512 SOM MPOA
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningTool useVision
MI
Dolphin Mistral 24B Venice Edition
Mistral · Jonwi0706
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
MistralLite
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistralai Mistral Nemo Instruct 2407 12B MPOA v1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
mlfoundations dev hp ablations mistral lr8e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 3B Reasoning 2512
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool use
MI
Hercules 2.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
samantha mistral instruct 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Starling merge trial1 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral7B PairRM SPPO Iter1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2 Code Ft
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Blossom v3 Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
HermesStar OrcaWind Synth 11B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
MonadGPT
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Code Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Mistralpaca 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Karen_TheEditor_V2_STRICT_Mistral_7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing