Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral 7B v0.2 ko Y24 v1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Shieldstral 1.0 3B
Mistral · Metabaron6
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mistral Small 3.1 24B Base 2503 SFT
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Candle Hermes 2 Pro Mistral 7B
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Samanthav3 MIXTRALDOLPHIN LORA i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral CatMacaroni slerp uncensored 7B
Mistral · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-utpztvu
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1
Mistral · mradermacher
Params7.39B
Context32K
Q4_K_M4.5 GB
MI
Liberalis Cogitator Mistral 3 8B
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral Nemo Gutenberg Doppel 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
mlfoundations dev hp ablations mistral epoch5 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
skymizer mistral 7B v0.1 csft relufication stage 1 on slim orca
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 14B Reasoning 2512 SOM MPOA
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · Jonwi0706
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
MistralLite
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistralai Mistral Nemo Instruct 2407 12B MPOA v1
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
mlfoundations dev hp ablations mistral lr8e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 3B Reasoning 2512
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Hercules 2.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
samantha mistral instruct 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Starling merge trial1 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral7B PairRM SPPO Iter1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2 Code Ft
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Blossom v3 Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
HermesStar OrcaWind Synth 11B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MonadGPT
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Code Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistralpaca 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Karen_TheEditor_V2_STRICT_Mistral_7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB