Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral 7B Instruct v0.1
Mistral · DhruvalLabs
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin 2.6 Mistral 7b Dpo Chat
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hermes 2 Pro Mixtral 4x7B i1
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
Mistral Nemo Base 2407 Uncensored
Mistral · AlSamCur123
Params12.2B
Context128K
Smallest7.1 GB
MI
InnerILLM OpenPipe Nous Yarn Mistral optimized 1228 7B slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7b Arc
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Prism 12B v2 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
self-reflect_ministral8Bit_mg_star-dpo_2ep
Mistral · RichardErkhov
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Synatra 7B Instruct v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 14B Abliterated Aggressive
Mistral · jenerallee78
Params13.5B
Context256K
Smallest14.4 GB
MI
Delcos airoboros mistral2.2 Starling 11b
Mistral · RichardErkhov
Params11.4B
Context32K
Q4_K_M6.8 GB
MI
Speechless Mistral Hermes Code 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral NeuralDPO v0.4
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-ijnxdha
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
PiVoT 0.1 early Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
FoxyzGPT 1.1 7B
Mistral · Flexan
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mahou 1.5 Mistral Nemo 12B
Mistral · mradermacher
Params10.1B
Context1000K
Q4_K_M6.2 GB
MI
ChatHercules 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Komt Mistral 7b v1 Dpo Osy v1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
TechniqueRAG FS Ministral 8B
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
NousResearch Genstruct 7B only
Mistral · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.2 Hf
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 10.7B v0.2
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
Mistral Small R1 Tensopolis
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Elysia Trismegistus Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hemispheres 7B Combiner
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
jackalope 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral_7Bx2_MoE
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Mistral Large Instruct 2407
Mistral · gaianet
Params123B
Context128K
Q4_K_M73.2 GB