Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
cognitivecomputations_dolphin-2.8-mistral-7b-v02
Mistral · dagbs
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 11B OmniMix Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Fireball Mistral Nemo 12B Philos i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
mistral 7b sft alpha
Mistral · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 3B Instruct v0.2 init
Mistral · Aryanne
Params2.81B
Context32K
Smallest1.4 GB
MI
Mistral Small 3.2 AntiRep 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Small R1 Tensopolis
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral grok instract 2 7B slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephyr beta math Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Speechless Thoughts Mistral 7b v1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo NT Ko 12B dpo i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
ChatHercules 2.5 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 3B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
dolphin 2.1 mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Cydonia ReduX 22B v1.1
Mistral · TheDrummer
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Mistral 7b FFT Test3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
samantha 1.2 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Japanese Instruct 2408
Mistral · mmnga
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral 7B Base SFT SimPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nexus IKM Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
legal it 8b
Mistral · EuLLM
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral dolphin 2.8 grok instract 2 7B slerp
Mistral · nasiruddin15
Params7.24B
Context32K
Smallest7.7 GB
MI
tiledfloor Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · dan517
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Ministral 3 3B Reasoning 2512 Absolute Heresy
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
openchat 3.5 1210
Mistral · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
openbuddy mistral 7b v13 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin-2.9.2-mixtral-8x22b
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
MI
ANITA NEXT 24B Dolphin Mistral UNCENSORED ITA
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
MI
lucid-v1-nemo
Mistral · Mungert
Params12.2B
Context128K
Q4_K_M7.6 GB