Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
cognitivecomputations_dolphin-2.8-mistral-7b-v02
Mistral · dagbs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 11B OmniMix Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Fireball Mistral Nemo 12B Philos i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
mistral 7b sft alpha
Mistral · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 3B Instruct v0.2 init
Mistral · Aryanne
Params2.81B
Context32K
Smallest1.4 GB
GGUF
MI
Mistral Small 3.2 AntiRep 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mistral Small R1 Tensopolis
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
Mistral grok instract 2 7B slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr beta math Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Speechless Thoughts Mistral 7b v1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral Nemo NT Ko 12B dpo i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
ChatHercules 2.5 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 3B Reasoning 2512 Esper3.1
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
CodingReasoningTool use
MI
dolphin 2.1 mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Cydonia ReduX 22B v1.1
Mistral · TheDrummer
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
Mistral 7b FFT Test3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
samantha 1.2 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Japanese Instruct 2408
Mistral · mmnga
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral 7B Base SFT SimPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nexus IKM Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
legal it 8b
Mistral · EuLLM
Params8.49B
Context256K
Q4_K_M5.2 GB
Tool use
MI
Mistral dolphin 2.8 grok instract 2 7B slerp
Mistral · nasiruddin15
Params7.24B
Context32K
Smallest7.7 GB
GGUF
MI
tiledfloor Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 22B ArliAI RPMax v1.1
Mistral · dan517
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
Ministral 3 3B Reasoning 2512 Absolute Heresy
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool use
MI
openchat 3.5 1210
Mistral · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
MI
openbuddy mistral 7b v13 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin-2.9.2-mixtral-8x22b
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
CodingTool use
MI
ANITA NEXT 24B Dolphin Mistral UNCENSORED ITA
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
MI
lucid-v1-nemo
Mistral · Mungert
Params12.2B
Context128K
Q4_K_M7.6 GB
GGUF

Keep browsing