Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Nemo Instruct 2407 Heretic Noslop MPOA
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · eaddario
Params23.6B
Context128K
Q4_K_M13.1 GB
GGUF
MI
Ae Calem Mistral 7b v0.1
Mistral · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · NousResearch
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
RenCoder Ministral 3 8B Instruct 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
CodingTool use
MI
NorwAI Mistral 7B instruct
Mistral · NorwAI
Params7.54B
Context—
Q4_K_M4.6 GB
GGUF
MI
Candle Mistral 7B Instruct v0.1
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
MI
Blossom v3 Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 Strix Philosophy Mistral 7B LoRA
Mistral · sayhan
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Candle llava v1.6 mistral 7b
Mistral · DanielClough
Params7.57B
Context—
Smallest2.5 GB
GGUF
MI
Commonsense QA Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Portuguese Luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
nbeerbower bophades mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
vagosolutions_sauerkrautlm-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
fpham_writing_partner_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 14B Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool use
MI
timestral cpp
Mistral · mudler
Params123M
Context32K
Smallest0.0 GB
GGUF
MI
Mistral-7b-MoEified-8x
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.6 GB
GGUF
MI
Mistral 7B Instruct v0.2 Abliterated Obliteratus
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CleverBoi Mistral 0.3 7B
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Heidrun Mistral 7B chat i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Nous Hermes 2 Mistral 7B DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
dolphin 2.5 mixtral 8x7b
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
MI
MixtralOrochi8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
Mistral 22B v0.2 GGUF smashed
Mistral · PrunaAI
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
MI
Kisna Mistral v1
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Ministral 8B Instruct 2410 Sft
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
CodingTool use
MI
CodeActAgent Mistral 7b v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mixtral_7Bx4_MOE_DPO
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
Ministral 3 14B Nymphaea RP Heretic
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
RoleplayTool useVision

Keep browsing