Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral Nemo Instruct 2407 Heretic Noslop MPOA
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · eaddario
Params23.6B
Context128K
Q4_K_M13.1 GB
MI
Ae Calem Mistral 7b v0.1
Mistral · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · NousResearch
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
RenCoder Ministral 3 8B Instruct 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
NorwAI Mistral 7B instruct
Mistral · NorwAI
Params7.54B
Context—
Q4_K_M4.6 GB
MI
Candle Mistral 7B Instruct v0.1
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
MI
Blossom v3 Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 Strix Philosophy Mistral 7B LoRA
Mistral · sayhan
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Candle llava v1.6 mistral 7b
Mistral · DanielClough
Params7.57B
Context—
Smallest2.5 GB
MI
Commonsense QA Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Portuguese Luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
nbeerbower bophades mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
vagosolutions_sauerkrautlm-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
fpham_writing_partner_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 14B Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
timestral cpp
Mistral · mudler
Params123M
Context32K
Smallest0.0 GB
MI
Mistral-7b-MoEified-8x
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.6 GB
MI
Mistral 7B Instruct v0.2 Abliterated Obliteratus
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CleverBoi Mistral 0.3 7B
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Heidrun Mistral 7B chat i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nous Hermes 2 Mistral 7B DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin 2.5 mixtral 8x7b
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
MixtralOrochi8x7B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
Mistral 22B v0.2 GGUF smashed
Mistral · PrunaAI
Params22.2B
Context64K
Q4_K_M13.3 GB
MI
Kisna Mistral v1
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Ministral 8B Instruct 2410 Sft
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
CodeActAgent Mistral 7b v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral_7Bx4_MOE_DPO
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
Ministral 3 14B Nymphaea RP Heretic
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB