Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral7B-PairRM-SPPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
norquinal_mistral-7b-claude-chat
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nous-Hermes-2-Mixtral-8x7B-DPO
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
undi95_mixtral-8x7b-moe-rp-story
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Mistral dolphin mix cine open Ne NSFW
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hermes 2 Pro Mistral 7B
Mistral · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
jphme_em_german_leo_mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
chronos mistral 7b i1
Mistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
models--bullerwins--Codestral-22B-v0.1-hf
Mistral · MaziyarPanahi
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Trinity 2 Codestral 22B v0.2
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
paixai_astrid-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral-3-3B-Reasoning-2512
Mistral · Mungert
Params3.43B
Context256K
Q4_K_M2.2 GB
MI
Models Mistralai Mistral Large Instruct 2407
Mistral · MaziyarPanahi
Params123B
Context32K
Q4_K_M73.2 GB
MI
Devstral Small 2505
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Pixtral
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
meta-math_metamath-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
MI
Mistral Nemo 12B Instruct
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Infinity Instruct 7M 0729 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
WikiHow Mistral Instruct 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Ministral 3 8B Nymphaea RP
Mistral · 0xA50C1A1
Params8.49B
Context—
Smallest0.0 GB
MI
Mahou-1.3-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Medium 3.5 128B
Mistral · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
MI
nondzu_mistral-7b-code-16k-qlora
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.3
Mistral · ArliAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
llava v1.6 mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Ministral-3-8B-Reasoning-2512
Mistral · Mungert
Params8.5B
Context256K
Q4_K_M5.5 GB
MI
Young Children Storyteller Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB