Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
mistral-11b-slimorca
Mistral · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
Kabster Bio Mistralv2 Squared
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Wayfarer-2-12B
Mistral · Mungert
Params12.2B
Context128K
Q4_K_M7.9 GB
MI
Mistral 7B Instruct v0.3 Malevolent
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
s3nh nsfw noromaid mistral instruct
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin 2.6 mistral 7b
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral_7Bx2_MoE_13B
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Hemispheres 7B Right
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
sqlcoder 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiaLatte Indo Mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Behemoth X 123B v2
Mistral · TheDrummer
Params123B
Context128K
Q4_K_M73.2 GB
MI
Mistral Grand R1 Dolphin 3.0 Deep Reasoning Brainstorm 45B i1
Mistral · mradermacher
Params45.2B
Context32K
Q4_K_M27.4 GB
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openinstruct-mistral-7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin 2.9.1 mistral 22b i1
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
MI
atom v1 preview 8b
Mistral · vanta-research
Params8.02B
Context32K
Smallest4.7 GB
MI
Bitnet-Mistral.0.2-330m-v0.2-grokfast-v2.9
Mistral · BoscoTheDog
Params330M
Context4K
Q4_K_M0.2 GB
MI
UNA-dolphin-2.6-mistral-7b-dpo-laser
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SciPhi Mistral 7B 32k i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Reasoning Mistral Nemo
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Small 2501 SCE Mashup 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
mlfoundations dev hp ablations mistral epoch1 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dans 07YahooAnswers 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 3B Reasoning 2512 DASHQ Q2
Mistral · jkim96
Params3.43B
Context256K
Smallest1.1 GB
MI
Ministral 3 8B Animus V12.0
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
mlfoundations dev hp ablations grid mistral bsz1024 lr5e 6 scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephyr 7b alpha sharded Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB