Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mixtral 8x7B Holodeck v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
models--mergekit-community--mergekit-slerp-jfynlwk
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Graft 2407
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral Lora Adapter CS Slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Locutusque_DIBT-Mistral-7B-QLoRA
Mistral · dagbs
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
E5 R Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct SPPO Iter2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Research Reasoner 7B v0.3
Mistral · Raymond-dev-546730
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
MistralPrism 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
LeoScorpius GreenNode Platypus 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Ministral 8B Instruct 2410
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
Mistral 24b Reddit Writing v1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mixtral-8x7B-Instruct-v0.1
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Amethyst 13B Mistral
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
MI
Mistral 7B v0.3 Middo Wizard
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mixtral GQA 400m v2
Mistral · mradermacher
Params2.01B
Context4K
Q4_K_M1.2 GB
MI
Mixtral 8x7B v0.1
Mistral · Artefact2
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mixtral Instruct ITR 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
Speechless Mistral Moloras 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin 2.5 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
SlimOpenOrca Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Openinstruct Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Young Children Storyteller Mistral 7B iMatrix
Mistral · MarsupialAI
Params7.24B
Context32K
Smallest2.0 GB
MI
mistral ft optimized 1227 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SinaReason Magistral 2509
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
BFPO Mistral 7b v0.1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
blossom v3 1 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Luau Devstral 24B Instruct v0.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Breezeblossom v4 mistral 2x7B
Mistral · mradermacher
Params13.1B
Context32K
Q4_K_M8.0 GB