Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mixtral 8x7B Holodeck v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-jfynlwk
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Nemo Graft 2407
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Mistral Lora Adapter CS Slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Locutusque_DIBT-Mistral-7B-QLoRA
Mistral · dagbs
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
E5 R Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct SPPO Iter2 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Research Reasoner 7B v0.3
Mistral · Raymond-dev-546730
Params7.25B
Context32K
Q4_K_M4.4 GB
ReasoningTool use
MI
MistralPrism 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
LeoScorpius GreenNode Platypus 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 8B Instruct 2410
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
Mistral 24b Reddit Writing v1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
MI
Mixtral-8x7B-Instruct-v0.1
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Amethyst 13B Mistral
Mistral · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mistral 7B v0.3 Middo Wizard
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral GQA 400m v2
Mistral · mradermacher
Params2.01B
Context4K
Q4_K_M1.2 GB
GGUF
MI
Mixtral 8x7B v0.1
Mistral · Artefact2
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mixtral Instruct ITR 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
Speechless Mistral Moloras 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin 2.5 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
MI
SlimOpenOrca Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Openinstruct Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Young Children Storyteller Mistral 7B iMatrix
Mistral · MarsupialAI
Params7.24B
Context32K
Smallest2.0 GB
GGUF
MI
mistral ft optimized 1227 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SinaReason Magistral 2509
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
MI
BFPO Mistral 7b v0.1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Vision
MI
blossom v3 1 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Luau Devstral 24B Instruct v0.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
MI
Breezeblossom v4 mistral 2x7B
Mistral · mradermacher
Params13.1B
Context32K
Q4_K_M8.0 GB
GGUF

Keep browsing