Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Infinity Instruct 3M 0625 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3b Instruct
Mistral · mradermacher
Params3.32B
Context128K
Q4_K_M2.0 GB
MI
Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-euzaldk
Mistral · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
Hyperion 3.0 Mistral 7B alpha i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dalau627 text to sql finetuned mistral 7b
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
samantha mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
grok oss 7B
Mistral · c4tdr0ut
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3 Heretic
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Radiantloom Mixtral 8x7b Fusion
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral Nemo NT Ko 12B sft
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Tiamat 24B Magistral
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
neural chat 7b v3 3 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--dolphin-mistral-instruct-7b
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 4 119B 2603
Mistral · EnlistedGhost
Params119B
Context1024K
Smallest61.9 GB
MI
StructLM 7B Mistral
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B v0.1 instruct l2 norm post SFT pruned 4 experts i1
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
mmnga_mixtral-fusion-4x7b-instruct-v0.1
Mistral · TheBloke
Params24.2B
Context32K
Q4_K_M13.6 GB
MI
Tamil Mistral 7B Instruct v0.1
Mistral · Hemanth-thunder
Params7.39B
Context32K
Q4_K_M4.5 GB
MI
Mixtral_AI_TheAncient
Mistral · afrideva
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
blossom v3 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Base SFT CPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SauerkrautLM Mixtral 8x7B Instruct i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
zubr mini 1.9 3b
Mistral · Zubr-AI
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
candle mistral
Mistral · lmz
Params7.24B
Context—
Smallest4.1 GB
MI
Mistral 4B
Mistral · mradermacher
Params3.75B
Context32K
Q4_K_M2.3 GB
MI
GreenNode mini 7B multilingual v1olet Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NeuralHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Kant Test 0.1 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hyperion 3.0 Mistral 7B alpha
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB