Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Infinity Instruct 3M 0625 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3b Instruct
Mistral · mradermacher
Params3.32B
Context128K
Q4_K_M2.0 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-euzaldk
Mistral · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
Hyperion 3.0 Mistral 7B alpha i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
dalau627 text to sql finetuned mistral 7b
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
samantha mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
grok oss 7B
Mistral · c4tdr0ut
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B Instruct v0.3 Heretic
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Radiantloom Mixtral 8x7b Fusion
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral Nemo NT Ko 12B sft
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
CodingRoleplay
MI
Tiamat 24B Magistral
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningRoleplayTool use
MI
neural chat 7b v3 3 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--dolphin-mistral-instruct-7b
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 4 119B 2603
Mistral · EnlistedGhost
Params119B
Context1024K
Smallest61.9 GB
Vision
MI
StructLM 7B Mistral
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B v0.1 instruct l2 norm post SFT pruned 4 experts i1
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
mmnga_mixtral-fusion-4x7b-instruct-v0.1
Mistral · TheBloke
Params24.2B
Context32K
Q4_K_M13.6 GB
GGUF
MI
Tamil Mistral 7B Instruct v0.1
Mistral · Hemanth-thunder
Params7.39B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Mixtral_AI_TheAncient
Mistral · afrideva
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
blossom v3 mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Base SFT CPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SauerkrautLM Mixtral 8x7B Instruct i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
zubr mini 1.9 3b
Mistral · Zubr-AI
Params3.43B
Context256K
Q4_K_M2.1 GB
Tool useVision
MI
candle mistral
Mistral · lmz
Params7.24B
Context—
Smallest4.1 GB
GGUF
MI
Mistral 4B
Mistral · mradermacher
Params3.75B
Context32K
Q4_K_M2.3 GB
Roleplay
MI
GreenNode mini 7B multilingual v1olet Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NeuralHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Kant Test 0.1 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hyperion 3.0 Mistral 7B alpha
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding

Keep browsing