Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Small 4 119B 2603 obliterated Q4 K M
Mistral · jenerallee78
Params119B
Context1024K
Q4_K_M72.2 GB
Tool useVision
MI
unsloth Hermes 2 Pro Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral-7B-Merge-14-v0.5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
MI
mistral-yuki-7B
Mistral · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
MI
Ministral 8B SFT RL
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
NeuralHermes-2.5-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Dolphin 2.1 Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
mamba gpt 7b v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b sft full Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes-2.5-Mistral-7B-16k
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
CharGen v2
Mistral · kubernetes-bad
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 8b Abliterated
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
mkebiclioglu mistralai Code Instruct Finetune sunday night test 2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral 7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Helcyon Mercury 12b v3.2
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
Mistral7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
haryra 7b mistral id i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · ggml-org
Params23.6B
Context128K
Smallest8.8 GB
Vision
MI
Synatra 7B v0.3 RP Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
K2S3 Mistral 7b v1.43
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Mixtral BioMedical
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
mistral-7b-v0.1-layla-v4-chatml
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
WebraftAI synapsellm 7b mistral v0.4 preview3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Base 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
mistral 7b v0.3 custom tokens
Mistral · Deeokay
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral-3-14B-Instruct-2512
Mistral · iasarkar
Params13.5B
Context256K
Q4_K_M8.2 GB
Tool useVision
MI
NeuralHermes 2.5 Mistral 7B
Mistral · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Nemo Webnovels
Mistral · NekoMikoReimu
Params12.2B
Context1000K
Smallest13.0 GB
GGUF

Keep browsing