Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Ablation 195 Finalsft2 Shisa v2 Mistral Small 24b
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
MI
WukongV2-Mixtral-8x7B-V0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Tor 8B
Mistral · QuantFactory
Params8.41B
Context16K
Q4_K_M5.1 GB
GGUF
MI
JJhooww Mistral 7B v0.2 Base ptbr
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral-7b-dolphin-sft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral MOE 4X7B Dark MultiVerse Uncensored Enhanced32 24B
Mistral · ekampra
Params24.2B
Context32K
Q4_K_M14.7 GB
Roleplay
MI
OpenHermes 2.5 neural chat 7b v3 1 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
laser-dolphin-mixtral-4x7b-dpo
Mistral · RichardErkhov
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
Ministral 3 14B Reasoning 2512
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningTool useVision
MI
bagel dpo 7b v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral marunashop v3 1.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
EulerMath-Mistral-7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
teknium.OpenHermes 2 Mistral 7B
Mistral · DevQuasar-8
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
merlinite 7b
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Chicka Mixtral 3x7b i1
Mistral · mradermacher
Params18.5B
Context8K
Q4_K_M11.2 GB
GGUF
MI
Mistral Nemo Baseline SFT i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Ministral 3 14B Reasoning 2512 SOM MPOA
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningTool use
MI
Ministral 3b instruct imatrix
Mistral · duyntnet
Params3.32B
Context128K
Q4_K_M2.0 GB
GGUF
MI
Mistral 7B v0.3 OBLITERATED
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Scary Story Finetune i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
una cybertron 7b v3 OMA Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407 abliterated Q4 K M
Mistral · Flamesline
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
mistral doryV2 12b
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral 7B v0.1 ORPO
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · gaianet
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
voxtral mini realtime
Mistral · TrevorJS
Params4.43B
Context—
Smallest2.5 GB
GGUF
MI
Mistral NeMo Minitron Upscale v1 i1
Mistral · mradermacher
Params12.5B
Context8K
Q4_K_M7.5 GB
GGUF
MI
Mistral Small 24B Roleplay V3
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
MI
OpenHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
ndebuhr Mistral 7B Technical Tutorial Summarization QLoRA
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing