Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
models--mergekit-community--mergekit-slerp-wvyefgo
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral-Small-2509
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
MI
mesolitica malaysian mistral 7b 32k instructions v4
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler linear warmup0.05 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral lr1e 6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Openai_Gsm8K_Finetune_Mistral7B_
Mistral · sematemur
Params7.25B
Context32K
Smallest7.7 GB
GGUF
MI
voxtral tts q4
Mistral · TrevorJS
Params4B
Context—
Smallest2.9 GB
GGUF
MI
Mistral Instruct Y24 DPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nous Hermes 2 Mistral 7B DPO iMat
Mistral · qwp4w3hyb
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B v0.1 Kyrgyz Text Completion
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
open s1 mistral small 7b zh
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mixtral 8x7B Instruct v0.1 Parasite
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
bagel 7b v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral 8 From Mixtral 8x7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.6 GB
GGUF
MI
mistralai.Ministral 3 3B Reasoning 2512
Mistral · DevQuasar
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
MI
Pixel Rave_babe 1111 Mistral 23b
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Khushi Business Ai
Mistral · UX4567
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
openchat 3.5 0106 Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
alexshengzhili mistral 3 0908 preference 4 conference shuffled 2023 sft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Turkish Mistral NeMo 12B Instruct
Mistral · mehmettozlu
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Mistral 7B Heretic V2
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
models--mergekit-community--mergekit-slerp-vhzhpmg
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mixtral 8x7b instruct compacted conservative
Mistral · continuum-ai
Params35.4B
Context32K
Q4_K_M21.4 GB
GGUF
MI
Mistral 7B Discord 0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
KnutJaegersberg/Walter-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
yjwon mpg27 mistral7bv3 sft dpo beta5e 2 epoch3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
zephyr 7b alpha dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CollectiveCognition v1.1 Mistral 7B dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
WebraftAI synapsellm 7b mistral v0.5 preview
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Locutusque/Hyperion-1.5-Mistral-7B
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing