Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
K2S3 Mistral 7b v1.42
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Hertz Mistral Hermes 2x7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B Instruct v0.3 TISER
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
EM German
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
neural chat 7b v3 1 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NeuralPivot Mistral 13B i1
Mistral · mradermacher
Params13.3B
Context8K
Q4_K_M8.0 GB
GGUF
MI
Mistral Devstral 2505 CODER Brainstorm40x 44B
Mistral · mradermacher
Params43.6B
Context128K
Q4_K_M26.4 GB
CodingTool use
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Heidrun Mistral 7B chat
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Devstral Small 2 24B Instruct 2512
Mistral · viniciusianni
Params23.6B
Context384K
Q4_K_M14.3 GB
Coding
MI
Mistral Palestinian Assistant
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
IntelLabs sqft sparsepeft mistral 7b v0.3 60 gsm8k heu
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hermes2 Gutenberg2 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
Tool use
MI
Rivermind 12B V1B Workspace
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Ministral 3 14B Instruct 2512
Mistral · ggml-org
Params13.5B
Context256K
Smallest14.4 GB
Tool useVision
MI
jisukim8873 mistral 7B alpaca case 3 2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral_AI_MasterTron
Mistral · afrideva
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 8B RL Only
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
Mistral 7B KNUT v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
bigstral-12b-32k-8xMoE
Mistral · bartowski
Params81.5B
Context32K
Q4_K_M49.6 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Codestral-22B-v0.1-hf
Mistral · thesven
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Hebrew Mistral 7B 200K
Mistral · RichardErkhov
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
MI
Optimus 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · mradermacher
Params16.4B
Context32K
Q4_K_M9.9 GB
Tool use
MI
Mrfakename.Mistral Small 3.1 24b Instruct 2503 Hf
Mistral · DevQuasar-6
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
NeuralHyperion 2.0 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7b Platypus Fp16
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing