Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
K2S3 Mistral 7b v1.42
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
MI
Hertz Mistral Hermes 2x7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3 TISER
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
EM German
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
neural chat 7b v3 1 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NeuralPivot Mistral 13B i1
Mistral · mradermacher
Params13.3B
Context8K
Q4_K_M8.0 GB
MI
Mistral Devstral 2505 CODER Brainstorm40x 44B
Mistral · mradermacher
Params43.6B
Context128K
Q4_K_M26.4 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Heidrun Mistral 7B chat
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Devstral Small 2 24B Instruct 2512
Mistral · viniciusianni
Params23.6B
Context384K
Q4_K_M14.3 GB
MI
Mistral Palestinian Assistant
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
IntelLabs sqft sparsepeft mistral 7b v0.3 60 gsm8k heu
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Hermes2 Gutenberg2 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
MI
Rivermind 12B V1B Workspace
Mistral · TheDrummer
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Ministral 3 14B Instruct 2512
Mistral · ggml-org
Params13.5B
Context256K
Smallest14.4 GB
MI
jisukim8873 mistral 7B alpaca case 3 2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral_AI_MasterTron
Mistral · afrideva
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 8B RL Only
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
Mistral 7B KNUT v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
bigstral-12b-32k-8xMoE
Mistral · bartowski
Params81.5B
Context32K
Q4_K_M49.6 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Codestral-22B-v0.1-hf
Mistral · thesven
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Hebrew Mistral 7B 200K
Mistral · RichardErkhov
Params7.5B
Context256K
Q4_K_M4.6 GB
MI
Optimus 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3
Mistral · mradermacher
Params16.4B
Context32K
Q4_K_M9.9 GB
MI
Mrfakename.Mistral Small 3.1 24b Instruct 2503 Hf
Mistral · DevQuasar-6
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
NeuralHyperion 2.0 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7b Platypus Fp16
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB