Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
cloudyu_mixtral_34bx2_moe_60b
Mistral · TheBloke
Params60.8B
Context195K
Q4_K_M34.4 GB
MI
Mistral Small 3.2 24B Instruct 2506 Absolute Heresy
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin-Mistral-24B-Venice-Edition
Mistral · Mungert
Params23.6B
Context32K
Q4_K_M14.5 GB
MI
nondzu_mistral-7b-codealpaca-lora
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NeuralHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ANIMA Phi Neptune Mistral 10.7B
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
YuisekinAI Mistral 0.7B
Mistral · RichardErkhov
Params746M
Context4K
Q4_K_M0.5 GB
MI
flammenai flammen15X mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
speechless-mistral-six-in-one-7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mixtral 8x7B v0.1 instruct l2 norm post SFT pruned 3 experts
Mistral · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
MI
Mistral Magistral Devstral Instruct FUSED CODER Reasoning 36B
Mistral · mradermacher
Params35.8B
Context128K
Q4_K_M21.7 GB
MI
Mistral 7B Instruct v0.2 GGUF smashed
Mistral · PrunaAI
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
nousresearch_yarn-mistral-7b-64k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B v0.1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
dolphin-2.9.3-mistral-7B-32k
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Ministral-3-14B-Nymphaea-RP
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Mixtral 11Bx2 MoE 19B
Mistral · TheBloke
Params19.2B
Context4K
Q4_K_M10.9 GB
MI
dolphin-2.9.3-mistral-7B-32k
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Merge Mixtral Prometheus 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
arc53_docsgpt-7b-mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
rossascends_mistral_7b_dolphin2.1_lima0.5_fp16
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Codestral 22B v0.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Mixtral AI Cyber 5.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Ministral 3 8B Reasoning 2512 It
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral Small 4 119B 2603
Mistral · mradermacher
Params119B
Context1024K
Q4_K_M72.2 GB
MI
mistral 7b grok
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Configurable-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB