Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Dolphin3.0 R1 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Abliterated Dolphin3.0 R1 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Lite-Mistral-150M-v2-Instruct
Mistral · OuteAI
Params157M
Context2K
Q4_K_M0.1 GB
MI
dragon mistral 7b v0
Mistral · llmware
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-instruct-7B-V2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 8B Reasoning 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Huihui Ministral 3 14B Reasoning 2512 Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
Huihui Ministral 3 8B Reasoning 2512 Abliterated
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Hercules 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b base lipo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
nickynicky_mistral-7b-openorca-oasst_top1_2023-08-25-v1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Stella mistral nemo 12B v2 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
Venomia 1.1 m7 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Air Striker Mixtral 8x7B ZLoss Instruct
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
embeddedllm_mistral-7b-merge-14-v0.1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Tess 3 Mistral Nemo
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Solstice Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
Mixtral-instruct-56B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
OpenHermes-2.5-Mistral-7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo 2407 Instruct 12B Deep Thinking Claude Gemini GPT5.2
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
chronos mistral 7b
Mistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
ehartford_samantha-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
llava NousResearch Nous Hermes 2 Vision
Mistral · billborkowski
Params7.24B
Context32K
Smallest4.1 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Devstral 2507 CODER Brainstorm40x 44B
Mistral · mradermacher
Params43.6B
Context128K
Q4_K_M26.4 GB
MI
WEBGEN Devstral 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral Small 24B Instruct 2501
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral Small 3.2 46B The Brilliant Raconteur II Instruct 2506
Mistral · mradermacher
Params45.2B
Context128K
Q4_K_M27.4 GB