Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Dolphin3.0 R1 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoningTool use
MI
Abliterated Dolphin3.0 R1 Mistral 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
Lite-Mistral-150M-v2-Instruct
Mistral · OuteAI
Params157M
Context2K
Q4_K_M0.1 GB
GGUF
MI
dragon mistral 7b v0
Mistral · llmware
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-instruct-7B-V2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Reasoning 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
MI
Huihui Ministral 3 14B Reasoning 2512 Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Reasoning
MI
Huihui Ministral 3 8B Reasoning 2512 Abliterated
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
Hercules 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistral 7b base lipo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
nickynicky_mistral-7b-openorca-oasst_top1_2023-08-25-v1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Stella mistral nemo 12B v2 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
Venomia 1.1 m7 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-Small-3.1-24B-Instruct-2503
Mistral · Mungert
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
Air Striker Mixtral 8x7B ZLoss Instruct
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
embeddedllm_mistral-7b-merge-14-v0.1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
MI
Tess 3 Mistral Nemo
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Solstice Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
Mixtral-instruct-56B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Vision
MI
OpenHermes-2.5-Mistral-7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Nemo 2407 Instruct 12B Deep Thinking Claude Gemini GPT5.2
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
chronos mistral 7b
Mistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
ehartford_samantha-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
llava NousResearch Nous Hermes 2 Vision
Mistral · billborkowski
Params7.24B
Context32K
Smallest4.1 GB
Tool useVision
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Devstral 2507 CODER Brainstorm40x 44B
Mistral · mradermacher
Params43.6B
Context128K
Q4_K_M26.4 GB
CodingTool use
MI
WEBGEN Devstral 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
MI
Mistral Small 24B Instruct 2501
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
Mistral Small 3.2 46B The Brilliant Raconteur II Instruct 2506
Mistral · mradermacher
Params45.2B
Context128K
Q4_K_M27.4 GB
ReasoningRoleplayVision

Keep browsing