Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Falkor 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Skyfall 31B v4.1
Mistral · TheDrummer
Params31.4B
Context128K
Q4_K_M19.0 GB
ReasoningTool use
MI
Mistral Small Instruct 2409
Mistral · duyntnet
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
Mistral 7B model 45k6e2e4
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.2 OpenHermes i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistral ft optimized 1227
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral NeMo Minitron 8B Base
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
MI
Mixtral 8x7B v0.1 instruct l2 norm post SFT pruned 1 experts
Mistral · mradermacher
Params41.1B
Context32K
Q4_K_M24.9 GB
GGUF
MI
mistralai.Ministral 3 8B Reasoning 2512
Mistral · DevQuasar
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool useVision
MI
Mistral Naberius 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Hyperion 2.1 Mistral 7B
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenMia Indo Mistral 7b v3 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dumpling Mistral Nemo 8B i1
Mistral · mradermacher
Params8.43B
Context1000K
Q4_K_M5.2 GB
Reasoning
MI
Kant Test 0.1 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.2 24B Instruct 2506 Text Only
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool use
MI
Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
neural chat 7b v3 1 dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral orpo capybara 7k
Mistral · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Backrooms Mistral 7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Reasoning 2512 heretic imatrix
Mistral · FadedRedStar
Params8.49B
Context256K
Q4_K_M5.2 GB
CodingReasoningTool use
MI
Mistral 7B v0.1 Flashback v2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MistralInstructLongish
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral epoch1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Alpaca 52k v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
avemio digital Mistral 7b orpo 3000 steps Prune
Mistral · RichardErkhov
Params5.06B
Context32K
Q4_K_M3.0 GB
GGUF
MI
speechless mistral six in one 7b orth 1.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
mistral ft optimized 1227 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mixtral 8x22b v0.1 imatrix
Mistral · ChristianAzinn
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
MI
Dolphin 2.5 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
MI
QuantumIntelligence QI mistral 7B slerp
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing