Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Nondzu Mistral 7B codealpaca lora
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Shastra Mistral Math Commonsense TIES
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DopeorNope Mistralopithecus v0.1 10.8B
Mistral · RichardErkhov
Params10.8B
Context32K
Q4_K_M6.5 GB
GGUF
MI
magistral-small-2507
Mistral · mistralai
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
MI
cognitivecomputations.Dolphin Mistral 24B Venice Edition
Mistral · DevQuasar
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Teeny Tiny Mixtral
Mistral · mradermacher
Params3.16B
Context32K
Q4_K_M1.9 GB
GGUF
MI
mistral 7B navigation
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NousResearch Nous Hermes 2 Mixtral 8x7B DPO
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
Mixtral 4x7B Instruct v0.1
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
LeroyDyer/Mixtral_AI_Cyber_Matrix_2_0
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
German RAG MISTRAL 7B v3.0 SFT HESSIAN AI
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Reasoning
MI
smartyplats 7b v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mindy 7b v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hyperion 2.0 Mistral 7B
Mistral · Goekdeniz-Guelmez
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Blockrank Msmarco Mistral 7b
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
EmbeddingTool use
MI
Mistral NeMo Minitron 8B Chat
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
Tool use
MI
Mixtral_AI_CyberTron_Ultra
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingReasoningRoleplay
MI
CapybaraHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Codestral-22B-v0.1-hf
Mistral · gaianet
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
cognitivecomputations dolphin 2.6 mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
LMCocktail Mistral 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 14B Nymphaea RP Heretic
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
RoleplayTool use
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral epoch2 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.1 24b Instruct 2503 Jackterated Hf
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
mlfoundations dev hp ablations mistral bsz1024
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Mcqa Circuit Broken
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral GQA 400m v4 4096 i1
Mistral · mradermacher
Params2.01B
Context4K
Q4_K_M1.2 GB
GGUF
MI
Openbuddy Mixtral 7bx8 v18.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.5 GB
GGUF

Keep browsing