Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b expert iteration iter3
Mistral · Corianas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Multitalk_rp_Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
AZERG MixTask Mistral
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistral rrc
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
laser dolphin mixtral 4x7b dpo
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo-laser
Mistral · Pokoinick
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin Mistral 24B Venice Edition Thinking
Mistral · blinkdotwav
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 minlr5e 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 3B Reasoning 2512
Mistral · EnlistedGhost
Params3.43B
Context256K
Q4_K_M2.2 GB
ReasoningVision
MI
Mistral 7B model 45k6e2e4 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NeuraLake m7 AshhLimaRP Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Flammades Mistral Nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
MistralThinker AntiRep 24B v1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Education Middle Mistral 7B Instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MistralHermesPipe-7B-slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Ministral 8b Abliterated
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral_7Bx5_MoE_30B
Mistral · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
GGUF
MI
OpenMia Indo Mistral 7b v3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · gaianet
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral 7B ScaleQuest
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hyperion 2.1 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ektome Mistral 7B Instruct v0.2 PristinelyUncensored
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral small 3.2 24B Instruct Abliterated Q4 K M
Mistral · fabhaus
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool use
MI
nilq baby python mistral 1L tiny TinyStories ft
Mistral · RichardErkhov
Params35M
Context2K
Q4_K_M0.0 GB
GGUF
MI
mistral nemo kartoffel PRUNE2
Mistral · mradermacher
Params9.52B
Context1000K
Q4_K_M5.8 GB
GGUF
MI
bullerwins Codestral 22B v0.1 hf
Mistral · RichardErkhov
Params22B
Context—
Q4_K_M0.0 GB
Coding

Keep browsing