Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b expert iteration iter3
Mistral · Corianas
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Multitalk_rp_Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
AZERG MixTask Mistral
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
mistral rrc
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
laser dolphin mixtral 4x7b dpo
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo-laser
Mistral · Pokoinick
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin Mistral 24B Venice Edition Thinking
Mistral · blinkdotwav
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 minlr5e 7
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 3B Reasoning 2512
Mistral · EnlistedGhost
Params3.43B
Context256K
Q4_K_M2.2 GB
MI
Mistral 7B model 45k6e2e4 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NeuraLake m7 AshhLimaRP Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Flammades Mistral Nemo 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
MistralThinker AntiRep 24B v1
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Education Middle Mistral 7B Instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MistralHermesPipe-7B-slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 8b Abliterated
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral_7Bx5_MoE_30B
Mistral · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
MI
OpenMia Indo Mistral 7b v3
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407
Mistral · gaianet
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral 7B ScaleQuest
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hyperion 2.1 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ektome Mistral 7B Instruct v0.2 PristinelyUncensored
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral small 3.2 24B Instruct Abliterated Q4 K M
Mistral · fabhaus
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
nilq baby python mistral 1L tiny TinyStories ft
Mistral · RichardErkhov
Params35M
Context2K
Q4_K_M0.0 GB
MI
mistral nemo kartoffel PRUNE2
Mistral · mradermacher
Params9.52B
Context1000K
Q4_K_M5.8 GB
MI
bullerwins Codestral 22B v0.1 hf
Mistral · RichardErkhov
Params22B
Context—
Q4_K_M0.0 GB