Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
DeepKarkhanis Mistral Passthrough 8L 10B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Neural-grok-dolphin-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.3 Parasite
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo 2407 Role Playing Final 4data
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10 minlr5e 7 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral bsz1024 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
sonthenguyen NeuralHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 7B Symbolic Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
nbeerbower mistral nemo gutenberg 12B
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Radintloom Mistral 7b Fusion
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B v0.1 instruct pruned random 4 experts i1
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
MI
Weyaxi MetaMath NeuralHermes 2.5 Mistral 7B Linear
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
neural chat 7b v3 2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dans AdventurousWinds Mk2 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenMia Indo Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CorticalStack mistral 7b tak stack dpo
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
saul mistral v0.1 7b slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Vikhr Nemo 12B Instruct R 21 09 24 imatrix
Mistral · liodon-ai
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.10
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ANIMA Phi Neptune Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
mistral_2X7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
DarkHelix
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Saul Nous Hermes 2 Mistral 7B DPO Ties i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Writing_Partner_Mistral_7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral_AI_CyberCoder_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Class Tutor 7b Ep3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407 abliterated i1
Mistral · 3uer
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
pucpr br Clinical BR Mistral 7B v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
loyal piano m7 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB