Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
osanseviero mistral instruct frankenmerge
Mistral · RichardErkhov
Params8.99B
Context32K
Q4_K_M5.4 GB
MI
mistral nemo gutenberg 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
DPOpenHermes 7B v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Openbuddy Mistral7B v19.1 4k
Mistral · mradermacher
Params7.28B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Base SFT IPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MathHermes-2.5-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
PiVoT 10.7B Mistral v0.2 RP
Mistral · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
abhishek autotrain xva0j mixtral8x7b
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Hercules-2.0-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Voxtral Mini 3B 2507
Mistral · mradermacher
Params4.01B
Context128K
Q4_K_M2.5 GB
MI
Andrewwwwww Nous Hermes 2 Mixtral 8x7B DPO
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 minlr1e 7 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B claude chat
Mistral · Undi95
Params7.24B
Context32K
Smallest4.1 GB
MI
Codestral 22B v0.1
Mistral · PrunaAI
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
dolphin 2.8 mistral 7b v02
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Contextual_KTO_Mistral_PairRM
Mistral · asedmammad
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
AZERG T3 Mistral
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b openplatypus i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7b Therapist
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NebulaNet v2 4x7B moe
Mistral · davideuler
Params24.2B
Context32K
Smallest8.8 GB
MI
Candle CollectiveCognition v1.1 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ReWiz 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
K2S3 Mistral 7bx2 48layers_v1.2
Mistral · mradermacher
Params10.9B
Context32K
Q4_K_M6.6 GB
MI
mlfoundations dev hp ablations mistral adambeta2 0.95
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 8B Instruct 2410
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
Mistral Portuguese Luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nous mistral orca 7B
Mistral · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Mistral Instruct Y24 v6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral-60m
Mistral · RichardErkhov
Params60M
Context4K
Q4_K_M0.0 GB
MI
Mistral Nemo Kurdish i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB