Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
osanseviero mistral instruct frankenmerge
Mistral · RichardErkhov
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
MI
mistral nemo gutenberg 12B
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
DPOpenHermes 7B v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Openbuddy Mistral7B v19.1 4k
Mistral · mradermacher
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Base SFT IPO
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MathHermes-2.5-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
PiVoT 10.7B Mistral v0.2 RP
Mistral · RichardErkhov
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
MI
abhishek autotrain xva0j mixtral8x7b
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Hercules-2.0-Mistral-7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Voxtral Mini 3B 2507
Mistral · mradermacher
Params4.01B
Context128K
Q4_K_M2.5 GB
Tool use
MI
Andrewwwwww Nous Hermes 2 Mixtral 8x7B DPO
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 minlr1e 7 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B claude chat
Mistral · Undi95
Params7.24B
Context32K
Smallest4.1 GB
GGUF
MI
Codestral 22B v0.1
Mistral · PrunaAI
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
MI
dolphin 2.8 mistral 7b v02
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Contextual_KTO_Mistral_PairRM
Mistral · asedmammad
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
AZERG T3 Mistral
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistral 7b openplatypus i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7b Therapist
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NebulaNet v2 4x7B moe
Mistral · davideuler
Params24.2B
Context32K
Smallest8.8 GB
GGUF
MI
Candle CollectiveCognition v1.1 Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
ReWiz 7B
Mistral · theprint
Params7.25B
Context32K
Q4_K_M4.4 GB
ReasoningTool use
MI
K2S3 Mistral 7bx2 48layers_v1.2
Mistral · mradermacher
Params10.9B
Context32K
Q4_K_M6.6 GB
GGUF
MI
mlfoundations dev hp ablations mistral adambeta2 0.95
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 8B Instruct 2410
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
Mistral Portuguese Luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nous mistral orca 7B
Mistral · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Mistral Instruct Y24 v6
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral-60m
Mistral · RichardErkhov
Params60M
Context4K
Q4_K_M0.0 GB
GGUF
MI
Mistral Nemo Kurdish i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use

Keep browsing