Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
AlexeyRyzhikov mistral7b text to json v5.20
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral-7b-ft-h4-no_robots_instructions
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Grand R1 Dolphin 3.0 Deep Reasoning Brainstorm 45B
Mistral · mradermacher
Params45.2B
Context32K
Q4_K_M27.4 GB
Reasoning
MI
Mistral 7B Parasite
Mistral · ApolloRaines
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Fireball Mistral Nemo evol Instruct 14B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
WizardMath 7B V1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral nemo gutades 12B i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
CatMacaroni Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2 turkish
Mistral · sayhan
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Commonsense QA Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Heretic
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B Instruct demi merge v0.2 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral ko 7B v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Cydonia 24B v3.1
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
Reasoning
MI
Mistral Nemo Instruct 2407
Mistral · RichardErkhov
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mistral Small 24B Instruct 2501 S1 Multilang
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
ANIMA Phi Neptune Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.3
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 minlr1e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hyperion 1.5 Mistral 7B iMat
Mistral · InferenceIllusionist
Params7.24B
Context32K
Smallest2.3 GB
GGUF
MI
Densefin 291 Mistral 22B
Mistral · mradermacher
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
MI
BugTraceAI CORE Pro
Mistral · BugTraceAI
Params12.2B
Context128K
Smallest7.5 GB
Tool use
MI
Mistral Nemo Instruct 2407 OmniWriter
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
Free_Sydney_V2_Mistral_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · second-state
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Dolphin Mistral 24B Venice Edition
Mistral · Yixman
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral 11b Slimorca
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
hydra project OpenHyperion 2.5 Mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.2 Turkish
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing