Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
dongyru Mistral 7B Claim Extractor
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B v0.1 turkish
Mistral · sayhan
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Juud Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small Drummer 22B i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
MI
Dionysus Mistral M3 v5
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Moderne 12B FFT experimental
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
internlm2-math-plus-mixtral8x22b
Mistral · lmstudio-community
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
MI
Mistral 7B Merge 02 v0
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
MI
DoppelKartoffel Mistral Nemo 23B i1
Mistral · mradermacher
Params23.2B
Context1000K
Q4_K_M14.0 GB
Reasoning
MI
Mixtral v0.1 8x7B Instruct
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
cognitivecomputations dolphin 2.2.1 mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler inverse sqrt dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 2407 Heretic Noslop MPOA
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MI
Mistral 7B CrewAI
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · mradermacher
Params5.5B
Context32K
Q4_K_M3.3 GB
GGUF
MI
Mistral Nemo 12B ArliAI RPMax v1.1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated
Mistral · therummage
Params23.6B
Context128K
Smallest25.1 GB
Tool useVision
MI
Huihui ai.Dolphin3.0 R1 Mistral 24B Abliterated
Mistral · DevQuasar-7
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
mistral nemo gutenberg 12B v3
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
bineric NorskGPT Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral_Pro_8B_v0.1
Mistral · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
MI
ziniuli/Mistral-7B-ReMax-v0.1
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
ANIMA Cognitive Mistral v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
T3Q Platypus MistralM7 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
malaysian-mistral-7b-32k-instructions
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
ANIMA Nectar v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
merlinite 7b
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.2 24B Character Creator V2
Mistral · SufficientPrune3897
Params23.6B
Context128K
Q4_K_M14.3 GB
RoleplayTool use
MI
MetaMath Chupacabra 7B v2.01 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NeuralMonarchCoderPearlBeagle T3Q Mistral Orca Math DPO 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding

Keep browsing