Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
neural chat 7b v3 1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3_2 24B Instruct 2506 Antislop
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
CorticalStack mistral 7b openhermes 2.5 sft
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
NeuralHermes 2.5 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mlfoundations dev hp ablations grid mistral bsz1024 lr2e 6 scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler linear warmup0.10
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 8B Instruct 2410 Abliterated
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
MI
Configurable-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral nemo kartoffel PRUNE
Mistral · mradermacher
Params10.1B
Context1000K
Q4_K_M6.2 GB
GGUF
MI
Mistral modelstock2 24B
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mistral Small 4 119B 2603
Mistral · fajardc
Params119B
Context1024K
Smallest52.1 GB
ReasoningTool useVision
MI
Ministral 3 3B Instruct 2512 Heresy Unfiltered
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
MI
Chinese Mistral 7B v0.1
Mistral · RichardErkhov
Params7.5B
Context32K
Q4_K_M4.5 GB
GGUF
MI
GreenNode mini 7B v1olet Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-hwgrlbs
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral Nemo Instruct 17B Claude High Reasoning EXTREME
Mistral · mradermacher
Params17.4B
Context128K
Q4_K_M10.6 GB
ReasoningTool use
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Papa mistral
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
Tess-2.0-Mixtral-v0.2
Mistral · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
Zero Mistral 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Mahou-1.2b-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
una cybertron 7b v3 OMA Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.3 GGUF smashed
Mistral · PrunaAI
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MNCJ1hun Mistral 7B OP u1k ver0.4
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1
Mistral · adamksn
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Search Sft Mistral Small 24B Instruct 2501
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler linear warmup0.10 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing