Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Candle airoboros mistral2.2 7b
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
MI
Mistral Ministral 3 8B Instruct
Mistral · NobodyWho
Params8.49B
Context256K
Q4_K_M5.2 GB
Tool useVision
MI
Mistral 7B Merge 14 v0.3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
MI
Yarn Mistral 7b 64k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Speechless Thoughts Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Cerebrum 1.0 10.7B
Mistral · bartowski
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
Mistral grok instract 2 7B slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B v0.1 instruct pruned random 2 experts
Mistral · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
GGUF
MI
Bellman 7b Mistral Instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
ebinzack15 mistral 7b finance v1.x mergedmodel
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
RAG KO Mixtral 7Bx2 v1.15
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Mistral-C64Wizard-instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-werhsur
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistral stargate i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Dolphin 2.6 Mistral 7b Dpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
Saul Nous Hermes 2 Mistral 7B DPO Ties
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Soar Mistral 123b
Mistral · mradermacher
Params123B
Context128K
Smallest26.0 GB
CodingTool use
MI
Ministral 3 14B Reasoning 2512 DASHQ Q2
Mistral · jkim96
Params13.5B
Context256K
Smallest4.1 GB
ReasoningTool use
MI
Mistral 7B v0.1
Mistral · shahzeb171
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Mistral quiet star demo
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations grid mistral bsz2048 lr5e 6 scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral T5 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral lr1e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SherlockAssistant/Mistral-7B-Instruct-Ukrainian
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Piotrasz mistral 25 ROME en FINAL
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mychen76 mistral 7b merged ties
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct Uz
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
CoEvol ChatGPT_Mistral 7B v0.1_SFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing