Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Candle airoboros mistral2.2 7b
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
MI
Mistral Ministral 3 8B Instruct
Mistral · NobodyWho
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral 7B Merge 14 v0.3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Yarn Mistral 7b 64k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Speechless Thoughts Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Cerebrum 1.0 10.7B
Mistral · bartowski
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
Mistral grok instract 2 7B slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B v0.1 instruct pruned random 2 experts
Mistral · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
MI
Bellman 7b Mistral Instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
ebinzack15 mistral 7b finance v1.x mergedmodel
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
RAG KO Mixtral 7Bx2 v1.15
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Mistral-C64Wizard-instruct
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-werhsur
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral stargate i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin 2.6 Mistral 7b Dpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Saul Nous Hermes 2 Mistral 7B DPO Ties
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Soar Mistral 123b
Mistral · mradermacher
Params123B
Context128K
Smallest26.0 GB
MI
Ministral 3 14B Reasoning 2512 DASHQ Q2
Mistral · jkim96
Params13.5B
Context256K
Smallest4.1 GB
MI
Mistral 7B v0.1
Mistral · shahzeb171
Params7.24B
Context32K
Smallest2.7 GB
MI
Mistral quiet star demo
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations grid mistral bsz2048 lr5e 6 scheduler cosine warmup0.15
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral T5 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
mlfoundations dev hp ablations mistral lr1e 6 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mlfoundations dev hp ablations mistral scheduler cosine warmup0.05 dcftv1.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SherlockAssistant/Mistral-7B-Instruct-Ukrainian
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Piotrasz mistral 25 ROME en FINAL
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
mychen76 mistral 7b merged ties
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct Uz
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
CoEvol ChatGPT_Mistral 7B v0.1_SFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB