Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Ministral 3 3B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mistral 7B v0.3 Middo Alpaca 4o Mini
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
PVD 160k Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss-dare-ties
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
K2S3 Mistral 7b v1.48
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
MI
Mixtral_13B_Chat_RAG Reader
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Ministral 3 3B Instruct 2512 roleplay tuned ERP tolerant
Mistral · Indexnusrefather
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
lvkaokao_mistral-7b-finetuned-orca-dpo-v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MistralPrism 24B
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Ministral 3B Heresy Unfiltered
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mahou-1.3-M1-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral-3-8B-Nymphaea-RP
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
cloudyu_mixtral_7bx2_moe
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.3 GB
MI
allura org Mistral Small 24b Sertraline 0304
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mixtral AI Ultron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Devstral 2505 CODER Brainstorm40x 44B
Mistral · mradermacher
Params43.6B
Context128K
Q4_K_M26.4 GB
MI
mistral nemo wissenschaft 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mahou-1.3-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 4 119B 2603
Mistral · mradermacher
Params119B
Context1024K
Q4_K_M72.2 GB
MI
Mistral 7B Instruct v0.3 Abliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
vagosolutions_sauerkrautlm-mixtral-8x7b-instruct
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Hermes 2 Pro Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mathstral 7B v0.1
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 3B Claude Opus Reasoning Distilled
Mistral · xtools-at
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mistral-Finnish-Alpaca-V1-7B
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small 3.2 24B Instruct 2506 Absolute Heresy
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
zubr mini 1.9 3b
Mistral · alekringtonnn-ai
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
kolibri mistral 0427 2
Mistral · kaleinaNyan
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SlimHercules-4.0-Mistral-7B-v0.2
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB