Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Ministral 3 3B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
MI
Mistral 7B v0.3 Middo Alpaca 4o Mini
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
PVD 160k Mistral 7b
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss-dare-ties
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
K2S3 Mistral 7b v1.48
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Mixtral_13B_Chat_RAG Reader
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Ministral 3 3B Instruct 2512 roleplay tuned ERP tolerant
Mistral · Indexnusrefather
Params3.43B
Context256K
Q4_K_M2.1 GB
RoleplayVision
MI
Mistral-7B-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
lvkaokao_mistral-7b-finetuned-orca-dpo-v2
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MistralPrism 24B
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
Ministral 3B Heresy Unfiltered
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
MI
Mahou-1.3-M1-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral-3-8B-Nymphaea-RP
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Roleplay
MI
cloudyu_mixtral_7bx2_moe
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.3 GB
GGUF
MI
allura org Mistral Small 24b Sertraline 0304
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingReasoning
MI
Mixtral AI Ultron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingReasoningRoleplay
MI
Mistral Devstral 2505 CODER Brainstorm40x 44B
Mistral · mradermacher
Params43.6B
Context128K
Q4_K_M26.4 GB
Coding
MI
mistral nemo wissenschaft 12B
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mahou-1.3-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 4 119B 2603
Mistral · mradermacher
Params119B
Context1024K
Q4_K_M72.2 GB
GGUF
MI
Mistral 7B Instruct v0.3 Abliterated
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
MI
vagosolutions_sauerkrautlm-mixtral-8x7b-instruct
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
Hermes 2 Pro Mistral 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mathstral 7B v0.1
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 3B Claude Opus Reasoning Distilled
Mistral · xtools-at
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool useVision
MI
Mistral-Finnish-Alpaca-V1-7B
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small 3.2 24B Instruct 2506 Absolute Heresy
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
MI
zubr mini 1.9 3b
Mistral · alekringtonnn-ai
Params3.43B
Context256K
Q4_K_M2.1 GB
Tool useVision
MI
kolibri mistral 0427 2
Mistral · kaleinaNyan
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SlimHercules-4.0-Mistral-7B-v0.2
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing