Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Dolphin 2.6 Mistral 7b Dpo Laser
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral nemo gutenberg 12B v2
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Magistral Small 2509 Ultra Uncensored Heretic v2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningTool use
MI
cgato_thespis-mistral-7b-alpha-v0.7
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--MaziyarPanahi--zephyr-7b-beta-Mistral-7B-Instruct-v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SciPhi Self RAG Mistral 7B 32k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openbuddy_openbuddy-mixtral-8x7b-v15.2
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
GGUF
MI
StructLM 7B Mistral
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Pantheon Rp 1.5 12b Nemo
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
MI
Mistral Nemo Instruct 2407 12B Thinking M Claude Opus High Reasoning
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
MI
Mistral Large Instruct 2407
Mistral · mmnga
Params123B
Context32K
Smallest26.0 GB
GGUF
MI
Mistral Large Instruct 2407
Mistral · RichardErkhov
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
MI
Helcyon Saturn
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MI
openbuddy_openbuddy-mistral-7b-v13-base
Mistral · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Instruct 12B Philosophy Math i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
MI
Tess XS v1 3 yarn 128K Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
models--mergekit-community--mergekit-slerp-adolxhj
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Magistral Small 2507 DASHQ Q2
Mistral · jkim96
Params23.6B
Context40K
Smallest6.8 GB
ReasoningTool use
MI
Mixtral Mini AI
Mistral · mradermacher
Params3.75B
Context32K
Q4_K_M2.3 GB
GGUF
MI
mixtral
Mistral · hfl
Params46.7B
Context32K
Smallest9.8 GB
GGUF
MI
mistralai_Ministral 3 8B Instruct 2512 Abliterated
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Tool use
MI
Mistral Small Instruct 2409
Mistral · legraphista
Params22.2B
Context128K
Smallest4.8 GB
Tool use
MI
Mistral 11B Instruct v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
T3Q Merge Mistral7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Nemo Batman Venom V7
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RoleplayTool use
MI
ilyagusev_saiga_mistral_7b_merged
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CWC Mistral Nemo 12B V2 q4 k m
Mistral · CWClabs
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
Mini Mixtral v0.2
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
flammenai flammen9 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 8B Reasoning 2512
Mistral · ggml-org
Params8.49B
Context256K
Smallest9.0 GB
ReasoningTool useVision

Keep browsing