Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Dolphin 2.6 Mistral 7b Dpo Laser
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral nemo gutenberg 12B v2
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Magistral Small 2509 Ultra Uncensored Heretic v2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
cgato_thespis-mistral-7b-alpha-v0.7
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--MaziyarPanahi--zephyr-7b-beta-Mistral-7B-Instruct-v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SciPhi Self RAG Mistral 7B 32k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openbuddy_openbuddy-mixtral-8x7b-v15.2
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
MI
StructLM 7B Mistral
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Pantheon Rp 1.5 12b Nemo
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Nemo Instruct 2407 12B Thinking M Claude Opus High Reasoning
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Large Instruct 2407
Mistral · mmnga
Params123B
Context32K
Smallest26.0 GB
MI
Mistral Large Instruct 2407
Mistral · RichardErkhov
Params123B
Context128K
Q4_K_M73.2 GB
MI
Helcyon Saturn
Mistral · XeyonAI
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
openbuddy_openbuddy-mistral-7b-v13-base
Mistral · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 12B Philosophy Math i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Tess XS v1 3 yarn 128K Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-adolxhj
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Magistral Small 2507 DASHQ Q2
Mistral · jkim96
Params23.6B
Context40K
Smallest6.8 GB
MI
Mixtral Mini AI
Mistral · mradermacher
Params3.75B
Context32K
Q4_K_M2.3 GB
MI
mixtral
Mistral · hfl
Params46.7B
Context32K
Smallest9.8 GB
MI
mistralai_Ministral 3 8B Instruct 2512 Abliterated
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral Small Instruct 2409
Mistral · legraphista
Params22.2B
Context128K
Smallest4.8 GB
MI
Mistral 11B Instruct v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
T3Q Merge Mistral7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Batman Venom V7
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
ilyagusev_saiga_mistral_7b_merged
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CWC Mistral Nemo 12B V2 q4 k m
Mistral · CWClabs
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mini Mixtral v0.2
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
flammenai flammen9 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 8B Reasoning 2512
Mistral · ggml-org
Params8.49B
Context256K
Smallest9.0 GB