Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mahou-1.2a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Luau Devstral 24B Instruct v0.2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Mistral Medium 3.5 128B Desiccated
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
MI
Mistral Nemo Instruct 2407 abliterated
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
mistral 7b v0.3 llama tokens
Mistral · Deeokay
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
mistralai Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Prism 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dolphin3.0 Mistral 24B
Mistral · rax4901
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mistral-7B-v0.3-Chinese-Chat-uncensored
Mistral · stephenlzc
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Gukbap Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Sydney_Pirate_Mistral_7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistralai_Ministral 3 3B Reasoning 2512
Mistral · lmstudio-community
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
yeungnlp_firefly-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
dolphin 2.8 mistral 7b v02
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openbuddy_openbuddy-mixtral-8x7b-v15.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
MI
flammenai flammen20 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Codestral-21B-Pruned
Mistral · mradermacher
Params21.5B
Context32K
Q4_K_M12.8 GB
MI
Mistral Trismegistus 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Nemo Instruct 2407
Mistral · unsloth
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Devstral Small 2507 Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
MI
chargoddard_mixtralrpchat-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Mistral 7B ReMax v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
teknium_collectivecognition-v1-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b v0.1
Mistral · neopolita
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 3B Instruct 2512
Mistral · EnlistedGhost
Params3.43B
Context256K
Smallest1.3 GB
MI
Mistral Nemo 12B Instruct 2407
Mistral · starble-dev
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
bophades mistral truthy DPO 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB