Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Magistral Small 2509 Ultra Uncensored Heretic v2
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Hermes 2.5 Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
allura org.Mistral Small 24b Sertraline 0304
Mistral · csabakecskemeti
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Mixtral 8x7B v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral 7B Instruct DPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct KhanAcademy v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Medium 3.5 128B
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
MI
Devstral Small 2507
Mistral · gabriellarson
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
Ministral 8B Instruct 2410 Sft
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Breezeblossom v4 mistral 2x7B i1
Mistral · mradermacher
Params13.1B
Context32K
Q4_K_M8.0 GB
MI
Mixtral AI Cyber 3.1 SFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Dans PersonalityEngine V1.1.0 12b
Mistral · QuantFactory
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Shisa v2 Mistral Nemo 12B Abliterated
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Mistral Nemo Instruct 2407
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Nemo Instruct 2407
Mistral · legraphista
Params12.2B
Context1000K
Smallest3.0 GB
MI
Mistral 8B IMDB Merged
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
rank zephyr 7b v1 full
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Pixtral
Mistral · lmstudio-community
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mistral Small 24B Instruct 2501 Heretic
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Hebrew Mistral 7B 200K
Mistral · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
MI
Mistral7B PairRM SPPO Iter3 imatrix
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral portuguese luana 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral Small Instruct 2409 Abliterated
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
MI
TowerInstruct Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · QuantFactory
Params8.41B
Context8K
Q4_K_M5.1 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · duyntnet
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Magistral-Small-2507
Mistral · unsloth
Params23.6B
Context40K
Q4_K_M14.3 GB
MI
Mistral Nemo Instruct Heretic
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB