Mistral GGUF models
9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.
MI
Mistral Small 24B Instruct 2501
Mistral · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
mergekit community Mistral Small 2501 SCE Mashup 2 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
Fireball Mistral Nemo Instruct 24B merge v1 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
brillibits_instruct_mixtral-8x7b-v0.1_dolly15k
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
azure99_blossom-v3-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B model 45k6e2e4 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
tosilos 128b
Mistral · nesilabs
Params125B
Context256K
Q4_K_M74.9 GB
MI
Ministral 3b instruct
Mistral · QuantFactory
Params3.32B
Context128K
Q4_K_M2.0 GB
MI
Mixtral AI Cyber 4.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Huihui Ministral 3 8B Reasoning 2512 Abliterated
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral 7B Instruct RDPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
DonutHole 8x7B
Mistral · ycros
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Mistral7B-PairRM-SPPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
orangetin_openhermes-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
K2S3 Mistral 7b v1.4
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
MI
Berthier Mistral Military 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
MI
dolphin mistral daybreak kunoichi dpo 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Mistral 7B Uncensored
Mistral · Andycurrent
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
flammenai flammen18 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
fpham_karen_theeditor_v2_creative_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct v0.1 Full Final
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 14B Reasoning 2512 ShiningValiant3
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
MI
mistralai_Ministral 3 8B Instruct 2512 Abliterated
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
qblocks_mistral_7b_norobots
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral AI PsycoTron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ministral 3 3B Instruct 2512 Roleplay Tuned ERP Tolerant
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
Mistral-C2F-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Karen TheEditor V2 CREATIVE Mistral 7B absolute heresy i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB