Mistral GGUF models

9355 GGUF models in the Mistral family, quantized by 2133 uploaders. Sizes run from 2M to 1050B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Small 24B Instruct 2501
Mistral · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
mergekit community Mistral Small 2501 SCE Mashup 2 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Fireball Mistral Nemo Instruct 24B merge v1 i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
brillibits_instruct_mixtral-8x7b-v0.1_dolly15k
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
azure99_blossom-v3-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B model 45k6e2e4 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
tosilos 128b
Mistral · nesilabs
Params125B
Context256K
Q4_K_M74.9 GB
ReasoningTool use
MI
Ministral 3b instruct
Mistral · QuantFactory
Params3.32B
Context128K
Q4_K_M2.0 GB
GGUF
MI
Mixtral AI Cyber 4.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Huihui Ministral 3 8B Reasoning 2512 Abliterated
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Reasoning
MI
Mistral 7B Instruct RDPO
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
DonutHole 8x7B
Mistral · ycros
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Mistral7B-PairRM-SPPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
orangetin_openhermes-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
Tool use
MI
Mistral Small 24B Instruct 2501
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
K2S3 Mistral 7b v1.4
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Berthier Mistral Military 24B
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
MI
dolphin mistral daybreak kunoichi dpo 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Mistral 7B Uncensored
Mistral · Andycurrent
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
flammenai flammen18 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
fpham_karen_theeditor_v2_creative_mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.1 Full Final
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 14B Reasoning 2512 ShiningValiant3
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
CodingReasoning
MI
mistralai_Ministral 3 8B Instruct 2512 Abliterated
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
Tool use
MI
qblocks_mistral_7b_norobots
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
Mixtral AI PsycoTron
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Ministral 3 3B Instruct 2512 Roleplay Tuned ERP Tolerant
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
RoleplayVision
MI
Mistral-C2F-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Karen TheEditor V2 CREATIVE Mistral 7B absolute heresy i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing