Q3_K_M GGUF models
3-bit k-quant, medium. Small files with some quality loss. 108680 models have a Q3_K_M file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.
LA
m51Lab MiniMax M2.7 REAP 139B A10B
Lab · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
GE
avemio digital gemma 2b Sft pretrain 6000 steps merge
Gemma · RichardErkhov
Params2.5B
Context8K
Q4_K_M1.6 GB
IN
InternVL3_5 8B
Internvl · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
codellama_codellama-13b-instruct-hf
Llama · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GE
gemma 4 E2B it
Gemma · AtomicChat
Params4.65B
Context128K
Q4_K_M3.4 GB
HU
Humanizer
Humanizer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 2 9b It
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
ON
OneJev 27B
Onejev · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
QW
Qwen3.8 27B
Qwen · prithivMLmods
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 27b It Abliterated
Gemma · mlabonne
Params27B
Context128K
Q4_K_M16.5 GB
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · llmfan46
Params79.7B
Context256K
Q4_K_M49.8 GB
GE
Gemma 3 27b It Qat
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
CA
causallm_7b
TheBloke
Params7.72B
Context8K
Q4_K_M4.8 GB
FA
FastH3 Omni
Fasth · Abiray
Params22.1B
Context—
Q4_K_M12.7 GB
SM
SmolLM2 135M
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
MI
MiniCPM5 2B
MiniCPM · bartowski
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
WI
wizardlm_wizardcoder-python-34b-v1.0
Wizardcoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
GE
Gemma 3 12b It Heretic v2
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
QW
Qwen3.5 9B Heretic v2
Qwen · filvyb
Params8.95B
Context256K
Q4_K_M5.6 GB
KR
Krea 2 Turbo
Krea · Abiray
Params12.9B
Context—
Q4_K_M7.5 GB
DE
deepseek-ai_deepseek-coder-6.7b-base
DeepSeek · TheBloke
Params6.74B
Context16K
Q4_K_M4.1 GB
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
GE
gemma-2-27b-it
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
JA
JackOD 9B Coder
Jackod · ManniX-ITA
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GP
Gpt Oss 120b Uncensored
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB