Q3_K_M GGUF models
3-bit k-quant, medium. Small files with some quality loss. 108680 models have a Q3_K_M file. Sizes run from 1M to 2780B parameters. The longest trained context is 4194304K tokens.
MI
nousresearch_yarn-mistral-7b-128k
Mistral · TheBloke
Params7.24B
Context128K
Q4_K_M4.4 GB
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
WE
WeVisOne VL 4B
Wevisone · mradermacher
Params4.42B
Context256K
Q4_K_M2.7 GB
NO
Noema 1.5 4B Fast
Noema · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
HE
Hermes 4 14B
Hermes · gabriellarson
Params14.8B
Context40K
Q4_K_M9.0 GB
LT
LTX2.3 10Eros 1.4 Split
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
CY
CyberStag Security 26B A4B V1 Uncensored Heretic
Cyberstag · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
MI
TowerInstruct Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AR
Artemis 31B v1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
TO
ToriiGate 0.5
Toriigate · DraconicDragon
Params4.84B
Context256K
Q4_K_M3.1 GB
LF
LFM2 VL 450M
Lfm · bartowski
Params354M
Context125K
Q4_K_M0.2 GB
DA
danube3-4B
Danube · h2oai
Params3.96B
Context8K
Q4_K_M2.4 GB
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
NO
Nock Coder 1.5b
Nock · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
JE
Jebadiah 27b v2 1
Jebadiah · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · ArliAI
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Humanish Roleplay Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
NE
Neuralgamma 2.5 7B slerp
Neuralgamma · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Qwen3.8 4B Agentic Distill
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
Firefly Llama2 13B v1.2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
FR
FrogNano 4B 2609
Frognano · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
OR
Ornith 1.5 9B Heretic
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ED
EduMixtral 4x7B i1
Edumixtral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
QW
Qwen3 VL Reranker 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
TI
tinyllama_tinyllama-1.1b-intermediate-step-1431k-3t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
DE
Deepseek-Tng-R1T2-Chimera
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
VI
Vikhr Nemo 12B Instruct R 21 09 24
Vikhr · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
MI
Mahou-1.2a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
14B Qwen2.5 Kunou v1
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CH
Chiboard 1.1 0.8b
Chiboard · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB