Q4_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1891 models have a Q4_K_L file. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.
NE
Dory1.0 4B BF16 Llamacpp
Nemotron · cloudnathan5
Params3.98B
Context256K
Q4_K_M2.4 GB
CY
Cydonia R1 24B v4
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
BA
Basal Omni 1.0 Ultra
Basal · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
DA
Dans PersonalityEngine v1.0.0 8b
Dans · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GE
Amoral Gemma3 12B v2
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GL
GLM Z1 Rumination 32B 0414
GLM · bartowski
Params33.1B
Context128K
Q4_K_M20.0 GB
KE
cognition ai Kevin 32B
Kevin · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
GL
GLM 4 32B Base 32K
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
GR
Granite 3.0 8b Lab Community
Granite · bartowski
Params8.17B
Context4K
Q4_K_M4.9 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
SK
Skywork OR1 32B Preview
Skywork · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
WR
writing roleplay 20k context nemo 12b v1.0
Writing · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3.1 8B ArliAI RPMax v1.3
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
NE
Nemotron 3 Nano 4B
Nemotron · bartowski
Params3.97B
Context1024K
Q4_K_M3.0 GB
SN
Snowflake Arctic Embed L v2.0
Snowflake · Casual-Autopsy
Params567M
Context8K
Q4_K_M0.4 GB
QW
trashpanda org QwQ 32B Snowdrop v0
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.8 GB
FA
Fara 7B
Fara · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
NE
OpenMath Nemotron 14B Kaggle
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
TA
UI TARS 2B SFT
Tars · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
CO
C4Ai Command A 03 2025
Command R · bartowski
Params111B
Context16K
Q4_K_M67.1 GB
JE
Jebadiah 9b v2 1
Jebadiah · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
CO
ContextPilot 14B
Contextpilot · bartowski
Params14.8B
Context40K
Q4_K_M9.3 GB
CY
Cydonia 24B v3
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
VE
Q25 1.5B VeoLu
Veolu · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
QW
32B Qwen2.5 Kunou v1
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen2.5 Gutenberg Doppel 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GR
Grug 35b
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
GR
Granite 3.3 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB