Q2_K_L GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 2217 models have a Q2_K_L file. Sizes run from 80M to 1030B parameters. The longest trained context is 10240K tokens.
LL
Llama 3.1 SuperNova Lite
Llama · Felladrin
Params8.03B
Context128K
Smallest3.7 GB
VO
voxpage 8k v2
Voxpage · simbolmina
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
mango 1.0
Qwen · ToldByNun
Params27.3B
Context256K
Smallest12.1 GB
GE
gemma ncert E2B
Gemma · iamsiddj
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
Qwen3.5 35B A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest12.9 GB
CU
customer support intent classification
Customer · Darkknight005
Params1B
Context32K
Smallest0.7 GB
QW
Qwen3-30B-A3B-Thinking-2507
Qwen · drwhall
Params30.5B
Context256K
Q4_K_M18.6 GB
VO
voxpage 8k v3
Voxpage · simbolmina
Params4.65B
Context128K
Q4_K_M3.4 GB
QW
qwen opus test 2b
Qwen · hamishfromatech
Params1.88B
Context256K
Smallest1.1 GB
GE
namma gemma
Gemma · Sharchan
Params4.65B
Context128K
Smallest3.7 GB
VO
VoxPage 4k v2
Voxpage · simbolmina
Params4.65B
Context128K
Q4_K_M3.4 GB
PA
Patricia V3
Patricia · AndyVampiro
Params1.48B
Context4K
Smallest0.8 GB
QW
QwQ 32B Abliterated
Qwen · Manojb
Params32.8B
Context128K
Smallest13.1 GB
QW
Qwen3.5-35B-A3B
Qwen · Manojb
Params34.7B
Context256K
Smallest13.0 GB
MY
4b 1.8gb
Mypersonalpf · mypersonalpf1
Params4.21B
Context256K
Smallest2.1 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · drwhall
Params14.8B
Context128K
Q4_K_M9.0 GB
PA
Patricia V10
Patricia · AndyVampiro
Params1B
Context32K
Smallest0.7 GB
DE
Qwen2.5 32B
DeepSeek · neifuisan
Params32.8B
Context128K
Smallest13.1 GB
PA
Patricia V7
Patricia · AndyVampiro
Params1B
Context32K
Smallest0.7 GB
CU
customersupport
Customersupport · Manochithra
Params1B
Context32K
Smallest0.7 GB
QW
speedymoai6.1 4b
Qwen · Speedymule
Params4.33B
Context256K
Q4_K_M2.8 GB
TO
Ai Todo App
Todo · sayedimran
Params596M
Context40K
Smallest0.3 GB
QW
Qwen3.5 0.8B
Qwen · dkingtutcd
Params773M
Context256K
Smallest0.5 GB
QW
Qwen3TestRun
Qwen · Raresmuntenas
Params596M
Context40K
Smallest0.3 GB
IC
ICONNAI ICONN 1
Iconnai · bartowski
Params84B
Context32K
Q4_K_M50.9 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · Bosswinner
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3 Coder 30B A3B Instruct
Qwen · balajiduraisamy
Params30.5B
Context256K
Q4_K_M18.6 GB
LL
Llama 3.2 3B Instruct
Llama · balajiduraisamy
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Meta Llama 3.1 8B Instruct
Llama · balajiduraisamy
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
speedymoai6.0 4b mside
Qwen · Speedymule
Params4.33B
Context256K
Q4_K_M2.8 GB