Q4_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1891 models have a Q4_K_L file. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
my_QwQ 32B Preview Abliterated Linear50
Qwen · pipihand01
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
HA
Hathor Sofit L3 8B v1
Hathor · Reiterate3680
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 397B A17B heretic
Qwen · dxx117
Params396B
Context256K
Smallest130.5 GB
ReasoningTool use
QW
my_QwQ 32B Preview Abliterated Linear75
Qwen · pipihand01
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
LL
Llama 3.2 1B Instruct
Llama · asad959191
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
QW
Qwen3.5 2B
Qwen · Manojb
Params1.88B
Context256K
Smallest1.5 GB
ReasoningTool useVision
PH
Phi 4 Mini Instruct
Phi · lucasxie2025
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
PH
Phi 3.1 mini 4k instruct
Phi · fjguodong
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
GE
Gemma 4 31B nomDePlume
Gemma · MRockatansky
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
QW
Qwen3.5 4B
Qwen · Manojb
Params4.21B
Context256K
Smallest3.0 GB
ReasoningTool useVision
PR
Precog Maxxed 31B
Precog · MRockatansky
Params31.4B
Context128K
Smallest0.0 GB
GGUF
GE
Testing
Gemma · Bax-uzi
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
RO
Rocinante 12B v1.1
Rocinante · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
QW
Qwen3.5 0.8B
Qwen · Manojb
Params752M
Context256K
Smallest0.6 GB
ReasoningTool useVision
QW
Qwen3.6 27B Omnimerge v4 MTP
Qwen · fribourgquant
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
HE
Kainaticulous Rp 7b
Hexoteric · kainatq
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MA
MagnumV2
Magnumv · Nazosan
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
QW
QwenPaw Flash 9B heretic MTP
Qwen · daydreamwarrior
Params9.2B
Context256K
Smallest6.1 GB
ReasoningTool use
LL
Llama 3.2 1B Instruct
Llama · Electro0023
Params1.24B
Context128K
Smallest0.9 GB
Tool use
LI
Ling Mini 2.0
Ling · Manojb
Params16.3B
Context32K
Smallest10.2 GB
ReasoningTool use
HO
Hollow Tail V1 12B
Hollow · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
IM
imatrix jpn test
Imatrix · dahara1
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
EU
L3.1 70B Euryale v2.2
Euryale · Reiterate3680
Params70.6B
Context128K
Smallest31.9 GB
GGUF
RO
Rocinante 12B v1b
Rocinante · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
Tool use
QW
QwenPaw Flash 9B heretic
Qwen · daydreamwarrior
Params8.95B
Context256K
Smallest5.9 GB
ReasoningTool use
HA
Hathor Trihexa L3 8B Anarchy Edition
Hathor · Reiterate3680
Params8.03B
Context8K
Smallest5.3 GB
GGUF
MA
Magnum 12b v2
Magnum · Reiterate3680
Params12.2B
Context1000K
Smallest8.0 GB
GGUF
LU
Lumimaid v0.2 8B
Lumimaid · Reiterate3680
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama 3.3 70B Instruct
Llama · tphage
Params70.6B
Context128K
Smallest43.3 GB
Tool use
QW
Animica Agent 2B
Qwen · animicaorg
Params135M
Context256K
Q4_K_M1.3 GB
Tool use

Other quants

Keep browsing