Q4_K_L GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 1891 models have a Q4_K_L file. Sizes run from 30M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TQ
Tqwendo 36b
Tqwendo · bartowski
Params35.7B
Context32K
Q4_K_M21.6 GB
CodingTool use
SE
Sekhmet_Bet L3.1 8B v0.2
Sekhmet · Reiterate3680
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 4 Gembrain 31B
Gemma · phruut
Params30.7B
Context256K
Smallest18.8 GB
ReasoningRoleplayTool use
QW
Qwen3.6 27B Omnimerge v4
Qwen · shaffhausen
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
GE
Gemma 4 E2B It
Gemma · Capsulanet
Params4.65B
Context128K
Q4_K_M3.5 GB
ReasoningTool useVision
LL
Llama 3.2 1B Instruct
Llama · sir0min
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
QW
Qwen3.5 9B
Qwen · Manojb
Params8.95B
Context256K
Smallest6.6 GB
ReasoningTool useVision
LL
Llama-3-8B-Stroganoff
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GL
GLM 4.5 Air Derestricted
GLM · TMNE
Params110B
Context128K
Q4_K_M73.5 GB
ReasoningTool use
GE
Gemma 4 E4B It
Gemma · Capsulanet
Params7.52B
Context128K
Q4_K_M5.4 GB
ReasoningTool useVision
LA
ai21labs_AI21 Jamba 1.5 Mini
Labs · leafspark
Params51.6B
Context256K
Smallest22.3 GB
Tool use
QW
Qwen2.5 7B Instruct
Qwen · dahara1
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Llama 3.2 1B Instruct
Llama · taylorj94
Params1.24B
Context128K
Smallest0.9 GB
Tool use
SM
SmolLM2 1.7B Instruct
SmolLM · aa1602295777
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
NE
NemoMix Unleashed 12B
Nemomix · violetahayashi69
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen3 72B Embiggened
Qwen · Ailearner007
Params72.7B
Context40K
Q4_K_M47.4 GB
ReasoningTool use
CO
codegeex4-all-9b
Codegeex · qwp4w3hyb
Params9.4B
Context128K
Smallest3.1 GB
GGUF
QW
Qwen3.6 27B Omnimerge v4
Qwen · fribourgquant
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
FA
FanFic Illustrator
Fanfic · webbigdata
Params3.09B
Context32K
Smallest2.0 GB
Tool use
LL
Llama 3.2 3B Instruct
Llama · benniekiss
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
models app
Models · jorbassilva
Params4.65B
Context125K
Smallest1.2 GB
ReasoningTool use
LL
Hyze1BInstruct
Llama · HyzeAI
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GE
Gemma 4 E4B It
Gemma · Krasnopjorovs
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
QW
my_QwQ 32B Preview Abliterated Linear25
Qwen · pipihand01
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
TH
The True Abomination 24B
The · Casual-Autopsy
Params23.6B
Context32K
Q4_K_M14.3 GB
Roleplay
PH
Phi 3.5 mini it Q4 K L chunked
Phi · BoscoTheDog
Params3.82B
Context128K
Smallest2.5 GB
Coding
PI
Pixtral 12B 2409 hf text only
Pixtral · leafspark
Params12.2B
Context1000K
Smallest9.2 GB
Tool useVision
LF
LFM2.5 2.6B
Lfm · kelvinlamptey
Params2.7B
Context125K
Q4_K_M1.7 GB
ReasoningTool use
GE
gemma 4 31B Mergemaxxed
Gemma · MRockatansky
Params30.7B
Context256K
Smallest0.0 GB
GGUF
CR
CREC N WREC Mate 24B v2
Crec · Casual-Autopsy
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF

Other quants

Keep browsing