GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
XI
Xing4.0 29B A4B
Xing · XingChen-AGI
Params31.2B
Context256K
Smallest0.2 GB
XX
encoder
Xxl · chatpig
Params219M
Context512
Q4_K_M2.9 GB
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · llmfan46
Params25.2B
Context256K
Q4_K_M17.3 GB
LY
Lythri 4B A2B
Lythri · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
MI
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated
Mistral · maerong3
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest13.3 GB
NE
NeoHorse-1-4B
Neohorse · TokenRhythm
Params4.21B
Context256K
Q4_K_M2.7 GB
DE
WhiteRabbitNeo WhiteRabbitNeo V3 7B
Deephat · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CE
mispeech/ced-tiny
Ced · mudler
Params86M
Context—
Smallest0.0 GB
QW
Qwen3 32B Uncensored
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3 VL 8B Heretic Stable
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama 3.2 8X4B MOE V2 Dark Champion Instruct uncensored abliterated 21B
Llama · DavidAU
Params20.9B
Context128K
Q4_K_M12.9 GB
GR
Granite 20b Code Instruct
Granite · bartowski
Params20B
Context8K
Q4_K_M12.8 GB
HO
Holo4 35B A3B
Holo · Hcompany
Params34.7B
Context256K
Q4_K_M21.3 GB
SA
Sabi Noema
Sabi · owao
Params27B
Context256K
Q4_K_M16.5 GB
QW
qwen2.5-32b-instruct
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
HO
K2-Horizon-MoVA-36B-A4B
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
QW
Qwen3 8B Heretic
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes Final NVFP4
Qwen · jan1k
Params34.7B
Context256K
Smallest21.1 GB
QW
Qwen3.5 9B Coder
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
FU
Fun ASR Nano
Fun · FunAudioLLM
Params234M
Context—
Smallest0.5 GB
MI
MiniCPM5 2B Math
MiniCPM · Caldalis
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Qwen3.6 35B Uncensored HauhauCS 1M
Qwen · satgeze
Params447M
Context1024K
Q4_K_M21.7 GB
MI
Ministral-3-14B-Reasoning-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
FL
FLUX.2 klein base 4B
Flux · leejet
Params3.88B
Context—
Smallest2.5 GB
MA
UI Mate 9B
Mate · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
QW
Qwen3-Coder-480B-A35B-Instruct
Qwen · unsloth
Params480B
Context256K
Q4_K_M290.1 GB
QW
Qwen3.8-27B
Qwen · julianmb
Params27.3B
Context256K
Smallest9.2 GB
TE
Ternary Bonsai 2 27B Abliterated PQ2 0 MTP
Ternary · BoldingBuilds
Params27B
Context256K
Smallest7.2 GB