GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
TE
Tessera-27B-B-CJK
Tessera · ZelligeAI
Params27.3B
Context256K
Smallest13.1 GB
GE
Gemory 26B A4B
Gemma · UltimateIntent
Params25.2B
Context256K
Q4_K_M16.8 GB
JA
Jan-v2-VL-high
Jan · janhq
Params8.2B
Context256K
Q4_K_M5.0 GB
QW
Qwen_Qwen3.5 27B
Qwen · lmstudio-community
Params27B
Context256K
Q4_K_M16.5 GB
NE
privacy-filter-nemotron
Nemotron · LocalAI-io
Params1.4B
Context128K
Smallest1.6 GB
NA
Nanbeige4.2 3B
Nanbeige · gkraker04
Params4.17B
Context256K
Q4_K_M2.6 GB
JA
Jan code 4b
Jan · janhq
Params4.4B
Context256K
Q4_K_M2.7 GB
GE
Gemma 4 E2B It Ultra Uncensored Heretic
Gemma · llmfan46
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
26B A4B
Gemma · terrorswift
Params25.2B
Context256K
Smallest0.5 GB
HO
K2 Horizon MoVA 36B A4B
Horizon · NANI-Nithin
Params37.4B
Context512K
Q4_K_M22.4 GB
GE
Dark Scarlett v0.3 26B A4B
Gemma · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
MU
Muse Glimmer 30B Abliterated
Muse · The-freezer
Params28B
Context128K
Q4_K_M1.6 GB
MI
MiniCPM V 4.7 1B DSpark
MiniCPM · openbmb
Params214M
Context256K
Q4_K_M0.1 GB
LI
T lite it 2.1
Lite · t-tech
Params8.2B
Context40K
Q4_K_M5.0 GB
HO
K2 Horizon 0.9B
Horizon · IFM
Params1.08B
Context128K
Q4_K_M0.7 GB
QW
Qwen2.5 14B Instruct
Qwen · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
KO
Huihui Kolibri 1 BF16 Abliterated
Kolibri · huihui-ai
Params78B
Context256K
Q4_K_M47.5 GB
QW
Qwen3 14B Abliterated
Qwen · RootMonsteR
Params14.8B
Context40K
Q4_K_M9.0 GB
WA
Wan2.1 T2V 1.3B
Wan · samuelchristlie
Params1.42B
Context—
Q4_K_M1.0 GB
GR
granite 4.0 1b speech
Granite · handy-computer
Params2.31B
Context—
Q4_K_M1.6 GB
AP
35B A3B
Apus · apus-ailab
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Signal 3.8 27B
Qwen · agentionai
Params27.3B
Context—
Q4_K_M17.0 GB
QW
Qwen3 Reranker 4B GGUF llama cpp
Qwen · Voodisss
Params4B
Context40K
Q4_K_M2.5 GB
SM
Smollm3-3B
SmolLM · unsloth
Params3.08B
Context64K
Q4_K_M1.9 GB
QW
Qwen2 VL 2B Instruct
Qwen · ggml-org
Params1.54B
Context32K
Q4_K_M1.0 GB
GP
Huihui Gpt Oss 20b BF16 Abliterated
gpt-oss · huihui-ai
Params20.9B
Context128K
Q4_K_M15.8 GB
GE
Gemma 4 31B It Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3 ASR 1.7B
Qwen · unslothai
Params2.03B
Context64K
Smallest2.2 GB
AL
Source Hf Aliceai T5 35b A0.6B
Aliceai · ngquocvinh
Params34.6B
Context128K
Q4_K_M21.0 GB
QW
Qwen3 VL 8B NSFW Caption V4.5
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB