GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LL
upstage_llama-30b-instruct-2048
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
LF
LFM2 24B A2B
Lfm · bartowski
Params23.8B
Context125K
Q4_K_M14.4 GB
CY
Cydonia 22B v1.2
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · grainrigi
Params177B
Context256K
Smallest0.9 GB
IN
Internlm2 Math Plus 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
ThinCtx Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
LF
LFM2.5 2.6B
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.7 GB
AY
Aya Expanse 8b
Aya · duyntnet
Params8B
Context8K
Q4_K_M5.1 GB
GL
Glm Edge 4b Chat
GLM · zai-org
Params4.33B
Context3K
Q4_K_M2.6 GB
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
QW
ThinCtx Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
D1
d1 3B
AtomicChat
Params2.7B
Context32K
Q4_K_M1.7 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · lmstudio-community
Params7.8B
Context32K
Q4_K_M4.8 GB
DE
deepseek llm 67b chat
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
LT
LTX 2.5 22b distilled
Ltx · elix3r
Params21B
Context—
Smallest16.9 GB
QW
Qwen3.8-Flash-CIRU-STRIX-IU4-MTP
Qwen · jcbtc
Params126B
Context256K
Smallest4.1 GB
GR
Granite 8b Code Instruct
Granite · duyntnet
Params8.05B
Context4K
Q4_K_M4.9 GB
CO
Cosmos Predict2 14B Text2Image
Cosmos · city96
Params14.3B
Context—
Q4_K_M9.5 GB
LF
Lfm2.5-230M
Lfm · unsloth
Params230M
Context125K
Q4_K_M0.2 GB
DE
DeepSeek R1 Distill Qwen 14B Heretic
DeepSeek · saidutta69
Params14.8B
Context128K
Q4_K_M9.0 GB
VA
VanMach 7B
Vanmach · mradermacher
Params7.71B
Context128K
Q4_K_M4.8 GB
BO
Borealis 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
KR
Krea R Turbo
Krea · realrebelai
Params12.8B
Context—
Q4_K_M7.7 GB
IN
Internlm2 Math Base 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
MA
Magnum v4 22b
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
FA
Falcon3 7B Instruct
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
DE
Deepseek Coder 6.7B Instruct
DeepSeek · second-state
Params6.74B
Context16K
Q4_K_M4.1 GB