GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
upstage_llama-30b-instruct-2048
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LF
LFM2 24B A2B
Lfm · bartowski
Params23.8B
Context125K
Q4_K_M14.4 GB
GGUF
CY
Cydonia 22B v1.2
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · grainrigi
Params177B
Context256K
Smallest0.9 GB
GGUF
IN
Internlm2 Math Plus 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
ThinCtx Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
LF
LFM2.5 2.6B
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
AY
Aya Expanse 8b
Aya · duyntnet
Params8B
Context8K
Q4_K_M5.1 GB
GGUF
GL
Glm Edge 4b Chat
GLM · zai-org
Params4.33B
Context3K
Q4_K_M2.6 GB
GGUF
DE
Deepseek Coder 7b Instruct v1.5
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
QW
ThinCtx Qwen3.5 2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
GGUF
D1
d1 3B
AtomicChat
Params2.7B
Context32K
Q4_K_M1.7 GB
ReasoningTool useVision
EX
EXAONE 3.5 7.8B Instruct
Exaone · lmstudio-community
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
DE
deepseek llm 67b chat
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · bartowski
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
LT
LTX 2.5 22b distilled
Ltx · elix3r
Params21B
Context—
Smallest16.9 GB
GGUF
QW
Qwen3.8-Flash-CIRU-STRIX-IU4-MTP
Qwen · jcbtc
Params126B
Context256K
Smallest4.1 GB
Vision
GR
Granite 8b Code Instruct
Granite · duyntnet
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
CO
Cosmos Predict2 14B Text2Image
Cosmos · city96
Params14.3B
Context—
Q4_K_M9.5 GB
GGUF
LF
Lfm2.5-230M
Lfm · unsloth
Params230M
Context125K
Q4_K_M0.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B Heretic
DeepSeek · saidutta69
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
VA
VanMach 7B
Vanmach · mradermacher
Params7.71B
Context128K
Q4_K_M4.8 GB
GGUF
BO
Borealis 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
KR
Krea R Turbo
Krea · realrebelai
Params12.8B
Context—
Q4_K_M7.7 GB
GGUF
IN
Internlm2 Math Base 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
MA
Magnum v4 22b
Magnum · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
FA
Falcon3 7B Instruct
Falcon · bartowski
Params7.46B
Context32K
Q4_K_M4.6 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
Coding
DE
Deepseek Coder 6.7B Instruct
DeepSeek · second-state
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing