GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MO
Moonshine Base (Arabic)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GGUF
NE
NVIDIA Nemotron 3 Super 120B A12B BF16 heretic v2
Nemotron · Sabomako
Params121B
Context1024K
Smallest68.6 GB
ReasoningTool use
FS
FsfairX-Zephyr-Chat-v0.1
Fsfairx · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
moonshine base zh
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GGUF
IN
Internlm2 1_8b
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
PH
lexi coder v4.3
Phi · reallexi
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
MI
MiniMax M2.1
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
GGUF
LL
llm compiler 7b ftd
Llm · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
DE
deepseek llm 67b chat
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
MA
magnum-72b-v1
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen3.8 Flash Next GGUF UD Q4 K XL
Qwen · KENIC-1
Params177B
Context256K
Smallest4.1 GB
Vision
ST
sd3.5 large controlnet
Stable · calcuis
Params8.15B
Context—
Smallest4.8 GB
GGUF
LL
Llama-3-8B-Synthia-v3.5
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
HY
HyperCLOVAX-SEED-Think-32B
Hyperclovax · naver-ellm
Params32.6B
Context128K
Q4_K_M21.3 GB
ReasoningTool useVision
QW
Qwen2.5-VL-72B-Instruct
Qwen · Mungert
Params73B
Context125K
Q4_K_M47.7 GB
Vision
QW
Qwen3.8-Flash-Next-102B-A5B-Niwaki-v2.4-3bit
Qwen · neopolita
Params108B
Context256K
Smallest43.8 GB
GGUF
QW
Qwen Qwen2.5 Coder 32B Instruct Heretic
Qwen · ThalisAI
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
QW
Swift 1.5 Qwen3.8 27b
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
MY
gryphe_mythomist-7b
Mythomist · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
CodeQwen1.5 7B Chat
Qwen · QuantFactory
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 72B Instruct Heretic
Qwen · brindusa
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
TE
Teuken 7B Instruct Research v0.4
Teuken · bartowski
Params7.45B
Context4K
Q4_K_M5.0 GB
GGUF
QW
Qwen2.5 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
ST
HOT Step CPP StableStep
Stable · scragnog
Params1.45B
Context—
Q4_K_M0.8 GB
GGUF
KU
Kunoichi-DPO-v2-7B
Kunoichi · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
stable-audio-3-small-music SAME-S
Stable · thepatch
Params—
Context—
Q4_K_M0.1 GB
GGUF
QW
Qwen 72B Chat
Qwen · mradermacher
Params72.3B
Context32K
Q4_K_M45.1 GB
GGUF
LL
LLaMA2 13B Holomax
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IN
Internlm2 Math 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF

Keep browsing