GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
MO
Moonshine Base (Arabic)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
NE
NVIDIA Nemotron 3 Super 120B A12B BF16 heretic v2
Nemotron · Sabomako
Params121B
Context1024K
Smallest68.6 GB
FS
FsfairX-Zephyr-Chat-v0.1
Fsfairx · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
moonshine base zh
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
IN
Internlm2 1_8b
InternLM · mradermacher
Params1.89B
Context32K
Q4_K_M1.2 GB
PH
lexi coder v4.3
Phi · reallexi
Params3.84B
Context128K
Q4_K_M2.5 GB
MI
MiniMax M2.1
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
LL
llm compiler 7b ftd
Llm · QuantFactory
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
deepseek llm 67b chat
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
MA
magnum-72b-v1
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.8 Flash Next GGUF UD Q4 K XL
Qwen · KENIC-1
Params177B
Context256K
Smallest4.1 GB
ST
sd3.5 large controlnet
Stable · calcuis
Params8.15B
Context—
Smallest4.8 GB
LL
Llama-3-8B-Synthia-v3.5
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
HY
HyperCLOVAX-SEED-Think-32B
Hyperclovax · naver-ellm
Params32.6B
Context128K
Q4_K_M21.3 GB
QW
Qwen2.5-VL-72B-Instruct
Qwen · Mungert
Params73B
Context125K
Q4_K_M47.7 GB
QW
Qwen3.8-Flash-Next-102B-A5B-Niwaki-v2.4-3bit
Qwen · neopolita
Params108B
Context256K
Smallest43.8 GB
QW
Qwen Qwen2.5 Coder 32B Instruct Heretic
Qwen · ThalisAI
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Swift 1.5 Qwen3.8 27b
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MY
gryphe_mythomist-7b
Mythomist · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
CodeQwen1.5 7B Chat
Qwen · QuantFactory
Params7.25B
Context64K
Q4_K_M4.7 GB
QW
Qwen2.5 72B Instruct Heretic
Qwen · brindusa
Params72.7B
Context32K
Q4_K_M47.4 GB
TE
Teuken 7B Instruct Research v0.4
Teuken · bartowski
Params7.45B
Context4K
Q4_K_M5.0 GB
QW
Qwen2.5 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
ST
HOT Step CPP StableStep
Stable · scragnog
Params1.45B
Context—
Q4_K_M0.8 GB
KU
Kunoichi-DPO-v2-7B
Kunoichi · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
stable-audio-3-small-music SAME-S
Stable · thepatch
Params—
Context—
Q4_K_M0.1 GB
QW
Qwen 72B Chat
Qwen · mradermacher
Params72.3B
Context32K
Q4_K_M45.1 GB
LL
LLaMA2 13B Holomax
Llama · KoboldAI
Params13B
Context4K
Q4_K_M7.9 GB
IN
Internlm2 Math 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB