GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
MI
MiniMax M2.7
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.8 GB
IN
InternLM2
InternLM · legraphista
Params19.9B
Context8K
Smallest4.5 GB
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · shefowl
Params177B
Context256K
Smallest67.2 GB
IM
z image turbo adreno
Image · zhiyuanasad
Params6.15B
Context—
Smallest2.3 GB
ST
sd3.5 medium
Stable · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
YI
Yi 34B 200K DARE megamerge v8 i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
LT
LTX 2
Ltx · vantagewithai
Params18.9B
Context—
Q4_K_M12.8 GB
LF
LFM2.5-24B-A2B
Lfm · OS-Software
Params24B
Context128K
Q4_K_M14.5 GB
QW
Qwen2.5 Coder 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
FA
FastH3 Omni GGUFs
Fastvideo · realrebelai
Params22.1B
Context—
Q4_K_M13.8 GB
QW
Qwen3.8-2.4T-A95B
Qwen · unsloth
Params2450B
Context256K
Smallest397.3 GB
QW
Qwen3.8 Flash Next FP8 Abliterated
Qwen · GCSA-AiLab
Params177B
Context256K
Q4_K_M2.8 GB
FL
Sakura FLUX.3 Image Klein
Flux · webmp3
Params5.55B
Context—
Q4_K_M3.3 GB
GL
Glm 4 9b Chat
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
PO
pony v7 base
Pony · purplesmartai
Params6.86B
Context—
Smallest3.9 GB
FL
FLUX.1 dev
Flux · lllyasviel
Params11.9B
Context—
Smallest4.0 GB
QW
Darrellbest Qwen Image 2.1 PE I2I Heretic
Qwen · darrellbest
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
DeepSeek V4 Flash Vision Strix Halo
DeepSeek · otheru
Params284B
Context—
Smallest10.9 GB
YA
YandexGPT 5 Lite 8B Instruct
Yandexgpt · yandex
Params8B
Context32K
Q4_K_M4.9 GB
QW
Qwen3.8 Flash Next
Qwen · FINAL-Bench
Params177B
Context256K
Q4_K_M100.2 GB
WH
whiterabbitneo_whiterabbitneo-33b-v1
Whiterabbitneo · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
QW
Qwen3.8 Flash Next FLE
Qwen · sirfyyn
Params177B
Context256K
Smallest1.5 GB
ER
10Eros Max Hybrid Beta5
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
NE
Nemotron 3 Nano 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B 4GB DFlash
Nemotron · nvidia
Params360M
Context128K
Smallest0.7 GB
GR
grok oss Apollyon 8B
Grok · c4tdr0ut
Params8B
Context128K
Smallest5.7 GB
FA
Falcon H1R 7B
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
VI
Vinci MLE 123B 1.0
Vinci · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
MI
Mistral Heretica 12B
Mistral · AnkitAI
Params12.2B
Context128K
Q4_K_M7.5 GB