GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiniMax M2.7
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.8 GB
GGUF
IN
InternLM2
InternLM · legraphista
Params19.9B
Context8K
Smallest4.5 GB
GGUF
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · shefowl
Params177B
Context256K
Smallest67.2 GB
Vision
IM
z image turbo adreno
Image · zhiyuanasad
Params6.15B
Context—
Smallest2.3 GB
GGUF
ST
sd3.5 medium
Stable · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
GGUF
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
YI
Yi 34B 200K DARE megamerge v8 i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LT
LTX 2
Ltx · vantagewithai
Params18.9B
Context—
Q4_K_M12.8 GB
GGUF
LF
LFM2.5-24B-A2B
Lfm · OS-Software
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
QW
Qwen2.5 Coder 3B
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
FA
FastH3 Omni GGUFs
Fastvideo · realrebelai
Params22.1B
Context—
Q4_K_M13.8 GB
GGUF
QW
Qwen3.8-2.4T-A95B
Qwen · unsloth
Params2450B
Context256K
Smallest397.3 GB
GGUF
QW
Qwen3.8 Flash Next FP8 Abliterated
Qwen · GCSA-AiLab
Params177B
Context256K
Q4_K_M2.8 GB
Vision
FL
Sakura FLUX.3 Image Klein
Flux · webmp3
Params5.55B
Context—
Q4_K_M3.3 GB
GGUF
GL
Glm 4 9b Chat
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
PO
pony v7 base
Pony · purplesmartai
Params6.86B
Context—
Smallest3.9 GB
GGUF
FL
FLUX.1 dev
Flux · lllyasviel
Params11.9B
Context—
Smallest4.0 GB
GGUF
QW
Darrellbest Qwen Image 2.1 PE I2I Heretic
Qwen · darrellbest
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
DE
DeepSeek V4 Flash Vision Strix Halo
DeepSeek · otheru
Params284B
Context—
Smallest10.9 GB
GGUF
YA
YandexGPT 5 Lite 8B Instruct
Yandexgpt · yandex
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · FINAL-Bench
Params177B
Context256K
Q4_K_M100.2 GB
GGUF
WH
whiterabbitneo_whiterabbitneo-33b-v1
Whiterabbitneo · TheBloke
Params33.3B
Context16K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.8 Flash Next FLE
Qwen · sirfyyn
Params177B
Context256K
Smallest1.5 GB
GGUF
ER
10Eros Max Hybrid Beta5
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
NE
Nemotron 3 Nano 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
Coding
NE
NVIDIA Nemotron 3.5 Bolt E4B 4GB DFlash
Nemotron · nvidia
Params360M
Context128K
Smallest0.7 GB
ReasoningTool use
GR
grok oss Apollyon 8B
Grok · c4tdr0ut
Params8B
Context128K
Smallest5.7 GB
GGUF
FA
Falcon H1R 7B
Falcon · tiiuae
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
VI
Vinci MLE 123B 1.0
Vinci · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
CodingTool use
MI
Mistral Heretica 12B
Mistral · AnkitAI
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay

Keep browsing