GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek Moe 16b Chat
DeepSeek · mradermacher
Params16.4B
Context4K
Q4_K_M10.9 GB
GGUF
BA
Babel 9B Chat
Babel · bartowski
Params9.01B
Context128K
Q4_K_M5.5 GB
Tool use
SE
SeaLLMs Audio 7B i1
Seallms · mradermacher
Params7.64B
Context8K
Q4_K_M4.7 GB
GGUF
DE
DeepICD R1 Zero 32B
Deepicd · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
VI
Vikhrmodels/Vikhr-YandexGPT-5-Lite-8B-it
Vikhrmodels · Vikhrmodels
Params8.04B
Context32K
Q4_K_M4.9 GB
GGUF
HO
holo
Holo · gguf-org
Params4.07B
Context—
Q4_K_M4.1 GB
GGUF
LF
LFM2.5-8B-A1B-Uncensored
Lfm · virtuanista
Params8.47B
Context125K
Q4_K_M5.2 GB
ReasoningTool use
LL
Llama-3-8B-Instruct-abliterated-dpomix
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
BA
ehartford_based-30b
Based · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
MI
minicpm5 1B GLM 5.2 Agentic v1
MiniCPM · hudsongouge
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
OR
Ornstein Hermes 3.6 27B SABER
Ornstein · gkraker04
Params26.9B
Context256K
Smallest9.4 GB
ReasoningTool useVision
PA
Palmyra Fin 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.5 122B A10B REAP 30
Qwen · mradermacher
Params87.7B
Context256K
Q4_K_M53.3 GB
ReasoningTool use
MI
Codestral-22B-v0.1
Mistral · SanctumAI
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
VI
Violet_Magcap 12B
Violet · wowtheawesome
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
OM
Omni Edu 9B
Omni · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
CO
ComfyUI Model Backups
Comfyui · AEmotionStudio
Params7.62B
Context512
Smallest3.4 GB
Tool use
GR
Grafted Wind Elementals 2x70B i1
Grafted · mradermacher
Params125B
Context32K
Smallest26.2 GB
GGUF
NE
NeuralMiLLaMa-8B-slerp
Neuralmillama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QA
Qarasu 14B Chat Plus Unleashed
Qarasu · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
MO
Morrow 2.6B CE
Morrow · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
GGUF
MA
MadKFC MergedCPsyModel
Madkfc · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
JU
Justina_Clarus 24b
Justina · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
Coding
QW
Qwen2.1 W8A8 W8A16 W4A8 W4A16 W4A4 QAT
Qwen · JoaoZaokk
Params7.12B
Context—
Smallest4.6 GB
GGUF
SK
SkyReels V2 DF 14B 720P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
LF
LFM2.5 2.6B Absolute Heresy
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
GGUF
NE
Nekomata 14b
Nekomata · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
OP
openNemo Cascade 2 30B A3B
Opennemo · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
KA
kappa_20b_131k
Kappa · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use

Keep browsing