GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DE
Deepseek Moe 16b Chat
DeepSeek · mradermacher
Params16.4B
Context4K
Q4_K_M10.9 GB
BA
Babel 9B Chat
Babel · bartowski
Params9.01B
Context128K
Q4_K_M5.5 GB
SE
SeaLLMs Audio 7B i1
Seallms · mradermacher
Params7.64B
Context8K
Q4_K_M4.7 GB
DE
DeepICD R1 Zero 32B
Deepicd · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
VI
Vikhrmodels/Vikhr-YandexGPT-5-Lite-8B-it
Vikhrmodels · Vikhrmodels
Params8.04B
Context32K
Q4_K_M4.9 GB
HO
holo
Holo · gguf-org
Params4.07B
Context—
Q4_K_M4.1 GB
LF
LFM2.5-8B-A1B-Uncensored
Lfm · virtuanista
Params8.47B
Context125K
Q4_K_M5.2 GB
LL
Llama-3-8B-Instruct-abliterated-dpomix
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
BA
ehartford_based-30b
Based · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
minicpm5 1B GLM 5.2 Agentic v1
MiniCPM · hudsongouge
Params1.08B
Context128K
Q4_K_M0.7 GB
OR
Ornstein Hermes 3.6 27B SABER
Ornstein · gkraker04
Params26.9B
Context256K
Smallest9.4 GB
PA
Palmyra Fin 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
QW
Qwen3.5 122B A10B REAP 30
Qwen · mradermacher
Params87.7B
Context256K
Q4_K_M53.3 GB
MI
Codestral-22B-v0.1
Mistral · SanctumAI
Params22.2B
Context32K
Q4_K_M13.3 GB
VI
Violet_Magcap 12B
Violet · wowtheawesome
Params12.2B
Context1000K
Q4_K_M7.5 GB
OM
Omni Edu 9B
Omni · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CO
ComfyUI Model Backups
Comfyui · AEmotionStudio
Params7.62B
Context512
Smallest3.4 GB
GR
Grafted Wind Elementals 2x70B i1
Grafted · mradermacher
Params125B
Context32K
Smallest26.2 GB
NE
NeuralMiLLaMa-8B-slerp
Neuralmillama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QA
Qarasu 14B Chat Plus Unleashed
Qarasu · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
MO
Morrow 2.6B CE
Morrow · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
MA
MadKFC MergedCPsyModel
Madkfc · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
JU
Justina_Clarus 24b
Justina · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen2.1 W8A8 W8A16 W4A8 W4A16 W4A4 QAT
Qwen · JoaoZaokk
Params7.12B
Context—
Smallest4.6 GB
SK
SkyReels V2 DF 14B 720P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
LF
LFM2.5 2.6B Absolute Heresy
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
NE
Nekomata 14b
Nekomata · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
OP
openNemo Cascade 2 30B A3B
Opennemo · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
KA
kappa_20b_131k
Kappa · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB