GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
FA
Falcon H1 Tiny Coder 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
HU
HunyuanVideo Avatar GGUF Experiment
Hunyuanvideo · lym00
Params13B
Context—
Q4_K_M8.0 GB
HA
Hathor Tahsin L3 8B v0.85
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.8-Flash-Next-113B-A5B-Niwaki-3bit
Qwen · neopolita
Params121B
Context256K
Smallest49.1 GB
ST
stable-code-instruct-3b
Stable · bartowski
Params2.8B
Context16K
Q4_K_M1.7 GB
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
LE
lexi coder v4.4
Lexi · reallexi
Params3.84B
Context128K
Q4_K_M2.5 GB
MO
MotherEarth Storm 1.0 8B i1
Motherearth · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
InternLM2
InternLM · legraphista
Params7.74B
Context32K
Smallest1.9 GB
NO
Nous-Capybara-3B-V1.9
Nous · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
MI
Mistral Medium 3.5 128B
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
LL
Meta-Llama-3-13B-Instruct
Llama · LiteLLMs
Params13.9B
Context8K
Q4_K_M8.4 GB
SA
maritaca-ai_sabia-7b
Sabia · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GO
Golddiamondgold Paperbliteration L33 70b
Golddiamondgold · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
TR
Trinity Mini
Trinity · mradermacher
Params26.1B
Context128K
Q4_K_M15.8 GB
LL
Skywork O1 Open Llama3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
GL
Warlock GLM 5.3
GLM · ahnafnafee
Params753B
Context1024K
Smallest369.4 GB
QW
Swift Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
LL
mikael110_llama-2-70b-guanaco-qlora
Llama · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GE
gemma-2b-it
Gemma · mlabonne
Params2.51B
Context8K
Q4_K_M1.5 GB
CY
Cydonia 24B v2
Cydonia · TheDrummer
Params23.6B
Context32K
Q4_K_M14.3 GB
SE
SeaLLMs-v3-1.5B-Chat
Seallms · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
Qwen Image Flash
Qwen · realrebelai
Params20.4B
Context—
Q4_K_M11.7 GB
QW
Zero Qwen3 8B OpenZero
Qwen · shafire
Params8.19B
Context40K
Smallest5.9 GB
QW
Qwen2-72B-Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
Hermes-2-Pro-Llama-3-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
LF
LFM3 1.7B
Lfm · prithivMLmods
Params1.73B
Context256K
Q4_K_M1.1 GB
QW
Swift Qwen3.8 27b Heretic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
72B Qwen2.5 Kunou v1
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
Bio Medical Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB