GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
FA
Falcon H1 Tiny Coder 90M
Falcon · tiiuae
Params108M
Context256K
Q4_K_M0.1 GB
Coding
HU
HunyuanVideo Avatar GGUF Experiment
Hunyuanvideo · lym00
Params13B
Context—
Q4_K_M8.0 GB
GGUF
HA
Hathor Tahsin L3 8B v0.85
Hathor · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.8-Flash-Next-113B-A5B-Niwaki-3bit
Qwen · neopolita
Params121B
Context256K
Smallest49.1 GB
ReasoningTool use
ST
stable-code-instruct-3b
Stable · bartowski
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LE
lexi coder v4.4
Lexi · reallexi
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
MO
MotherEarth Storm 1.0 8B i1
Motherearth · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
IN
InternLM2
InternLM · legraphista
Params7.74B
Context32K
Smallest1.9 GB
GGUF
NO
Nous-Capybara-3B-V1.9
Nous · duyntnet
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
MI
Mistral Medium 3.5 128B
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
GGUF
LL
Meta-Llama-3-13B-Instruct
Llama · LiteLLMs
Params13.9B
Context8K
Q4_K_M8.4 GB
GGUF
SA
maritaca-ai_sabia-7b
Sabia · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GO
Golddiamondgold Paperbliteration L33 70b
Golddiamondgold · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
TR
Trinity Mini
Trinity · mradermacher
Params26.1B
Context128K
Q4_K_M15.8 GB
ReasoningTool use
LL
Skywork O1 Open Llama3.1 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GL
Warlock GLM 5.3
GLM · ahnafnafee
Params753B
Context1024K
Smallest369.4 GB
ReasoningTool use
QW
Swift Qwen3.8 27B Uncensored MTP
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
LL
mikael110_llama-2-70b-guanaco-qlora
Llama · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
GE
gemma-2b-it
Gemma · mlabonne
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF
CY
Cydonia 24B v2
Cydonia · TheDrummer
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
SE
SeaLLMs-v3-1.5B-Chat
Seallms · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
QW
Qwen Image Flash
Qwen · realrebelai
Params20.4B
Context—
Q4_K_M11.7 GB
GGUF
QW
Zero Qwen3 8B OpenZero
Qwen · shafire
Params8.19B
Context40K
Smallest5.9 GB
ReasoningTool use
QW
Qwen2-72B-Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LL
Hermes-2-Pro-Llama-3-8B
Llama · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LF
LFM3 1.7B
Lfm · prithivMLmods
Params1.73B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
QW
Swift Qwen3.8 27b Heretic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
72B Qwen2.5 Kunou v1
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
LL
Bio Medical Llama 3.1 8B i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF

Keep browsing