GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 3B Instruct
Qwen · QuantFactory
Params3.4B
Context32K
Q4_K_M2.1 GB
CodingTool use
MI
Mistral-7B-Instruct-v0.1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
ddh0_orcamaid-v3-13b-32k
Orcamaid · TheBloke
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
QW
Qwen1.5 55B Chat Cut i1
Qwen · mradermacher
Params54.8B
Context32K
Q4_K_M33.3 GB
GGUF
FL
Flux2 Klein 9B True V2
Flux · BIGJUTT
Params9.08B
Context—
Smallest5.7 GB
GGUF
AI
airoboros-70b-3.3
Airoboros · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
RoleplayTool use
ST
stable-code-3b
Stable · duyntnet
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
OP
openNemo 9B Claude Opus 4.6 Distill
Opennemo · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
MO
MotherEarth Storm 1.0 8B
Motherearth · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BR
Breeze TTS 2
Breeze · agentory
Params—
Context—
Smallest4.3 GB
GGUF
GE
GEMMA SUTRA
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
NE
NVIDIA Nemotron Nano 12B v2 VL BF16
Nemotron · Vastined
Params12.3B
Context1024K
Q4_K_M7.5 GB
ReasoningTool useVision
MI
MiniMax M2.5 REAP 139B A10B i1
Minimax · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
ReasoningTool use
FL
Flux2 Klein 9b Uncensored Text Encoder
Flux · KM445
Params8.19B
Context40K
Smallest8.7 GB
Coding
VI
Visual LaylelemonMaidRP 7B i1
Visual · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
allura org Bigger Body 8b
Bigger · bartowski
Params8.02B
Context32K
Q4_K_M4.9 GB
Roleplay
QW
Qwen3 Omni 30B A3B Thinking Heretic
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
ReasoningTool useVision
LF
LFM3 Audio 2B
Lfm · prithivMLmods
Params1.73B
Context125K
Q4_K_M1.1 GB
CodingReasoningTool use
QW
calme-2.2-qwen2.5-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
GL
Glm Edge V 2b
GLM · zai-org
Params1.59B
Context2K
Q4_K_M1.0 GB
Vision
QW
Qwen3.8 Flash Next Prune11264 124B
Qwen · Atomic-Germ
Params124B
Context256K
Q4_K_M83.8 GB
ReasoningTool useVision
CL
claude fable7 undecillion sse
Claude · oroboros-labs
Params14.8B
Context32K
Smallest9.0 GB
ReasoningTool use
SA
Dr.Samantha-8B
Samantha · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
AceMath RL Nemotron 7B
Nemotron · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
CY
Cydonia 22B v1.1
Cydonia · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
TO
Totvs Protheus ADVPL V0.1
Totvs · dyulianocecilio
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool useVision
MO
Moonshine Base (Vietnamese)
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GGUF
SO
Solar Open 69B REAP
Solar · mradermacher
Params69.4B
Context128K
Q4_K_M42.1 GB
Tool use
JE
Jev Vision 0.8B
Jev · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
MI
MiniCPM5 1B
MiniCPM · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use

Keep browsing