GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GO
Google_Medgemma 1.5 4b It
Google · Bercraft
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
BA
bagel 20b v04
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
CodingRoleplayTool use
FL
flux kontext
Flux · gguf-org
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
LF
LFM2.5 230M heretic
Lfm · saidutta69
Params230M
Context125K
Q4_K_M0.2 GB
ReasoningRoleplayTool use
KI
Mythalion Kimiko v2
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Meta llama.Llama 4 Scout 17B 16E Instruct
Llama · DevQuasar-12
Params108B
Context10240K
Q4_K_M65.4 GB
Tool use
IN
Internlm2 Math 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
QW
Qwen 72B Chat
Qwen · mradermacher
Params72B
Context32K
Q4_K_M45.1 GB
GGUF
MI
MiniMax H3
Minimax · robertbschuette
Params20.1B
Context—
Q4_K_M18.2 GB
GGUF
LL
Llama3 8b chinese Uncensored v0.1
Llama · supernovaburn
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LF
lfm2 audio 1.5b
Lfm · cstr
Params79M
Context—
Smallest0.2 GB
GGUF
AI
airoboros l2 13b gpt4 m2.0
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NO
Nous Hermes ReflexAgent 8B v1
Nous · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen3 ASR 1.7B JA Anime Galgame
Qwen · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
Vision
QW
Qwen2 VL 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Vision
HU
Hunyuan 80B A13B Safe Hunyuan A13B Instruct
Hunyuan · tencent
Params80B
Context256K
Q4_K_M48.8 GB
GGUF
LL
Llama 3 Dolphin Instruct 11.5B
Llama · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
LF
LFM2.5 VL 3B Absolute Heresy
Lfm · mradermacher
Params2.7B
Context125K
Q4_K_M1.7 GB
Vision
KA
KAT V1 40B
Kat · mradermacher
Params40.6B
Context128K
Q4_K_M24.6 GB
Tool use
LT
LTX 2.3
Ltx · nnick79
Params21B
Context—
Q4_K_M14.2 GB
GGUF
LO
longchat 7b v1.5 32k
Longchat · shaowenchen
Params6.74B
Context32K
Smallest2.8 GB
GGUF
MI
Mistral Large 4 1T A52B NVFP4
Mistral · ggml-org
Params1050B
Context1024K
Smallest4.2 GB
ReasoningTool useVision
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Loverboy69
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
SE
SeaLLM3 7B Chat
Seallms · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LF
LFM2.5 Encoder 350M Diffusion
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
Coding
HY
HyGPT 10b
Hygpt · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Sperma Aj Qwen3.8 27b
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
ER
10Eros Max fl2va Beta2
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
GGUF
SI
Silicon-Maid-7B
Silicon · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
AN
Anima turbo v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF

Keep browsing