GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GO
Google_Medgemma 1.5 4b It
Google · Bercraft
Params3.88B
Context128K
Q4_K_M2.5 GB
BA
bagel 20b v04
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
FL
flux kontext
Flux · gguf-org
Params11.9B
Context—
Q4_K_M6.9 GB
LF
LFM2.5 230M heretic
Lfm · saidutta69
Params230M
Context125K
Q4_K_M0.2 GB
KI
Mythalion Kimiko v2
Kimi · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
LL
Meta llama.Llama 4 Scout 17B 16E Instruct
Llama · DevQuasar-12
Params108B
Context10240K
Q4_K_M65.4 GB
IN
Internlm2 Math 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
QW
Qwen 72B Chat
Qwen · mradermacher
Params72B
Context32K
Q4_K_M45.1 GB
MI
MiniMax H3
Minimax · robertbschuette
Params20.1B
Context—
Q4_K_M18.2 GB
LL
Llama3 8b chinese Uncensored v0.1
Llama · supernovaburn
Params8B
Context8K
Q4_K_M4.9 GB
LF
lfm2 audio 1.5b
Lfm · cstr
Params79M
Context—
Smallest0.2 GB
AI
airoboros l2 13b gpt4 m2.0
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
NO
Nous Hermes ReflexAgent 8B v1
Nous · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 ASR 1.7B JA Anime Galgame
Qwen · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
QW
Qwen2 VL 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
HU
Hunyuan 80B A13B Safe Hunyuan A13B Instruct
Hunyuan · tencent
Params80B
Context256K
Q4_K_M48.8 GB
LL
Llama 3 Dolphin Instruct 11.5B
Llama · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
LF
LFM2.5 VL 3B Absolute Heresy
Lfm · mradermacher
Params2.7B
Context125K
Q4_K_M1.7 GB
KA
KAT V1 40B
Kat · mradermacher
Params40.6B
Context128K
Q4_K_M24.6 GB
LT
LTX 2.3
Ltx · nnick79
Params21B
Context—
Q4_K_M14.2 GB
LO
longchat 7b v1.5 32k
Longchat · shaowenchen
Params6.74B
Context32K
Smallest2.8 GB
MI
Mistral Large 4 1T A52B NVFP4
Mistral · ggml-org
Params1050B
Context1024K
Smallest4.2 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Loverboy69
Params3.09B
Context32K
Q4_K_M1.9 GB
SE
SeaLLM3 7B Chat
Seallms · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
LF
LFM2.5 Encoder 350M Diffusion
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
HY
HyGPT 10b
Hygpt · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Sperma Aj Qwen3.8 27b
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ER
10Eros Max fl2va Beta2
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
SI
Silicon-Maid-7B
Silicon · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
AN
Anima turbo v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB