GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LF
Luth LFM2 350M
Lfm · kurakurai
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
SA
Sara 1.5 4B It
Sara · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Tool useVision
LF
LFM2.5 24B A2B Uncensored
Lfm · Ishowbackup
Params24B
Context128K
Q4_K_M15.4 GB
ReasoningTool use
FA
Fallen Command A 111B v1.1
Fallen · bartowski
Params111B
Context256K
Smallest26.8 GB
GGUF
QW
Qwen3.8 27B Uncensored cyber
Qwen · nico248000000000
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
LT
LTXV 13B 0.9.8 distilled
Ltx · biali
Params13B
Context—
Q4_K_M8.8 GB
GGUF
AN
Anubis 70B v1 i1
Anubis · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
PR
prettybird_bce_basic_8B
Prettybird · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Google Gemma 4 12B It
Gemma · sigmanih
Params11.9B
Context256K
Smallest9.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Desyced
DeepSeek · ApolloRaines
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
QW
Models Huihui Ai Qwen2.5 Coder 3B Instruct Abliterated
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
CodingTool use
LL
Llama 3.3 Nemotron 70B Reward Principle
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
ST
stablelm-2-12b-chat
Stablelm · stabilityai
Params12.1B
Context4K
Q4_K_M7.4 GB
Tool use
QW
14B Qwen2.5 Freya x1 i1
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
QW
Qwen3.8 Flash Next Uncensored ROCmFP4 STRIX LEAN
Qwen · kingjones777
Params177B
Context256K
Smallest105.8 GB
ReasoningTool useVision
QW
Qwen2.5 Coder 3B Instruct Heretic
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingRoleplayTool use
LF
LFM2 VL 3B Heretic
Lfm · ZuzeTt
Params2.57B
Context125K
Q4_K_M1.6 GB
Vision
RA
Razorback 12B v0.2
Razorback · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool useVision
LF
LFM2.5 Encoder 230M
Lfm · LiquidAI
Params230M
Context125K
Smallest0.1 GB
CodingTool use
ME
Medgemma 27b It
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
EmbeddingVision
DI
Dirty Alice RP 2b i1
Dirty · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Roleplay
LL
Llama 3.1 Minitron 4B Magpie SFT 650K MT
Llama · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
LI
L3-8B-LingYang-v2
Lingyang · mradermacher
Params8.03B
Context1024K
Q4_K_M4.9 GB
GGUF
HE
HAI3 RAW
Helpingai · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
CO
Cosmos Reason2 8b
Cosmos · apolo13x
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
AI
Airoboros L2 7b Gpt4 M2.0
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GA
Gaia LLM 8B
Gaia · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
MI
Mistralai Devstral Small 2 24B Instruct 2512
Mistral · sigmanih
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingTool use
MI
Mistral-7B-OpenOrca
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral Small Gutenberg Doppel 22B
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use

Keep browsing