GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PL
Plamo 2 Translate
Plamo · mmnga
Params9.53B
Context10240K
Smallest4.6 GB
GGUF
LF
Kulyk En Uk
Lfm · Yehor
Params354M
Context125K
Smallest0.4 GB
GGUF
LF
LFM2.5-24B-A2B
Lfm · IsValorum
Params24B
Context128K
Smallest9.6 GB
ReasoningTool use
EI
Einstein-v4-7B
Einstein · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
KA
Kairos
Kairos · mradermacher
Params8.2B
Context32K
Q4_K_M5.0 GB
GGUF
LE
LeVo2
Levo · ckadirt
Params663M
Context—
Q4_K_M0.6 GB
GGUF
LL
Llama3.1 Nemo Thinker
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
HA
Hathor Sofit L3 8B v1
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
WA
wan22 qx encoders
Wan · wangkanai
Params5.68B
Context512
Smallest2.9 GB
Coding
LL
llama3 8b chat uncensored
Llama · georgesung
Params8B
Context8K
Smallest4.7 GB
GGUF
DE
openbuddy deepseek 67b v15 base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
KW
KwaiCoder AutoThink Preview
Kwaicoder · bartowski
Params40.6B
Context32K
Q4_K_M24.6 GB
Coding
QW
Swift 1.5 Qwen3.8 27b
Qwen · br1nz
Params27B
Context256K
Smallest10.9 GB
GGUF
LL
openbuddy-llama3-70b-v21.2-32k
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v3
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingReasoningTool use
AI
airoboros-2.2.1-limarpv3-y34b
Airoboros · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
BE
Behemoth T1 123B
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
ReasoningRoleplay
QW
Qwen2.5 3B Instruct heretic
Qwen · saidutta69
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
FL
FLUX.1 Fill dev
Flux · gpustack
Params17B
Context—
Smallest10.1 GB
GGUF
MI
Minitron 4B Base
Minitron · legraphista
Params4.19B
Context4K
Smallest1.9 GB
GGUF
NE
Nemotron 3 Embed 8B BF16
Nemotron · Aqua00
Params7.95B
Context256K
Q4_K_M4.9 GB
Embedding
QW
Qwen Qwen3.8 27B
Qwen · sigmanih
Params27.3B
Context256K
Smallest10.6 GB
ReasoningTool use
QW
Einstein-v4-Qwen-1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
CodingTool use
MI
Midnight Miqu 70B v1.0
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
LL
Nous-Hermes-Llama2-13b
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
LF
Kulyk Uk En
Lfm · Yehor
Params354M
Context125K
Smallest0.4 GB
GGUF
QW
Qwen2.5 VL 3B Instruct
Qwen · DhruvalLabs
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
LL
cognitivecomputations dolphin 2.9 llama3 8b
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SA
Samantha Mythomax l2 13b merge fixed i1
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SK
skywork_skywork-13b-base
Skywork · TheBloke
Params13.9B
Context128K
Q4_K_M8.4 GB
GGUF

Keep browsing