GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
PL
Plamo 2 Translate
Plamo · mmnga
Params9.53B
Context10240K
Smallest4.6 GB
LF
Kulyk En Uk
Lfm · Yehor
Params354M
Context125K
Smallest0.4 GB
LF
LFM2.5-24B-A2B
Lfm · IsValorum
Params24B
Context128K
Smallest9.6 GB
EI
Einstein-v4-7B
Einstein · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KA
Kairos
Kairos · mradermacher
Params8.2B
Context32K
Q4_K_M5.0 GB
LE
LeVo2
Levo · ckadirt
Params663M
Context—
Q4_K_M0.6 GB
LL
Llama3.1 Nemo Thinker
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
HA
Hathor Sofit L3 8B v1
Hathor · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
WA
wan22 qx encoders
Wan · wangkanai
Params5.68B
Context512
Smallest2.9 GB
LL
llama3 8b chat uncensored
Llama · georgesung
Params8B
Context8K
Smallest4.7 GB
DE
openbuddy deepseek 67b v15 base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
KW
KwaiCoder AutoThink Preview
Kwaicoder · bartowski
Params40.6B
Context32K
Q4_K_M24.6 GB
QW
Swift 1.5 Qwen3.8 27b
Qwen · br1nz
Params27B
Context256K
Smallest10.9 GB
LL
openbuddy-llama3-70b-v21.2-32k
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v3
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
AI
airoboros-2.2.1-limarpv3-y34b
Airoboros · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
BE
Behemoth T1 123B
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
QW
Qwen2.5 3B Instruct heretic
Qwen · saidutta69
Params3.09B
Context32K
Q4_K_M1.9 GB
FL
FLUX.1 Fill dev
Flux · gpustack
Params17B
Context—
Smallest10.1 GB
MI
Minitron 4B Base
Minitron · legraphista
Params4.19B
Context4K
Smallest1.9 GB
NE
Nemotron 3 Embed 8B BF16
Nemotron · Aqua00
Params7.95B
Context256K
Q4_K_M4.9 GB
QW
Qwen Qwen3.8 27B
Qwen · sigmanih
Params27.3B
Context256K
Smallest10.6 GB
QW
Einstein-v4-Qwen-1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
MI
Midnight Miqu 70B v1.0
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
LL
Nous-Hermes-Llama2-13b
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
LF
Kulyk Uk En
Lfm · Yehor
Params354M
Context125K
Smallest0.4 GB
QW
Qwen2.5 VL 3B Instruct
Qwen · DhruvalLabs
Params3.09B
Context125K
Q4_K_M1.9 GB
LL
cognitivecomputations dolphin 2.9 llama3 8b
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
SA
Samantha Mythomax l2 13b merge fixed i1
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
SK
skywork_skywork-13b-base
Skywork · TheBloke
Params13.9B
Context128K
Q4_K_M8.4 GB