GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
calme-2.2-qwen2.5-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
FO
Foundation Sec 1.1 8B Instruct
Foundation · fdtn-ai
Params8.03B
Context64K
Smallest8.5 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B BF16
Nemotron · Jmica
Params38B
Context1024K
Smallest13.9 GB
Vision
KR
Krea-2-Engineer-V1
Krea · BennyDaBall
Params4B
Context256K
Q4_K_M2.5 GB
Coding
HY
digitous_13b-hypermantis
Hypermantis · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Roleplay
PL
Plano Orchestrator 30B A3B
Plano · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Tool use
MY
MythoMax L2 13b Heretic
Mythomax · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · kkguku
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
MI
OpenHermes-2.5-Mistral-7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
IN
Internlm2_5 7b Chat
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
MI
MiniMax M2.7
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
ST
stable-audio-3-small-sfx SAME-S
Stable · thepatch
Params—
Context—
Q4_K_M0.1 GB
GGUF
JA
AI21 Jamba Mini 1.7
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
GGUF
LF
LFM2.5 24B A2B Uncensored no refusal
Lfm · 0xSojalSec
Params24B
Context128K
Q4_K_M15.4 GB
ReasoningTool use
QW
Qwen3.8 Flash Next CodeUD v18a
Qwen · mtita
Params177B
Context256K
Smallest1.3 GB
ReasoningTool useVision
LF
Atomic Chat / LFM2.5 8B A1B
Lfm · AtomicChat
Params8.47B
Context125K
Q4_K_M5.2 GB
ReasoningTool use
WI
WizardLM-13B-Uncensored
Wizardlm · duyntnet
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
OM
Omni Edu 9B
Omni · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · BenMonkey11
Params177B
Context256K
Smallest68.2 GB
ReasoningTool useVision
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
CodingTool use
MA
Anthracite Org_Magnum v2 72b
Magnum · anthracite-org
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · second-state
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
DE
Deepseek v2 Lite Chat
DeepSeek · ggfox00000
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
MY
MythoLogic-13b
Mythologic · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B Badger Mixed
Qwen · CleverBadger
Params27.3B
Context—
Smallest0.0 GB
GGUF
ME
Medgemma 4b It
Medgemma · second-state
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
LF
LFM3 Omni 2B
Lfm · erenyeager-1
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
QW
Qwopus3.6 27B Fusion
Qwen · Jackrong
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoning
QW
Qwen3 8B
Qwen · second-state
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
FA
Falcon H1 3B Instruct
Falcon · tiiuae
Params3.15B
Context128K
Q4_K_M1.9 GB
GGUF

Keep browsing