GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
calme-2.2-qwen2.5-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
FO
Foundation Sec 1.1 8B Instruct
Foundation · fdtn-ai
Params8.03B
Context64K
Smallest8.5 GB
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B BF16
Nemotron · Jmica
Params38B
Context1024K
Smallest13.9 GB
KR
Krea-2-Engineer-V1
Krea · BennyDaBall
Params4B
Context256K
Q4_K_M2.5 GB
HY
digitous_13b-hypermantis
Hypermantis · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
PL
Plano Orchestrator 30B A3B
Plano · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
MY
MythoMax L2 13b Heretic
Mythomax · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen Image 2.1 Uncensored
Qwen · kkguku
Params7.12B
Context—
Q4_K_M4.6 GB
MI
OpenHermes-2.5-Mistral-7B
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
Internlm2_5 7b Chat
InternLM · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
MI
MiniMax M2.7
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
ST
stable-audio-3-small-sfx SAME-S
Stable · thepatch
Params—
Context—
Q4_K_M0.1 GB
JA
AI21 Jamba Mini 1.7
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
LF
LFM2.5 24B A2B Uncensored no refusal
Lfm · 0xSojalSec
Params24B
Context128K
Q4_K_M15.4 GB
QW
Qwen3.8 Flash Next CodeUD v18a
Qwen · mtita
Params177B
Context256K
Smallest1.3 GB
LF
Atomic Chat / LFM2.5 8B A1B
Lfm · AtomicChat
Params8.47B
Context125K
Q4_K_M5.2 GB
WI
WizardLM-13B-Uncensored
Wizardlm · duyntnet
Params13B
Context2K
Q4_K_M7.9 GB
OM
Omni Edu 9B
Omni · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · BenMonkey11
Params177B
Context256K
Smallest68.2 GB
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
MA
Anthracite Org_Magnum v2 72b
Magnum · anthracite-org
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen2.5 3B Instruct
Qwen · second-state
Params3.09B
Context32K
Q4_K_M1.9 GB
DE
Deepseek v2 Lite Chat
DeepSeek · ggfox00000
Params15.7B
Context160K
Q4_K_M10.4 GB
MY
MythoLogic-13b
Mythologic · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
QW
Swift 1.5 Qwen3.8 27B Badger Mixed
Qwen · CleverBadger
Params27.3B
Context—
Smallest0.0 GB
ME
Medgemma 4b It
Medgemma · second-state
Params3.88B
Context128K
Q4_K_M2.5 GB
LF
LFM3 Omni 2B
Lfm · erenyeager-1
Params1.73B
Context125K
Q4_K_M1.1 GB
QW
Qwopus3.6 27B Fusion
Qwen · Jackrong
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 8B
Qwen · second-state
Params8.19B
Context40K
Q4_K_M5.0 GB
FA
Falcon H1 3B Instruct
Falcon · tiiuae
Params3.15B
Context128K
Q4_K_M1.9 GB