GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
KI
Kimi K3 Uncensored
Kimi · Ryanchen911
Params2780B
Context1024K
Smallest579.5 GB
GGUF
QW
Qwen3.8 27B Finance
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen2.5 Coder 7B Instruct Heretic
Qwen · saidutta69
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
KI
Kimi K3
Kimi · AtomicChat
Params2780B
Context1024K
Smallest589.5 GB
ReasoningTool useVision
FL
Persephone Flux 2.0 Q8
Flux · pyys
Params11.9B
Context—
Smallest12.7 GB
GGUF
KI
Qwopus3.5 122B A10B Kimi K2.6 destill healed abliterated
Kimi · OpenYourMind
Params125B
Context256K
Q4_K_M75.8 GB
Vision
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
Coding
QW
Qwen Image 2.1 ComfyUI
Qwen · vantagewithai
Params7.12B
Context—
Q4_K_M4.2 GB
GGUF
RU
RusMind.Вспышка 3.5
Rusmind · DICPlay
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
AI
Airoboros L2 70B GPT4 m2.0
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
PH
Phi 3 mini 128k instruct imatrix
Phi · duyntnet
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
MI
MiniMaxAI_MiniMax M2.7
Minimax · lmstudio-community
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
LF
Lfm2-8B-A1B
Lfm · unsloth
Params8.34B
Context125K
Q4_K_M5.0 GB
GGUF
FL
FLUX.1 Depth dev
Flux · SporkySporkness
Params11.9B
Context—
Smallest6.8 GB
GGUF
NE
AceReason Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoning
QW
Qwen2.5 3B Instruct
Qwen · gaianet
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
FA
Falcon-H1-1.5B-Deep-Instruct
Falcon · unsloth
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
QW
ATX Swift 1.5 Qwen3.8 27B Uncensored IQ4 XS M
Qwen · jakeatx
Params27.3B
Context256K
Smallest0.0 GB
GGUF
LL
Llama 3_1 Nemotron 51B Instruct
Llama · bartowski
Params51.5B
Context128K
Q4_K_M31.0 GB
GGUF
SE
SenseVoiceSmall
Sensevoicesmall · cstr
Params234M
Context—
Smallest0.1 GB
GGUF
EX
EXAONE-4.0-32B
Exaone · LGAI-EXAONE
Params32B
Context128K
Q4_K_M19.3 GB
GGUF
UN
ajibawa-2023_uncensored-jordan-7b
Uncensored · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
ST
stable diffusion 3.5 medium
Stable · city96
Params2.47B
Context—
Q4_K_M1.8 GB
GGUF
DE
DeepSeek V2.5
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
GGUF
YI
brucethemoose_capybara-tess-yi-34b-200k-dare-ties
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
VE
VecGlypher 27b It
Vecglypher · wahidmounir
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
SA
Saiga_Yandexgpt_8B_Sft_M4_D19_Hf
Saiga · IlyaGusev
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v3
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingReasoningTool use
YU
Ruach Studio Models v2
Yue · goldhub
Params632M
Context32K
Q4_K_M4.7 GB
Vision
NE
Nemotron 3.5 Embed 8B BF16
Nemotron · W4D
Params7.95B
Context256K
Q4_K_M4.9 GB
EmbeddingVision

Keep browsing