GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 8B Heretic
Qwen · saidutta69
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
KR
Krea 2 Raw
Krea · vantagewithai
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
QW
Dongfangshuo Qwen3.8 27B NSFW v4
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
MI
Codestral-22B-v0.1
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
TI
TIPO 200M Ft
Tipo · KBlueLeaf
Params203M
Context2K
Smallest0.4 GB
Vision
HU
HunyuanVideo
Hunyuanvideo · city96
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
LF
LFM2 350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
RO
Rocinante 12B v1.1
Rocinante · TheDrummer
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
RO
Rocinante 12B v1.1
Rocinante · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
OpenYourMind_Minimax M3 Abliterated Clean
Minimax · Sica-Quants-2
Params426B
Context1024K
Smallest155.0 GB
ReasoningVision
FA
FastH3 V2 GGUFs
Fastvideo · realrebelai
Params35B
Context—
Q4_K_M14.6 GB
GGUF
YI
brucethemoose_yi-34b-200k-dare-megamerge-v8
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
GE
Nz Gemma4 12B LTX25
Gemma · Rootport
Params13.1B
Context—
Q4_K_M9.2 GB
GGUF
LF
LFM2.5 Embedding 350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
Embedding
IN
IndexTTS 2.5
Indextts · Richasy
Params—
Context—
Smallest7.9 GB
GGUF
ST
stable code 3b
Stable · stabilityai
Params2.8B
Context16K
Smallest2.0 GB
Coding
DE
deepseek llm 7B chat
DeepSeek · TheBloke
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
DE
deepseek-ai_deepseek-coder-5.7bmqa-base
DeepSeek · TheBloke
Params5.7B
Context16K
Q4_K_M3.4 GB
Coding
QW
Qwen3.5 27B WebNovel Writer Zh
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
CO
Cotype Nano
Cotype · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Swift Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M125.6 GB
ReasoningVision
ME
Medgemma-27B-It
Medgemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
EmbeddingVision
GL
glm-4-9b-chat
GLM · legraphista
Params9.4B
Context128K
Smallest4.0 GB
GGUF
QW
Agnes 3.0 Qwen
Qwen · bartowski
Params180B
Context1024K
Q4_K_M127.1 GB
ReasoningTool useVision
QW
Qwen2.5 Vl 7b Cam Motion
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
DE
DeepSeek R1 Distill Llama 8B Heretic
DeepSeek · saidutta69
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
QW
Qwen2.5 Coder 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
FL
krea
Flux · calcuis
Params11.9B
Context—
Q4_K_M7.1 GB
GGUF
QW
JiRackDeltaNet 180b
Qwen · CMSManhattan
Params177B
Context256K
Q4_K_M119.2 GB
ReasoningTool use
ME
Medgemma 27b It
Medgemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
EmbeddingVision

Keep browsing