GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
Ornith 1.5 35B A3B
Ornith · AtomicChat
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
GL
GLM 4.7 Flash
GLM · ggml-org
Params30B
Context198K
Smallest18.2 GB
GGUF
QW
Huihui Qwable 3.6 27b abliterated MTP
Qwable · huihui-ai
Params27.3B
Context256K
Q4_K_M20.5 GB
Vision
GL
GLM 5.3 Flash BF16
GLM · vcruz305
Params321B
Context1024K
Q4_K_M192.9 GB
Vision
GL
GLM 4.7 Flash
GLM · bartowski
Params30B
Context198K
Q4_K_M18.5 GB
GGUF
GL
GLM 5.3 Flash Strata Q2Q3 Experts
GLM · lte-ai
Params292B
Context1024K
Smallest63.2 GB
GGUF
QW
Huihui Qwable 3.6 27b abliterated
Qwable · huihui-ai
Params27B
Context256K
Q4_K_M19.7 GB
Vision
GL
GLM 5.3 Flash CYBERSECURITY
GLM · SyndicateLabs
Params313B
Context1024K
Q4_K_M195.5 GB
GGUF
QW
Atomic Chat / Qwen3 4B DFlash
Qwen · AtomicChat
Params537M
Context40K
Smallest0.6 GB
ReasoningTool use
GL
Glm-4.6V
GLM · unsloth
Params107B
Context128K
Q4_K_M70.6 GB
Vision
DE
DeepSeek V4.1 Flash 1017
DeepSeek · mrfakename
Params748B
Context—
Q4_K_M444.7 GB
GGUF
GL
Zai org_GLM 4.6V Flash
GLM · lmstudio-community
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
GL
GLM 5.3 Flash Maya M Derisked IQ2 S
GLM · peasantsmith
Params321B
Context1024K
Smallest116.0 GB
GGUF
LO
LongCat Video Avatar 1.5 GGUF ComfyUI
Longcat · vantagewithai
Params15.9B
Context—
Q4_K_M12.1 GB
GGUF
OR
Ornith 1.0 35B Heretic MTP APEX
Ornith · SC117
Params447M
Context—
Smallest0.2 GB
ReasoningVision
DE
Deepseek-V4-Flash
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.5 GB
GGUF
GL
GLM 5.3 Flash Coder RCO 152E
GLM · lapadatbogdan
Params170B
Context1024K
Q4_K_M102.6 GB
CodingReasoningTool use
PH
Phi 3 mini 4k instruct
Phi · microsoft
Params3.82B
Context4K
Smallest2.4 GB
Coding
MU
multilingual e5 large instruct
Multilingual · Ralriki
Params559M
Context512
Q4_K_M0.4 GB
GGUF
OR
Ornith 1.5 35B A3B Huihui Sangreal MTP ICE
Ornith · gbuzhf
Params35.5B
Context256K
Smallest0.2 GB
ReasoningTool use
QW
Qwen3 4B RPG Roleplay V2
Qwen · Chun121
Params4B
Context32K
Q4_K_M2.5 GB
Roleplay
BI
bitnet b1.58 2B 4T
Bitnet · microsoft
Params2.41B
Context4K
Smallest1.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Reasoning
GL
Models Zai Org GLM 4.6V Flash
GLM · MaziyarPanahi
Params9.4B
Context128K
Q4_K_M6.2 GB
GGUF
GL
cerebras/GLM-4.7-Flash-REAP-23B-A3B
GLM · unsloth
Params23B
Context198K
Q4_K_M14.1 GB
GGUF
OR
Ornith 1.5 9B Heretic v2
Ornith · Thunder13240
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
JI
JiRackUltra 1b
Jirackultra · CMSManhattan
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek R1 0528
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
Reasoning
DE
DeepSeek V4.1 Flash
DeepSeek · vcruz305
Params748B
Context—
Q4_K_M444.7 GB
GGUF
BG
bge m3 Q8 0
BGE · ggml-org
Params567M
Context8K
Smallest0.6 GB
Embedding

Keep browsing