GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
OR
Ornith 1.5 35B A3B
Ornith · AtomicChat
Params34.7B
Context256K
Q4_K_M21.2 GB
GL
GLM 4.7 Flash
GLM · ggml-org
Params30B
Context198K
Smallest18.2 GB
QW
Huihui Qwable 3.6 27b abliterated MTP
Qwable · huihui-ai
Params27.3B
Context256K
Q4_K_M20.5 GB
GL
GLM 5.3 Flash BF16
GLM · vcruz305
Params321B
Context1024K
Q4_K_M192.9 GB
GL
GLM 4.7 Flash
GLM · bartowski
Params30B
Context198K
Q4_K_M18.5 GB
GL
GLM 5.3 Flash Strata Q2Q3 Experts
GLM · lte-ai
Params292B
Context1024K
Smallest63.2 GB
QW
Huihui Qwable 3.6 27b abliterated
Qwable · huihui-ai
Params27B
Context256K
Q4_K_M19.7 GB
GL
GLM 5.3 Flash CYBERSECURITY
GLM · SyndicateLabs
Params313B
Context1024K
Q4_K_M195.5 GB
QW
Atomic Chat / Qwen3 4B DFlash
Qwen · AtomicChat
Params537M
Context40K
Smallest0.6 GB
GL
Glm-4.6V
GLM · unsloth
Params107B
Context128K
Q4_K_M70.6 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · mrfakename
Params748B
Context—
Q4_K_M444.7 GB
GL
Zai org_GLM 4.6V Flash
GLM · lmstudio-community
Params9.4B
Context128K
Q4_K_M6.2 GB
GL
GLM 5.3 Flash Maya M Derisked IQ2 S
GLM · peasantsmith
Params321B
Context1024K
Smallest116.0 GB
LO
LongCat Video Avatar 1.5 GGUF ComfyUI
Longcat · vantagewithai
Params15.9B
Context—
Q4_K_M12.1 GB
OR
Ornith 1.0 35B Heretic MTP APEX
Ornith · SC117
Params447M
Context—
Smallest0.2 GB
DE
Deepseek-V4-Flash
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.5 GB
GL
GLM 5.3 Flash Coder RCO 152E
GLM · lapadatbogdan
Params170B
Context1024K
Q4_K_M102.6 GB
PH
Phi 3 mini 4k instruct
Phi · microsoft
Params3.82B
Context4K
Smallest2.4 GB
MU
multilingual e5 large instruct
Multilingual · Ralriki
Params559M
Context512
Q4_K_M0.4 GB
OR
Ornith 1.5 35B A3B Huihui Sangreal MTP ICE
Ornith · gbuzhf
Params35.5B
Context256K
Smallest0.2 GB
QW
Qwen3 4B RPG Roleplay V2
Qwen · Chun121
Params4B
Context32K
Q4_K_M2.5 GB
BI
bitnet b1.58 2B 4T
Bitnet · microsoft
Params2.41B
Context4K
Smallest1.2 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
GL
Models Zai Org GLM 4.6V Flash
GLM · MaziyarPanahi
Params9.4B
Context128K
Q4_K_M6.2 GB
GL
cerebras/GLM-4.7-Flash-REAP-23B-A3B
GLM · unsloth
Params23B
Context198K
Q4_K_M14.1 GB
OR
Ornith 1.5 9B Heretic v2
Ornith · Thunder13240
Params8.95B
Context256K
Q4_K_M5.6 GB
JI
JiRackUltra 1b
Jirackultra · CMSManhattan
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek R1 0528
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
DE
DeepSeek V4.1 Flash
DeepSeek · vcruz305
Params748B
Context—
Q4_K_M444.7 GB
BG
bge m3 Q8 0
BGE · ggml-org
Params567M
Context8K
Smallest0.6 GB