GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
OR
Ornith 1.5 9B
Ornith · abenzerps
Params8.95B
Context256K
Smallest2.8 GB
CY
Cyber Tiel Coder 35B A3B APEX I MiniPlus V2.1
Cyber · IsValorum
Params34.7B
Context256K
Smallest1.5 GB
WH
whisper large v3 turbo
Whisper · xkeyC
Params809M
Context—
Smallest0.5 GB
BG
bge-small-zh-v1.5
BGE · CompendiumLabs
Params24M
Context512
Q4_K_M0.0 GB
LI
Ling-3.0-flash-Sante
Ling · AtomicChat
Params127B
Context256K
Smallest35.7 GB
GL
GLM 4 9B 0414
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
DE
DeepSeek V4.1 Flash 1017 GSQ agentic strata
DeepSeek · kaushikvira
Params14.7B
Context—
Smallest5.7 GB
PA
MS3.2 PaintedFantasy v4.1 24B
Paintedfantasy · zerofata
Params23.6B
Context128K
Q4_K_M14.3 GB
DE
Deepseek-R1-0528
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
GL
Huihui GLM 4.7 Flash Abliterated
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GL
GLM-5.3-Flash
GLM · pfeifferj
Params313B
Context1024K
Smallest117.5 GB
OR
Ornith 1.5 35B A3B Heretic MTP APEX
Ornith · SC117
Params447M
Context256K
Smallest14.3 GB
GL
GLM 5.3 Flash UNCENSORED mlx oQ4e DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest2.4 GB
GL
GLM 4.6V Flash
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.2 GB
OR
Huihui Ornith 1.0 9B abliterated MTP
Ornith · huihui-ai
Params2.28B
Context256K
Q4_K_M6.9 GB
GL
Huihui GLM 4.7 Flash Abliterated
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
QW
Qwen2.5 Coder 7B Instruct Uncensored
Qwen · BlossomsAI
Params7.62B
Context32K
Q4_K_M4.7 GB
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
OR
Ornith
Ornith · pfeifferj
Params34.7B
Context256K
Smallest13.0 GB
MI
MiMo-V2.6-Flash-RL
Mimo · YanissAmz
Params310B
Context1024K
Smallest107.8 GB
MO
Moonshine Streaming Medium
Moonshine · handy-computer
Params266M
Context—
Smallest0.3 GB
MI
MiMo-V2.6-Flash-RL
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
GI
GigaAM v3 CTC
Gigaam · handy-computer
Params221M
Context—
Q4_K_M0.2 GB
QW
Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GL
GLM 5.3 Flash abliterated Maya M
GLM · alesha-pro
Params370B
Context64K
Smallest0.0 GB
OR
Ornith 1.0 35B
Ornith · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
PH
phi 4
Phi · microsoft
Params14.7B
Context16K
Smallest3.6 GB
PH
phi 4
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
GL
GLM-5.3-Flash
GLM · neuralll
Params313B
Context1024K
Smallest113.6 GB
VI
vibevoice.cpp models
Vibevoice · mudler
Params—
Context—
Smallest0.0 GB