GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
Ornith 1.5 9B
Ornith · abenzerps
Params8.95B
Context256K
Smallest2.8 GB
ReasoningTool use
CY
Cyber Tiel Coder 35B A3B APEX I MiniPlus V2.1
Cyber · IsValorum
Params34.7B
Context256K
Smallest1.5 GB
GGUF
WH
whisper large v3 turbo
Whisper · xkeyC
Params809M
Context—
Smallest0.5 GB
GGUF
BG
bge-small-zh-v1.5
BGE · CompendiumLabs
Params24M
Context512
Q4_K_M0.0 GB
Embedding
LI
Ling-3.0-flash-Sante
Ling · AtomicChat
Params127B
Context256K
Smallest35.7 GB
ReasoningTool use
GL
GLM 4 9B 0414
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 GSQ agentic strata
DeepSeek · kaushikvira
Params14.7B
Context—
Smallest5.7 GB
GGUF
PA
MS3.2 PaintedFantasy v4.1 24B
Paintedfantasy · zerofata
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
DE
Deepseek-R1-0528
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
CodingReasoning
GL
Huihui GLM 4.7 Flash Abliterated
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
GL
GLM-5.3-Flash
GLM · pfeifferj
Params313B
Context1024K
Smallest117.5 GB
Vision
OR
Ornith 1.5 35B A3B Heretic MTP APEX
Ornith · SC117
Params447M
Context256K
Smallest14.3 GB
ReasoningVision
GL
GLM 5.3 Flash UNCENSORED mlx oQ4e DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest2.4 GB
Vision
GL
GLM 4.6V Flash
GLM · bartowski
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
OR
Huihui Ornith 1.0 9B abliterated MTP
Ornith · huihui-ai
Params2.28B
Context256K
Q4_K_M6.9 GB
GGUF
GL
Huihui GLM 4.7 Flash Abliterated
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct Uncensored
Qwen · BlossomsAI
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
OR
Ornith
Ornith · pfeifferj
Params34.7B
Context256K
Smallest13.0 GB
GGUF
MI
MiMo-V2.6-Flash-RL
Mimo · YanissAmz
Params310B
Context1024K
Smallest107.8 GB
GGUF
MO
Moonshine Streaming Medium
Moonshine · handy-computer
Params266M
Context—
Smallest0.3 GB
GGUF
MI
MiMo-V2.6-Flash-RL
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
Vision
GI
GigaAM v3 CTC
Gigaam · handy-computer
Params221M
Context—
Q4_K_M0.2 GB
GGUF
QW
Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
GL
GLM 5.3 Flash abliterated Maya M
GLM · alesha-pro
Params370B
Context64K
Smallest0.0 GB
Vision
OR
Ornith 1.0 35B
Ornith · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
Vision
PH
phi 4
Phi · microsoft
Params14.7B
Context16K
Smallest3.6 GB
Coding
PH
phi 4
Phi · bartowski
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
GL
GLM-5.3-Flash
GLM · neuralll
Params313B
Context1024K
Smallest113.6 GB
GGUF
VI
vibevoice.cpp models
Vibevoice · mudler
Params—
Context—
Smallest0.0 GB
GGUF

Keep browsing