GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM-4.7-Flash-Coder
GLM · ngquocvinh
Params30B
Context198K
Q4_K_M18.1 GB
Coding
GL
GLM 4.5V
GLM · mradermacher
Params107B
Context64K
Q4_K_M70.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 14B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
QW
Qwen3 8B ERP v0.1
Qwen · Aratako
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
LT
LTX 2.3 test
Ltx · smthem
Params12.2B
Context—
Smallest8.7 GB
GGUF
MI
mimo asr
Mimo · cstr
Params8.02B
Context—
Smallest0.0 GB
GGUF
GL
GLM 4.5
GLM · unsloth
Params358B
Context128K
Q4_K_M216.5 GB
GGUF
QW
Co Rewarding I Qwen3 8B Base MATH
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
PH
phi 4 i1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
GL
GLM 5.1
GLM · unsloth
Params754B
Context198K
Q4_K_M464.5 GB
GGUF
SM
nisten/Biggie-SmoLlm-0.15B-Base
SmolLM · nisten
Params152M
Context2K
Smallest0.2 GB
GGUF
MI
MiMo V2.6 Flash RL Mixed Quant
Mimo · Baekpica
Params310B
Context—
Smallest0.5 GB
GGUF
VI
vibevoice asr
Vibevoice · cstr
Params8.33B
Context—
Smallest0.0 GB
GGUF
OR
Ornith 1.5 REAP 20B A3B
Ornith · sleepyeldrazi
Params19B
Context256K
Smallest10.5 GB
ReasoningTool use
HY
HybridAgent 14B Agentic
Hybridagent · bartowski
Params14.8B
Context32K
Q4_K_M9.3 GB
ReasoningTool use
PH
phi3.5 gutenberg 4B i1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
QW
Qwen2.5 Coder 14B Instruct Uncensored
Qwen · BlossomsAI
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
OR
Ornith-1.5-9B-Uncensored
Ornith · vonvonhero
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
FR
FrogNano 4B 2609
Frognano · webmp3
Params4.33B
Context256K
Smallest2.0 GB
Vision
KI
Kimi-Dev-72B
Kimi · unsloth
Params72.7B
Context128K
Smallest23.0 GB
Coding
BG
bge m3
BGE · CompendiumLabs
Params567M
Context8K
Smallest1.2 GB
Embedding
UN
unlimited ocr
Unlimited · vimalnakrani
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
UN
Unlimited OCR 2
Unlimited · AtomicChat
Params2.94B
Context128K
Smallest2.0 GB
Vision
PH
Phi 4 Reasoning
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
YI
Faro Yi 34B i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
OR
Ornith 1.5 9B Heretic
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
CH
Chocolatine 14B Instruct DPO v1.2 i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF
IN
INTELLECT 3
Intellect · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
Reasoning
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
GGUF
GL
GLM 5.3 Flash Uncensored Mixed Quant
GLM · Baekpica
Params564M
Context—
Smallest1.1 GB
GGUF

Keep browsing