GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
Reasoning
GL
Huihui GLM 4.5V Abliterated
GLM · mradermacher
Params107B
Context64K
Q4_K_M70.4 GB
Vision
BI
Big Alice 28B v1
Big · bartowski
Params28.6B
Context64K
Q4_K_M17.3 GB
GGUF
PH
Phi 3 mini 128k instruct IMat
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
GGUF
OR
Ornith1.5 9B 3MPER0RR Obliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
RI
Ring Mini 2.0
Ring · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
GGUF
BE
Beck 1.7B
Beck · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
HY
HybridAgent 8B Agentic
Hybridagent · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
OR
Ornith-1.5-35B-A3B-Uncensored
Ornith · vonvonhero
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
GL
GLM 4.7 Flash Absolute Heresy
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
BL
Q3.5 BlueStar v2 27B Ultra Uncensored Heretic v2
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
QW
CoReward Qwen3 8B Base
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
LI
Ling 3.0 flash VL
Ling · AtomicChat
Params124B
Context128K
Q4_K_M79.3 GB
ReasoningTool useVision
GE
Gemma 4 RUST CODER 12B
Gemma · MassivDash
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningTool use
QW
MangaExpert OCR Qwen3.5 2b 20260820 185447
Qwen · The1Just
Params1.88B
Context256K
Smallest2.0 GB
Vision
BA
bark-small
Bark · cstr
Params404M
Context—
Smallest0.2 GB
GGUF
ZE
zephyr 7b beta
Zephyr · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
microsoft.Phi 4 Reasoning Vision 15B
Phi · DevQuasar
Params14.7B
Context32K
Smallest5.5 GB
ReasoningVision
AS
astrollama 2 70b base aic i1
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SA
Saul 7B Instruct v1
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
ZhangShenao SELM Llama 3 8B Instruct iter 3
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CA
CAT Translate 1.4b
Cat · mmnga-o
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
PH
Barcenas 14b Phi 3 medium ORPO
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
AS
Astrollama 3 8b Chat_Summary
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SA
Sarashina2.2 0.5b
Sarashina · mradermacher
Params793M
Context8K
Q4_K_M0.5 GB
GGUF
PE
Peach 2.0 9B 8k Roleplay Heretic
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
AG
Agent Reflex 8B
Agent · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
MI
MiMo VL 7B SFT 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision

Keep browsing