GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
GL
Huihui GLM 4.5V Abliterated
GLM · mradermacher
Params107B
Context64K
Q4_K_M70.4 GB
BI
Big Alice 28B v1
Big · bartowski
Params28.6B
Context64K
Q4_K_M17.3 GB
PH
Phi 3 mini 128k instruct IMat
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
OR
Ornith1.5 9B 3MPER0RR Obliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
RI
Ring Mini 2.0
Ring · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
BE
Beck 1.7B
Beck · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
HY
HybridAgent 8B Agentic
Hybridagent · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
OR
Ornith-1.5-35B-A3B-Uncensored
Ornith · vonvonhero
Params34.7B
Context256K
Q4_K_M21.2 GB
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
GL
GLM 4.7 Flash Absolute Heresy
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
DE
DeepSeek R1 Distill Llama 8B 3MPER0RR Abliterated
DeepSeek · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
BL
Q3.5 BlueStar v2 27B Ultra Uncensored Heretic v2
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
CoReward Qwen3 8B Base
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
LI
Ling 3.0 flash VL
Ling · AtomicChat
Params124B
Context128K
Q4_K_M79.3 GB
GE
Gemma 4 RUST CODER 12B
Gemma · MassivDash
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
MangaExpert OCR Qwen3.5 2b 20260820 185447
Qwen · The1Just
Params1.88B
Context256K
Smallest2.0 GB
BA
bark-small
Bark · cstr
Params404M
Context—
Smallest0.2 GB
ZE
zephyr 7b beta
Zephyr · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
microsoft.Phi 4 Reasoning Vision 15B
Phi · DevQuasar
Params14.7B
Context32K
Smallest5.5 GB
AS
astrollama 2 70b base aic i1
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
SA
Saul 7B Instruct v1
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
ZhangShenao SELM Llama 3 8B Instruct iter 3
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
CA
CAT Translate 1.4b
Cat · mmnga-o
Params1.41B
Context8K
Q4_K_M0.9 GB
PH
Barcenas 14b Phi 3 medium ORPO
Phi · QuantFactory
Params14B
Context4K
Q4_K_M8.4 GB
AS
Astrollama 3 8b Chat_Summary
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
SA
Sarashina2.2 0.5b
Sarashina · mradermacher
Params793M
Context8K
Q4_K_M0.5 GB
PE
Peach 2.0 9B 8k Roleplay Heretic
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
AG
Agent Reflex 8B
Agent · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
MI
MiMo VL 7B SFT 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB