GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
UL
UltraLink LM
Ultralink · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
RI
Rio 3.5 Open 397B
Rio · bartowski
Params403B
Context256K
Q4_K_M245.0 GB
QW
Qwen3.8 1.0B A0.6B
Qwen · TEKIBO
Params966M
Context256K
Smallest0.6 GB
PH
phi 3 22b 128k i1
Phi · mradermacher
Params22B
Context128K
Q4_K_M13.6 GB
PH
Phi 4 mini instruct heretic
Phi · richardyoung
Params3.84B
Context128K
Q4_K_M2.5 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · VitreousCut
Params9.2B
Context256K
Q4_K_M6.1 GB
PY
Pyrex 8B Instruct Uncensored
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
MagenticBrain
Magenticbrain · devehz
Params14.8B
Context40K
Q4_K_M9.0 GB
AU
AURA Eve Tactical Instruct 3.8B
Aura · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
WH
When2Think ThinkOnly 1.5B
When · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · bartowski
Params14B
Context4K
Q4_K_M8.4 GB
SU
Sumo T9 7B v0.1 i1
Sumo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
FL
FluentlyLM Prinum Abliterated
Fluentlylm · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen2.5 Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
AG
Agentflow Planner 7b
Agentflow · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
Nexus 4x7B IKM MLX
Nexus · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
DE
Deepseek ai.DeepSeek V3.1 Terminus BF16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
CO
CodeFuse SVR 8B
Codefuse · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GO
GoLongRL 30B A3B
Golongrl · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
PH
Phi 3 mini 4k instruct
Phi · backyardai
Params3.82B
Context4K
Q4_K_M2.4 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · prometheusAIR
Params748B
Context1024K
Smallest0.8 GB
QW
Qwen SEA LION v4 32B IT
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
KI
Kimi VL A3B Instruct
Kimi · mradermacher
Params16B
Context128K
Q4_K_M10.5 GB
M2
m2m100 418m
cstr
Params486M
Context—
Smallest0.3 GB
DE
DeepScaleR 1.5B Preview Abliterated
Deepscaler · ThomasBaruzier
Params1.78B
Context128K
Q4_K_M1.1 GB
HI
HiDream I1 Fast
Hidream · city96
Params17.1B
Context—
Q4_K_M11.5 GB
OR
Ornith 1.5 9B OBLITERATED
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
MI
MiroThinker v1.0 8B
Mirothinker · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB
AU
authormist originality
Authormist · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CO
Codefu 7b v0.1
Codefu · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB