GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
ST
StructLM 34B
Structlm · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
QW
UnifiedReward Flex Qwen3Vl 8b
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
DE
deepseek v4.1 flash 1017
DeepSeek · audreyt
Params755B
Context—
Smallest1.0 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · bullerwins
Params284B
Context—
Smallest0.5 GB
CO
comfy org gguf int4
Comfy · smthem
Params10.3B
Context—
Smallest4.5 GB
NP
NPO CR WMDP
Npo · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
Thyme RL
Thyme · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
CH
Chocolatine 3B Instruct DPO Revised
Chocolatine · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · ZeroWw
Params8.95B
Context256K
Smallest6.4 GB
KI
cerebras/Kimi-Linear-REAP-35B-A3B-Instruct
Kimi · mradermacher
Params35.1B
Context1024K
Q4_K_M21.3 GB
PO
Polyglot Lion 0.6b v1.5
Polyglot · mradermacher
Params596M
Context64K
Q4_K_M0.4 GB
GL
GLM 4.5 Architect 106B A12B
GLM · mradermacher
Params110B
Context128K
Q4_K_M72.9 GB
QW
UnifiedReward Think Qwen3Vl 8b
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3 0.6B coders
Qwen · XformAI-india
Params596M
Context40K
Q4_K_M0.4 GB
GL
Glitch v1.1 8B
Glitch · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
SmaliLLM Qwen3 8B Finetuned
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
UI Genie Agent 7B
Genie · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
AC
AclevoGPT 100M Instruct i1
Aclevogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
RI
Ring flash 2.0 i1
Ring · mradermacher
Params103B
Context32K
Smallest0.3 GB
AL
X ALMA 13B Group5
Alma · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
AG
Agentic R1
Agentic · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ON
Oneirogen 1.5B
Oneirogen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
SRFT Qwen2.5 Math 7B
Qwen · mradermacher
Params7.62B
Context16K
Q4_K_M4.7 GB
NE
NeuralTranslate v0.2
Neuraltranslate · Thermostatic
Params7.24B
Context32K
Q4_K_M4.4 GB
AR
Arcanum 12b
Arcanum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
OP
Open Reasoner Zero 7B
Open · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
SA
SaulLM 141B Instruct i1
Saullm · mradermacher
Params141B
Context64K
Smallest29.6 GB
LL
Llama KoEmpathy
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
HE
HelpingAI Lite
Helpingai · OEvortex
Params1.1B
Context2K
Q4_K_M0.7 GB
CR
CroPond 3B
Cropond · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB