GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
StructLM 34B
Structlm · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
QW
UnifiedReward Flex Qwen3Vl 8b
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
DE
deepseek v4.1 flash 1017
DeepSeek · audreyt
Params755B
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · bullerwins
Params284B
Context—
Smallest0.5 GB
GGUF
CO
comfy org gguf int4
Comfy · smthem
Params10.3B
Context—
Smallest4.5 GB
GGUF
NP
NPO CR WMDP
Npo · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
Thyme RL
Thyme · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
CH
Chocolatine 3B Instruct DPO Revised
Chocolatine · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B
Qwen · ZeroWw
Params8.95B
Context256K
Smallest6.4 GB
ReasoningTool use
KI
cerebras/Kimi-Linear-REAP-35B-A3B-Instruct
Kimi · mradermacher
Params35.1B
Context1024K
Q4_K_M21.3 GB
Tool use
PO
Polyglot Lion 0.6b v1.5
Polyglot · mradermacher
Params596M
Context64K
Q4_K_M0.4 GB
Vision
GL
GLM 4.5 Architect 106B A12B
GLM · mradermacher
Params110B
Context128K
Q4_K_M72.9 GB
ReasoningTool use
QW
UnifiedReward Think Qwen3Vl 8b
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
QW
Qwen3 0.6B coders
Qwen · XformAI-india
Params596M
Context40K
Q4_K_M0.4 GB
CodingReasoningTool use
GL
Glitch v1.1 8B
Glitch · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
SmaliLLM Qwen3 8B Finetuned
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingReasoningTool use
GE
UI Genie Agent 7B
Genie · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
AC
AclevoGPT 100M Instruct i1
Aclevogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
Reasoning
RI
Ring flash 2.0 i1
Ring · mradermacher
Params103B
Context32K
Smallest0.3 GB
GGUF
AL
X ALMA 13B Group5
Alma · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AG
Agentic R1
Agentic · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
ON
Oneirogen 1.5B
Oneirogen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
QW
SRFT Qwen2.5 Math 7B
Qwen · mradermacher
Params7.62B
Context16K
Q4_K_M4.7 GB
Reasoning
NE
NeuralTranslate v0.2
Neuraltranslate · Thermostatic
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AR
Arcanum 12b
Arcanum · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
OP
Open Reasoner Zero 7B
Open · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
SA
SaulLM 141B Instruct i1
Saullm · mradermacher
Params141B
Context64K
Smallest29.6 GB
GGUF
LL
Llama KoEmpathy
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
HE
HelpingAI Lite
Helpingai · OEvortex
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
CR
CroPond 3B
Cropond · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision

Keep browsing