GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
tiger-lab_mammoth-coder-13b
Mammoth · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
JI
JiRackUltra_7b
Jirackultra · mradermacher
Params7.6B
Context128K
Q4_K_M4.7 GB
Tool use
NU
NuMarkdown-8B-Thinking
Numarkdown · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
NE
Next 8b
Next · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
Reasoning
DO
Dots.Llm1.Inst
Dots · unsloth
Params143B
Context32K
Q4_K_M94.5 GB
GGUF
VI
Mythos Nano Final
Vibethinker · squ11z1
Params3.1B
Context128K
Q4_K_M1.9 GB
CodingReasoning
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Reasoning
OR
Ornith 1.5 35B A3B FULLY OBLITERATED
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
PH
Phi 3.5 MoE Instruct
Phi · bartowski
Params41.9B
Context128K
Q4_K_M25.3 GB
Coding
DE
DeepSeek V4.1 Flash 1017 GSQ RCO
DeepSeek · taurusduan
Params197B
Context—
Smallest110.6 GB
GGUF
KU
Kuvera 8B v0.1.0
Kuvera · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
YU
YuLan Mini
Yulan · bartowski
Params2.42B
Context28K
Q4_K_M1.8 GB
Coding
QW
Qwen2.5 Coder 14B Instruct Uncensored
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
DE
DeepSeek V4 Flash 0731 MXFP4 Q3 K Q2 K mixed
DeepSeek · BahamutRU
Params284B
Context—
Smallest126.9 GB
GGUF
QW
Huihui Qwen3 Next 80B A3B Thinking Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
DE
DeepSeek V4.1 Flash 1017 VQ
DeepSeek · Baekpica
Params485M
Context—
Smallest1.0 GB
GGUF
MI
MiMo V2.5
Mimo · huihui-ai
Params310B
Context1024K
Smallest186.7 GB
ReasoningTool useVision
LL
Llama 2 13b Hf
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 GSQ RCO StrixHalo
DeepSeek · Harsha001
Params658B
Context1024K
Smallest214.8 GB
ReasoningTool use
GL
GLM 5.3 Flash dealignai orcarouter merge
GLM · Cypherfox
Params320B
Context1024K
Smallest170.9 GB
Vision
OP
Openhands Lm 7b v0.1
Openhands · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
PH
phi 2 orange
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
TR
Truthful DPO TomGrc FusionNet 7Bx2 MoE 13B i1
Truthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
Coding
MI
Nexus IKM Mistral Instruct v0.2 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Unbiased
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
OR
Ornith 1.5 9B
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
PH
Phi 3 song lyrics 1.0 i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
OR
Ornith 1.0 35B MTP
Ornith · SC117
Params447M
Context256K
Smallest14.3 GB
ReasoningVision

Keep browsing