GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
MA
tiger-lab_mammoth-coder-13b
Mammoth · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
JI
JiRackUltra_7b
Jirackultra · mradermacher
Params7.6B
Context128K
Q4_K_M4.7 GB
NU
NuMarkdown-8B-Thinking
Numarkdown · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
NE
Next 8b
Next · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
DO
Dots.Llm1.Inst
Dots · unsloth
Params143B
Context32K
Q4_K_M94.5 GB
VI
Mythos Nano Final
Vibethinker · squ11z1
Params3.1B
Context128K
Q4_K_M1.9 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
OR
Ornith 1.5 35B A3B FULLY OBLITERATED
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
PH
Phi 3.5 MoE Instruct
Phi · bartowski
Params41.9B
Context128K
Q4_K_M25.3 GB
DE
DeepSeek V4.1 Flash 1017 GSQ RCO
DeepSeek · taurusduan
Params197B
Context—
Smallest110.6 GB
KU
Kuvera 8B v0.1.0
Kuvera · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
YU
YuLan Mini
Yulan · bartowski
Params2.42B
Context28K
Q4_K_M1.8 GB
QW
Qwen2.5 Coder 14B Instruct Uncensored
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
DE
DeepSeek V4 Flash 0731 MXFP4 Q3 K Q2 K mixed
DeepSeek · BahamutRU
Params284B
Context—
Smallest126.9 GB
QW
Huihui Qwen3 Next 80B A3B Thinking Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
DE
DeepSeek V4.1 Flash 1017 VQ
DeepSeek · Baekpica
Params485M
Context—
Smallest1.0 GB
MI
MiMo V2.5
Mimo · huihui-ai
Params310B
Context1024K
Smallest186.7 GB
LL
Llama 2 13b Hf
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
DE
DeepSeek V4.1 Flash 1017 GSQ RCO StrixHalo
DeepSeek · Harsha001
Params658B
Context1024K
Smallest214.8 GB
GL
GLM 5.3 Flash dealignai orcarouter merge
GLM · Cypherfox
Params320B
Context1024K
Smallest170.9 GB
OP
Openhands Lm 7b v0.1
Openhands · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
PH
phi 2 orange
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
TR
Truthful DPO TomGrc FusionNet 7Bx2 MoE 13B i1
Truthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
PH
Phi 3 Medium 128k Instruct
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
MI
Nexus IKM Mistral Instruct v0.2 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Unbiased
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
Ornith 1.5 9B
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
PH
Phi 3 song lyrics 1.0 i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
OR
Ornith 1.0 35B MTP
Ornith · SC117
Params447M
Context256K
Smallest14.3 GB