GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
PH
microsoft.phi 4
Phi · DevQuasar-2
Params14.7B
Context16K
Q4_K_M9.1 GB
NU
NuMarkdown-8B-Thinking
Numarkdown · numind
Params7.62B
Context125K
Q4_K_M4.7 GB
TI
TIGER OM
Tiger · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
QW
Qwen3.6 27B DFlash
Qwen · Anbeeld
Params1.73B
Context256K
Q4_K_M1.0 GB
YA
yaoi v1 instruct i1
Yaoi · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
OP
Open1 1.5B Instruct
Open · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
DE
DeepSeek R1 Distill Llama 3B
DeepSeek · hassenhamdi
Params3.21B
Context128K
Q4_K_M2.0 GB
RA
rank1 7b
Rank · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
DAT Llama 3 8B Instruct
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SH
shisa v2.1 unphi4 14b
Shisa · XpressAI
Params14.7B
Context16K
Q4_K_M8.9 GB
OR
Ornith 1.5 122B
Ornith · prithivMLmods
Params125B
Context256K
Smallest69.7 GB
LU
Luna 7B A4B
Luna · mradermacher
Params6.71B
Context256K
Q4_K_M4.1 GB
LL
llm4decompile 6.7b v2 Q4 K M
Llm · Th3S
Params6.74B
Context8K
Q4_K_M4.1 GB
PH
Phi 3 Mini 4k Instruct
Phi · RichardErkhov
Params3.82B
Context4K
Q4_K_M2.3 GB
JA
Jailbreak Generator
Jailbreak · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
FL
Flashlight v1.0 i1
Flashlight · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
JI
JiRackUltra_1b
Jirackultra · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
LightThinker Plus Qwen
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
PH
Phi3 ITA mini 4K instruct i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
OP
OptiMind SFT
Optimind · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GL
cerebras/GLM-4.5-Air-REAP-82B-A12B
GLM · mradermacher
Params85B
Context128K
Smallest34.6 GB
QW
PAPO G Qwen2.5 VL 3B
Qwen · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
MI
MistralHermes CodePro 7B v1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
UL
UltraCM 13B
Ultracm · alvarobartt
Params13B
Context4K
Q4_K_M7.9 GB
AC
acestep-v15-turbo
Ace · DKTechin
Params4.19B
Context32K
Q4_K_M1.4 GB
MI
MiroThinker v1.5 30B
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ED
EduHelp 8B
Eduhelp · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
Trendmicro ailab.Llama Primus Reasoning
Llama · DevQuasar-6
Params8.03B
Context128K
Q4_K_M4.9 GB
SE
SeaLLMs v3 1.5B Chat Uncensored i1
Seallms · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB