GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
QW
Parm 2 CoT 14B 16k o1 QwQ i1
Qwen · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PY
PyroNet v1.5
Pyronet · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
DE
LoneStriker DeepSeek R1 Distill Llama 70B 8.0bpw h8 exl2 GGUF smashed
DeepSeek · PrunaAI
Params13M
Context128K
Q4_K_M0.0 GB
GI
ai-sage/GigaChat-20B-A3B-instruct
Gigachat · ai-sage
Params20.6B
Context128K
Q4_K_M12.5 GB
LL
Llama 3.1 8B Instruct AgenticLU
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PH
phi 4
Phi · Mungert
Params14.7B
Context16K
Q4_K_M9.1 GB
DE
DeepCoder-1.5B-Preview
DeepSeek · Mungert
Params1.78B
Context128K
Q4_K_M1.2 GB
JO
JOSIE 1.1 4B Thinking
Josie · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
DE
DeepSeek R1 Distill Qwen 1.5B Fully Uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
PH
tuong nguyen prd Phi 3.5 mini 128k instruct
Phi · RichardErkhov
Params3.82B
Context128K
Q4_K_M2.4 GB
AT
Atlas Pro 7B Preview 1M
Athena · aayanmishra-ml
Params7.62B
Context986K
Q4_K_M4.7 GB
TE
4.5test
Test · mradermacher
Params110B
Context128K
Q4_K_M72.9 GB
ME
MedResearcher R1 32B
Medresearcher · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
UnifiedReward Edit Qwen3Vl 8b
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · n00b001
Params8.19B
Context128K
Q4_K_M5.0 GB
OR
Tiel Inspired Coder 9B
Ornith · VitreousCut
Params9.2B
Context256K
Q4_K_M5.8 GB
LE
LegalOne R1 8B
Legalone · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
CO
cow encoder
Cow · calcuis
Params2.62B
Context—
Smallest0.4 GB
AS
astrollama 3 8b chat aic
Astrollama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
phi-4-mini
Phi · EasierAI
Params3.84B
Context128K
Smallest2.6 GB
LI
inclusionAI/Ling-1T
Ling · bartowski
Params1000B
Context32K
Q4_K_M608.4 GB
YO
Yoshino 0.8B
Yoshino · mradermacher
Params773M
Context256K
Q4_K_M0.5 GB
LL
Llama 2 7b Hf
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GE
Gemma 2 9b It SimPO
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
Macaron V1 Tall
Macaron · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
CY
Cydonia 22B v1.2 i1
Cydonia · BasedAGI
Params22.2B
Context32K
Q4_K_M13.3 GB
LL
GraphMind LLAMA 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
JarvisVLA Qwen2 VL 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
GenPRM 7B
Genprm · tinyopsec
Params7.62B
Context128K
Q4_K_M4.7 GB