GGUF models: cc license

119 GGUF models listed under the cc license on Hugging Face. Always read the license text before commercial use. Sizes run from 33M to 70.6B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
GA
GalaxyFarAway DialoGPT Yoda
Galaxyfaraway · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
MU
mula
Mula · Musouno-Enma99
Params825M
Context32K
Smallest0.9 GB
GGUF
LL
Dark Triad Adam Llama3.2 3B v2
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
GA
Hansolo
Galaxyfaraway · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
LL
llama 3 sqlcoder 8b
Llama · MatrixIA
Params8.03B
Context8K
Smallest4.7 GB
Coding
AY
ayaka
Ayaka · HuanLin
Params7.62B
Context32K
Smallest4.4 GB
GGUF
MH
MHENN5
Mhenn · netcat420
Params7.24B
Context32K
Smallest4.4 GB
Coding
QW
test qwen2.5 7B
Qwen · n0ni
Params7.62B
Context986K
Smallest4.7 GB
Tool use
SO
SOLAR 19.2B Instruct v1.0 Q4 K M
Solar · bingbort
Params18.6B
Context4K
Q4_K_M11.2 GB
GGUF
PO
poc strlen overflow
Poc · aTmHnTR
Params—
Context—
Smallest0.0 GB
GGUF
GE
Gemma 3 Evacuation
Gemma · pozapas
Params3.88B
Context128K
Smallest4.1 GB
GGUF
LL
LLM Based Hindi Biology Chatbot
Llm · JoardarRitwik
Params8.03B
Context128K
Smallest8.5 GB
GGUF
MI
mistral nemo r1
Mistral · slimShaders
Params12.2B
Context128K
Q4_K_M7.5 GB
Reasoning
AL
alielfilali01 PG7BB
Alielfilali · RichardErkhov
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
WO
li
Woshilihaoran · woshilihaoran
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TE
test model
Test · OmerHofFJ
Params8.03B
Context128K
Smallest2.9 GB
Tool use
LL
llama finetune
Llama · sujaytechtez
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PI
Pillar 3 Knox 9625
Pillar · Malcolmdenis
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
NO
Noya
Noya · Garix
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
YI
Yi 6B Infinity Chat
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
LL
llama3.1 unsloth.Q6 K
Llama · adeljebali
Params8.03B
Context128K
Smallest6.6 GB
GGUF
NE
neural history chat v1.5 q8
Neural · ambrosfitz
Params7.24B
Context32K
Smallest7.7 GB
GGUF
SE
sethuiyer Diana 7B
Sethuiyer · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
deeparousal
Deeparousal · penile
Params8.03B
Context128K
Smallest6.6 GB
GGUF
CO
CosMoE AlpacaLight v0.2
Cosmoe · mradermacher
Params5.37B
Context2K
Q4_K_M3.3 GB
GGUF
DE
deepscalerR1
Deepscalerr · lolimitramandal
Params1.78B
Context128K
Smallest3.6 GB
Tool use
MB
MBX 7B v3
Mbx · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
ResearchQwen 2.5 3B LoRA
Qwen · Programmer-RD-AI
Params3.09B
Context32K
Q4_K_M3.3 GB
Tool use
GE
generic nano616
Generic · generic-bot
Params507M
Context896
Smallest0.3 GB
GGUF

Keep browsing