GGUF models: gpl-3.0 license

272 GGUF models listed under the gpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 72.3B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Sakura 13B Qwen2beta v0.10pre0
Qwen · Tabing010102
Params14.2B
Context32K
Smallest9.0 GB
GGUF
PH
Phi 4 Abliterated
Phi · UntitledMinister
Params14.7B
Context16K
Smallest10.6 GB
GGUF
SA
Sarvam Translate
Sarvam · Savyasaachin
Params3.88B
Context128K
Smallest4.1 GB
GGUF
LL
tamil llama 13b base v0.1
Llama · abhinand
Params13.2B
Context4K
Q4_K_M8.0 GB
GGUF
GE
Gemma 2 2b Chinese It
Gemma · Asureu
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest5.3 GB
GGUF
NA
NanoLM 70M Instruct v1
Nanolm · Felladrin
Params71M
Context2K
Smallest0.1 GB
GGUF
LL
k llama tiny
Llama · Prashantmdgl9
Params6.88B
Context4K
Smallest4.9 GB
GGUF
LL
MIXdevAI Llama
Llama · Kolyadual
Params1.24B
Context128K
Smallest0.8 GB
Tool use
LL
Llama 2 7b Q4 K M
Llama · linuxer
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PH
Phi 4 Abliterated
Phi · UntitledMinister
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
SA
Sarvam Translate
Sarvam · fischerman
Params3.88B
Context128K
Smallest1.7 GB
GGUF
NA
NanoLM 0.3B Instruct v1
Nanolm · mradermacher
Params315M
Context128K
Q4_K_M0.3 GB
GGUF
LU
on lunar vlm v1
Lunar · circulus
Params3.82B
Context4K
Q4_K_M2.3 GB
Vision
GE
Gemma 2 2b Chinese It
Gemma · DataSoul
Params2.61B
Context8K
Smallest1.9 GB
GGUF
BE
34b beta
Beta · nold
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
SA
salamandraTA 7b Instruct
Salamandrata · maigonis
Params7.77B
Context8K
Q4_K_M4.9 GB
GGUF
SA
Sarvam Translate
Sarvam · shinshekai
Params3.88B
Context128K
Smallest4.1 GB
GGUF
SA
Sarvam Translate
Sarvam · jagan546
Params3.88B
Context128K
Smallest4.1 GB
GGUF
QW
Qwen3.5 0.8B Thinking Distilled Gemini3Pro
Qwen · generalchucklese
Params18M
Context—
Q4_K_M0.0 GB
Reasoning
QW
zhihu tech zhichang qwen 7b
Qwen · chanceQZhang
Params7.62B
Context32K
Smallest5.4 GB
GGUF
QW
qwen3 sussurro
Qwen · cesp99
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
NE
Newton Bot 2A Standard_Merged Gguf
Newton · kirilldual0987
Params8.19B
Context40K
Smallest8.7 GB
CodingReasoningTool use
QW
Meissa Qwen2.5 14B Instruct
Qwen · Orion-zhen
Params14.8B
Context32K
Smallest15.7 GB
RoleplayTool use
NO
NovelAI Krake v2
Novelai · onicubag
Params20.6B
Context2K
Smallest41.1 GB
GGUF
NE
Newton Bot 3
Newton · Kolyadual
Params8.19B
Context128K
Smallest8.7 GB
Tool use
DA
Dafifi 14B
Dafifi · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
PH
Phi 4 Abliterated
Phi · ApexReign
Params14.7B
Context16K
Q4_K_M9.1 GB
GGUF
CH
Newton bot 2A mini merged
Chatgpt · Kolyadual
Params4.02B
Context40K
Smallest2.6 GB
CodingReasoning
BE
35b beta2ep Q4 K M
Beta · vanxxxx
Params35B
Context8K
Q4_K_M21.5 GB
Tool use

Keep browsing