GGUF models: gpl-3.0 license
272 GGUF models listed under the gpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 72.3B parameters. The longest trained context is 1024K tokens.
QW
Sakura 13B Qwen2beta v0.10pre0
Qwen · Tabing010102
Params14.2B
Context32K
Smallest9.0 GB
PH
Phi 4 Abliterated
Phi · UntitledMinister
Params14.7B
Context16K
Smallest10.6 GB
SA
Sarvam Translate
Sarvam · Savyasaachin
Params3.88B
Context128K
Smallest4.1 GB
LL
tamil llama 13b base v0.1
Llama · abhinand
Params13.2B
Context4K
Q4_K_M8.0 GB
GE
Gemma 2 2b Chinese It
Gemma · Asureu
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest5.3 GB
NA
NanoLM 70M Instruct v1
Nanolm · Felladrin
Params71M
Context2K
Smallest0.1 GB
LL
k llama tiny
Llama · Prashantmdgl9
Params6.88B
Context4K
Smallest4.9 GB
LL
MIXdevAI Llama
Llama · Kolyadual
Params1.24B
Context128K
Smallest0.8 GB
LL
Llama 2 7b Q4 K M
Llama · linuxer
Params6.74B
Context4K
Q4_K_M4.1 GB
PH
Phi 4 Abliterated
Phi · UntitledMinister
Params14.7B
Context16K
Q4_K_M9.1 GB
SA
Sarvam Translate
Sarvam · fischerman
Params3.88B
Context128K
Smallest1.7 GB
NA
NanoLM 0.3B Instruct v1
Nanolm · mradermacher
Params315M
Context128K
Q4_K_M0.3 GB
LU
on lunar vlm v1
Lunar · circulus
Params3.82B
Context4K
Q4_K_M2.3 GB
GE
Gemma 2 2b Chinese It
Gemma · DataSoul
Params2.61B
Context8K
Smallest1.9 GB
BE
34b beta
Beta · nold
Params34.4B
Context195K
Q4_K_M20.7 GB
SA
salamandraTA 7b Instruct
Salamandrata · maigonis
Params7.77B
Context8K
Q4_K_M4.9 GB
SA
Sarvam Translate
Sarvam · shinshekai
Params3.88B
Context128K
Smallest4.1 GB
SA
Sarvam Translate
Sarvam · jagan546
Params3.88B
Context128K
Smallest4.1 GB
QW
Qwen3.5 0.8B Thinking Distilled Gemini3Pro
Qwen · generalchucklese
Params18M
Context—
Q4_K_M0.0 GB
QW
zhihu tech zhichang qwen 7b
Qwen · chanceQZhang
Params7.62B
Context32K
Smallest5.4 GB
QW
qwen3 sussurro
Qwen · cesp99
Params2.03B
Context40K
Q4_K_M1.3 GB
NE
Newton Bot 2A Standard_Merged Gguf
Newton · kirilldual0987
Params8.19B
Context40K
Smallest8.7 GB
QW
Meissa Qwen2.5 14B Instruct
Qwen · Orion-zhen
Params14.8B
Context32K
Smallest15.7 GB
NO
NovelAI Krake v2
Novelai · onicubag
Params20.6B
Context2K
Smallest41.1 GB
NE
Newton Bot 3
Newton · Kolyadual
Params8.19B
Context128K
Smallest8.7 GB
DA
Dafifi 14B
Dafifi · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
PH
Phi 4 Abliterated
Phi · ApexReign
Params14.7B
Context16K
Q4_K_M9.1 GB
CH
Newton bot 2A mini merged
Chatgpt · Kolyadual
Params4.02B
Context40K
Smallest2.6 GB
BE
35b beta2ep Q4 K M
Beta · vanxxxx
Params35B
Context8K
Q4_K_M21.5 GB