GGUF models: gpl-3.0 license

272 GGUF models listed under the gpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 72.3B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
qwen 8b dialog v1
Qwen · milwright
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
CA
canvers llm cpp v1
Canvers · circulus
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
CLRQ2 3B
Llama · steamed-potatop
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
LLMs
Llms · ehristoforu
Params7.24B
Context32K
Smallest3.1 GB
Coding
TA
TagForge
Tagforge · cooperdk
Params518M
Context2K
Smallest0.7 GB
GGUF
SA
Sarvam Translate
Sarvam · Savyasaachin
Params3.88B
Context128K
Smallest2.8 GB
GGUF
QW
Qwen3 0.6B Text FIM
Qwen · IAmTheCollector
Params596M
Context32K
Smallest0.6 GB
GGUF
QW
Qwen2.5 7B Gutenberg KTO
Qwen · Orion-zhen
Params7.62B
Context32K
Smallest6.3 GB
Tool use
GE
Gemma 2 2b Chinese It
Gemma · DataSoul
Params2.61B
Context8K
Smallest2.8 GB
GGUF
SA
Sarvam Translate
Sarvam · jagan546
Params3.88B
Context128K
Smallest2.8 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B Abliterated
DeepSeek · G17c21ds
Params7.62B
Context128K
Smallest8.1 GB
ReasoningTool use
PH
Phi 4 Abliterated
Phi · syedaic
Params14.7B
Context16K
Smallest15.6 GB
GGUF
BE
34b beta
Beta · LoneStriker
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Meissa Qwen2.5 14B Instruct
Qwen · TouchNight
Params14.8B
Context32K
Q4_K_M9.0 GB
RoleplayTool use
YA
Yapper M4 Flash 0256
Yapper · Fantominsight
Params3.43B
Context256K
Smallest3.7 GB
RoleplayTool use
QW
Qwen3 4B Odoo17.Q4 K M
Qwen · digitalonionly
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
SA
Sarvam Translate
Sarvam · spitfire4794
Params3.88B
Context128K
Smallest4.1 GB
GGUF
DA
DAC 4.3 Q4 K M
Dac · Mattimax
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
PH
phi 4 abliterated Orion 18B Q8 0
Phi · Otakadelic
Params18.1B
Context16K
Smallest19.2 GB
GGUF
SA
Sarvam Translate
Sarvam · Savyasaachin
Params3.88B
Context128K
Smallest3.2 GB
GGUF
QW
Meissa Qwen2.5 7B Instruct
Qwen · Laocaicai
Params7.62B
Context32K
Smallest8.1 GB
Roleplay
MI
Mistral 7B Instruct v0.2Neural
Mistral · Magneato
Params7B
Context—
Smallest0.1 GB
GGUF
SA
Sarvam Translate
Sarvam · SrijitSet99
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
AZ
azadin modeli
Azadin · azadreiz485
Params30M
Context512
Smallest0.1 GB
GGUF
CA
canvers vlm cpp v1
Canvers · circulus
Params7.24B
Context32K
Smallest4.4 GB
Vision
BE
Causallm 34b Beta
Beta · jy-hxy
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
MindChat Qwen2 7B GGUF fp16
Qwen · Slipstream-Max
Params7.72B
Context8K
Smallest15.4 GB
GGUF
CH
ChatYuan 7B
Chatyuan · itlwas
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
TI
tinyBibleGPT
Tinybiblegpt · AMAZING2545
Params1M
Context—
Smallest0.0 GB
GGUF
LL
Bayling 2 Llama 3 8b
Llama · Skier8402
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing