GGUF models: gpl-3.0 license

272 GGUF models listed under the gpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 72.3B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest4.5 GB
GGUF
GP
Gpt2 Aclu Gender
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
CA
CausalLM 34b beta iMat
Causallm · dranger003
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Sakura 1B8 Qwen2beta v0.9
Qwen · ShenSheiBot
Params1.84B
Context32K
Smallest3.7 GB
GGUF
DI
DialoGPT Mahiru Proto
Dialogpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
GGUF
NA
NanoLM 0.3B Instruct v1.1
Nanolm · mradermacher
Params315M
Context128K
Q4_K_M0.3 GB
GGUF
QW
Qwen3 VL maid 8B
Qwen · Zyi4082
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
LL
tamil llama 7b base v0.1
Llama · abhinand
Params6.87B
Context4K
Q4_K_M4.2 GB
GGUF
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest3.8 GB
GGUF
KO
KoGemma dpo 2b v1
Kogemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
qwen finance 4b
Qwen · quantumstocks
Params4.33B
Context256K
Smallest4.6 GB
ReasoningTool useVision
OR
Orkires
Orkires · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
QW
Qwen2.5 7B Gutenberg KTO
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Meissa Qwen2.5 7B Instruct
Qwen · puyuxiang
Params7.62B
Context32K
Smallest4.1 GB
Roleplay
QW
Meissa Qwen2.5 14B Instruct
Qwen · Orion-zhen
Params14.8B
Context32K
Smallest12.1 GB
RoleplayTool use
SA
salamandraTA 7b Instruct
Salamandrata · egekocabas
Params7.77B
Context8K
Smallest5.6 GB
GGUF
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest15.2 GB
GGUF
MI
Viel Mistral v3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Roleplay
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest5.4 GB
GGUF
GR
Grounding7B
Grounding · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool use
DA
Dafifi 1.5B
Dafifi · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest8.1 GB
GGUF
SA
Safelm 1.7b Heretic
Safelm · mradermacher
Params1.81B
Context8K
Q4_K_M1.1 GB
GGUF
QW
ATLAS AI
Qwen · YunusTAS13
Params8.19B
Context40K
Smallest5.0 GB
ReasoningTool use
MI
Incelgpt 24B v1.2 Q4 K M
Mistral · pixelmelt
Params23.6B
Context128K
Q4_K_M14.3 GB
Tool use
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest3.5 GB
GGUF
SA
sarvam translate
Sarvam · spitfire4794
Params3.88B
Context128K
Smallest3.2 GB
GGUF
LL
Bayling 2 Llama 3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SA
sarvam translate 8bit
Sarvam · Mugunth123
Params3.88B
Context128K
Smallest4.1 GB
GGUF
BE
34b beta
Beta · akumaburn
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF

Keep browsing