GGUF models: gpl-3.0 license
272 GGUF models listed under the gpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 72.3B parameters. The longest trained context is 1024K tokens.
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest4.5 GB
GP
Gpt2 Aclu Gender
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
CA
CausalLM 34b beta iMat
Causallm · dranger003
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Sakura 1B8 Qwen2beta v0.9
Qwen · ShenSheiBot
Params1.84B
Context32K
Smallest3.7 GB
DI
DialoGPT Mahiru Proto
Dialogpt · mradermacher
Params355M
Context1K
Q4_K_M0.2 GB
NA
NanoLM 0.3B Instruct v1.1
Nanolm · mradermacher
Params315M
Context128K
Q4_K_M0.3 GB
QW
Qwen3 VL maid 8B
Qwen · Zyi4082
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
tamil llama 7b base v0.1
Llama · abhinand
Params6.87B
Context4K
Q4_K_M4.2 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest3.8 GB
KO
KoGemma dpo 2b v1
Kogemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
qwen finance 4b
Qwen · quantumstocks
Params4.33B
Context256K
Smallest4.6 GB
OR
Orkires
Orkires · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
QW
Qwen2.5 7B Gutenberg KTO
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Meissa Qwen2.5 7B Instruct
Qwen · puyuxiang
Params7.62B
Context32K
Smallest4.1 GB
QW
Meissa Qwen2.5 14B Instruct
Qwen · Orion-zhen
Params14.8B
Context32K
Smallest12.1 GB
SA
salamandraTA 7b Instruct
Salamandrata · egekocabas
Params7.77B
Context8K
Smallest5.6 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest15.2 GB
MI
Viel Mistral v3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest5.4 GB
GR
Grounding7B
Grounding · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DA
Dafifi 1.5B
Dafifi · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest8.1 GB
SA
Safelm 1.7b Heretic
Safelm · mradermacher
Params1.81B
Context8K
Q4_K_M1.1 GB
QW
ATLAS AI
Qwen · YunusTAS13
Params8.19B
Context40K
Smallest5.0 GB
MI
Incelgpt 24B v1.2 Q4 K M
Mistral · pixelmelt
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest3.5 GB
SA
sarvam translate
Sarvam · spitfire4794
Params3.88B
Context128K
Smallest3.2 GB
LL
Bayling 2 Llama 3 8b
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
SA
sarvam translate 8bit
Sarvam · Mugunth123
Params3.88B
Context128K
Smallest4.1 GB
BE
34b beta
Beta · akumaburn
Params34.4B
Context195K
Q4_K_M20.7 GB