GGUF models: gpl-3.0 license
272 GGUF models listed under the gpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 72.3B parameters. The longest trained context is 1024K tokens.
AP
approval bureau merged i1
Approval · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
AP
approval bureau merged
Approval · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
BE
Causallm 34b Beta
Beta · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
NA
NanoTranslator Immersive_Translate 0.5B
Nanotranslator · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
QW
comfyui workflowgenerator models
Qwen · DanielPFlorian
Params7.62B
Context32K
Smallest8.1 GB
QW
Orion-zhen/Meissa-Qwen2.5-7B-Instruct
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest6.3 GB
GE
gemma 4 26b a4b opus 4.7 distilled
Gemma · glyphsoftware
Params25.2B
Context256K
Q4_K_M16.8 GB
SA
sarvam translate 1bit
Sarvam · Mugunth123
Params3.88B
Context128K
Smallest1.1 GB
ME
MedLlama.nl
Medllama · UMCU
Params1.5B
Context128K
Q4_K_M1.0 GB
QW
Qwen3 VL 8B Maid
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Meissa Qwen2.5 7B Instruct
Qwen · yemiao2745
Params7.62B
Context32K
Q4_K_M4.7 GB
PR
72B preview
Preview · CausalLM
Params72.3B
Context32K
Q4_K_M43.8 GB
LL
Llama 3 Lunar 8B v0.1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GU
guanaco 7B leh
Guanaco · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · tu-haogui56899756214
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
gemma4 e2b neon veil rp
Gemma · titan087
Params4.65B
Context128K
Q4_K_M3.4 GB
GU
guanaco 7b leh v2
Guanaco · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
QW
Qwen2.5 14B Instruct Uncensored
Qwen · G17c21ds
Params14.8B
Context32K
Smallest15.7 GB
LL
Llama 33B Instructed
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
NA
NanoLM 0.3B Instruct v2
Nanolm · Felladrin
Params315M
Context128K
Smallest0.3 GB
GE
Gemma 2 2b Chinese It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Meissa Qwen2.5 7B Instruct
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
MIXdevAI llama quantized
Llama · kirilldual0987
Params1.24B
Context128K
Q4_K_M0.8 GB
NA
NanoLM 1B Instruct v1.1
Nanolm · mradermacher
Params1.08B
Context4K
Q4_K_M0.7 GB
NA
NanoLM 1B Instruct v2
Nanolm · mradermacher
Params1.08B
Context4K
Q4_K_M0.7 GB
NA
NanoLM 70M Instruct v1
Nanolm · mradermacher
Params71M
Context2K
Q4_K_M0.1 GB
LL
Llama 2 7b Chat TruthX
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Viel Mistral v3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Q4_K_M4.7 GB