GGUF models: gpl-3.0 license

272 GGUF models listed under the gpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 72.3B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AP
approval bureau merged i1
Approval · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
AP
approval bureau merged
Approval · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
BE
Causallm 34b Beta
Beta · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
NA
NanoTranslator Immersive_Translate 0.5B
Nanotranslator · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
comfyui workflowgenerator models
Qwen · DanielPFlorian
Params7.62B
Context32K
Smallest8.1 GB
Tool use
QW
Orion-zhen/Meissa-Qwen2.5-7B-Instruct
Qwen · featherless-ai-quants
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Smallest6.3 GB
GGUF
GE
gemma 4 26b a4b opus 4.7 distilled
Gemma · glyphsoftware
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
SA
sarvam translate 1bit
Sarvam · Mugunth123
Params3.88B
Context128K
Smallest1.1 GB
GGUF
ME
MedLlama.nl
Medllama · UMCU
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
QW
Qwen3 VL 8B Maid
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Meissa Qwen2.5 7B Instruct
Qwen · yemiao2745
Params7.62B
Context32K
Q4_K_M4.7 GB
Roleplay
PR
72B preview
Preview · CausalLM
Params72.3B
Context32K
Q4_K_M43.8 GB
GGUF
LL
Llama 3 Lunar 8B v0.1 i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GU
guanaco 7B leh
Guanaco · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
QW
Qwen2.5 7B Instruct Uncensored
Qwen · tu-haogui56899756214
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GE
gemma4 e2b neon veil rp
Gemma · titan087
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningRoleplayTool use
GU
guanaco 7b leh v2
Guanaco · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
QW
Qwen2.5 14B Instruct Uncensored
Qwen · G17c21ds
Params14.8B
Context32K
Smallest15.7 GB
Tool use
LL
Llama 33B Instructed
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
NA
NanoLM 0.3B Instruct v2
Nanolm · Felladrin
Params315M
Context128K
Smallest0.3 GB
Coding
GE
Gemma 2 2b Chinese It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Meissa Qwen2.5 7B Instruct
Qwen · RichardErkhov
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
MIXdevAI llama quantized
Llama · kirilldual0987
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
NA
NanoLM 1B Instruct v1.1
Nanolm · mradermacher
Params1.08B
Context4K
Q4_K_M0.7 GB
Coding
NA
NanoLM 1B Instruct v2
Nanolm · mradermacher
Params1.08B
Context4K
Q4_K_M0.7 GB
GGUF
NA
NanoLM 70M Instruct v1
Nanolm · mradermacher
Params71M
Context2K
Q4_K_M0.1 GB
GGUF
LL
Llama 2 7b Chat TruthX
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Viel Mistral v3
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Roleplay
QW
Qwen2.5 7B Instruct Uncensored
Qwen · roleplaiapp
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF

Keep browsing