GGUF models: gpl-3.0 license
272 GGUF models listed under the gpl-3.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 72.3B parameters. The longest trained context is 1024K tokens.
QW
qwen 8b dialog v1
Qwen · milwright
Params8.19B
Context40K
Q4_K_M5.0 GB
CA
canvers llm cpp v1
Canvers · circulus
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
CLRQ2 3B
Llama · steamed-potatop
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
LLMs
Llms · ehristoforu
Params7.24B
Context32K
Smallest3.1 GB
TA
TagForge
Tagforge · cooperdk
Params518M
Context2K
Smallest0.7 GB
SA
Sarvam Translate
Sarvam · Savyasaachin
Params3.88B
Context128K
Smallest2.8 GB
QW
Qwen3 0.6B Text FIM
Qwen · IAmTheCollector
Params596M
Context32K
Smallest0.6 GB
QW
Qwen2.5 7B Gutenberg KTO
Qwen · Orion-zhen
Params7.62B
Context32K
Smallest6.3 GB
GE
Gemma 2 2b Chinese It
Gemma · DataSoul
Params2.61B
Context8K
Smallest2.8 GB
SA
Sarvam Translate
Sarvam · jagan546
Params3.88B
Context128K
Smallest2.8 GB
DE
DeepSeek R1 Distill Qwen 7B Abliterated
DeepSeek · G17c21ds
Params7.62B
Context128K
Smallest8.1 GB
PH
Phi 4 Abliterated
Phi · syedaic
Params14.7B
Context16K
Smallest15.6 GB
BE
34b beta
Beta · LoneStriker
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Meissa Qwen2.5 14B Instruct
Qwen · TouchNight
Params14.8B
Context32K
Q4_K_M9.0 GB
YA
Yapper M4 Flash 0256
Yapper · Fantominsight
Params3.43B
Context256K
Smallest3.7 GB
QW
Qwen3 4B Odoo17.Q4 K M
Qwen · digitalonionly
Params4.02B
Context40K
Q4_K_M2.5 GB
SA
Sarvam Translate
Sarvam · spitfire4794
Params3.88B
Context128K
Smallest4.1 GB
DA
DAC 4.3 Q4 K M
Dac · Mattimax
Params596M
Context40K
Q4_K_M0.4 GB
PH
phi 4 abliterated Orion 18B Q8 0
Phi · Otakadelic
Params18.1B
Context16K
Smallest19.2 GB
SA
Sarvam Translate
Sarvam · Savyasaachin
Params3.88B
Context128K
Smallest3.2 GB
QW
Meissa Qwen2.5 7B Instruct
Qwen · Laocaicai
Params7.62B
Context32K
Smallest8.1 GB
MI
Mistral 7B Instruct v0.2Neural
Mistral · Magneato
Params7B
Context—
Smallest0.1 GB
SA
Sarvam Translate
Sarvam · SrijitSet99
Params3.88B
Context128K
Q4_K_M2.5 GB
AZ
azadin modeli
Azadin · azadreiz485
Params30M
Context512
Smallest0.1 GB
CA
canvers vlm cpp v1
Canvers · circulus
Params7.24B
Context32K
Smallest4.4 GB
BE
Causallm 34b Beta
Beta · jy-hxy
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
MindChat Qwen2 7B GGUF fp16
Qwen · Slipstream-Max
Params7.72B
Context8K
Smallest15.4 GB
CH
ChatYuan 7B
Chatyuan · itlwas
Params6.74B
Context2K
Q4_K_M4.1 GB
TI
tinyBibleGPT
Tinybiblegpt · AMAZING2545
Params1M
Context—
Smallest0.0 GB
LL
Bayling 2 Llama 3 8b
Llama · Skier8402
Params8.03B
Context8K
Q4_K_M4.9 GB