GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NY
L3-Nymeria-Maid-8B
Nymeria · tannedbum
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
YU
Yuna 7b Merge
Yuna · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SP
titanet large loom
Speakerverification · loom-ai-org
Params22M
Context—
Smallest0.1 GB
GGUF
PA
Parakeet TDT 0.6B v3 Hebrew
Parakeet · vibe-app
Params628M
Context—
Smallest0.8 GB
GGUF
EN
ENERGY DRINK LOVE komt DPOv3
Energy · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
ST
conformer ctc small loom
Stt · loom-ai-org
Params15M
Context—
Smallest0.1 GB
GGUF
SO
KS SOLAR 10.7B v0.1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
UN
underdog bark 3.0 plus
Underdog · scholzmx
Params627M
Context—
Smallest0.4 GB
GGUF
LL
Stoicism1 Llama3.1 8b instruct GGUF 16bit
Llama · AlbertoB12
Params8.03B
Context128K
Smallest16.1 GB
Tool use
JA
Jaskier 7b Dpo v6
Jaskier · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
HA
Hayula Kindi 7B
Hayula · BinSaqban
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen2.5 3B Instruct_Johnny_Silverhand_Merged
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
LL
.\Mermaid\
Llama · mradermacher
Params7.16B
Context8K
Q4_K_M4.4 GB
GGUF
BL
Blitz v0.1 i1
Blitz · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
stt be fastconformer hybrid large pc
Stt · Pashted
Params120M
Context—
Smallest0.1 GB
GGUF
ME
Memphis-scribe-3B
Memphis · Green-Sky
Params2.8B
Context4K
Q4_K_M1.7 GB
Roleplay
HE
HERETICAL_IRIX 12B
Heretical · DreadPoor
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CA
Canary 180M Flash
Canary · myflow-ai
Params189M
Context—
Smallest0.2 GB
GGUF
UN
underdog bark 3.0
Underdog · scholzmx
Params627M
Context—
Smallest0.4 GB
GGUF
HA
Hammer2.0 1.5b
Hammer · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
ST
stt ar fastconformer hybrid large pc v1.0
Stt · Pashted
Params120M
Context—
Smallest0.1 GB
GGUF
RA
Railz R
Railz · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
PA
Parakeet TDT-CTC 110M (CTC head)
Parakeet · dawsonvosburg
Params109M
Context—
Smallest0.2 GB
GGUF
GE
GEITje 7b uncensored
Geitje · tostideluxekaas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GP
gpt2 Therapy2
Gpt · mradermacher
Params163M
Context250
Q4_K_M0.1 GB
GGUF
PA
Parakeet TDT 1.1B
Parakeet · epapanita
Params1.07B
Context—
Q4_K_M0.8 GB
GGUF
FA
FallenMerick Bionic Vaquita 13B
Fallenmerick · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Canary-Qwen 2.5B
Qwen · myflow-ai
Params2.53B
Context—
Smallest2.0 GB
GGUF
QW
qwen3 0.6b clinical screening
Qwen · luizaaca
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
PI
piccolo 8x7b
Piccolo · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF

Keep browsing