GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · SandLogicTechnologies
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
VE
MN VelvetCafe RP 12B
Velvetcafe · Otakadelic
Params12.2B
Context128K
Smallest10.1 GB
Roleplay
PY
PYceshi
Pyceshi · cxp2002
Params7.62B
Context128K
Smallest8.1 GB
GGUF
LL
Stoicism1 Llama3.1 8b instruct i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
CE
Cesco2004/TW3CESCO.V4
Cesco · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
parakeet primeline
Parakeet · myflow-ai
Params627M
Context—
Smallest0.7 GB
GGUF
PA
Parakeet TDT 0.6B v3
Parakeet · Fazmin
Params627M
Context—
Q4_K_M0.5 GB
GGUF
DR
DRA GRPO i1
Dra · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
KI
Kiwi 1.0 0.7B 32k
Kiwi · mradermacher
Params703M
Context32K
Q4_K_M0.5 GB
Tool use
CA
Canary 180M Flash
Canary · voicetide
Params189M
Context—
Smallest0.2 GB
GGUF
PA
Parakeet CTC 1.1B
Parakeet · voicetide
Params1.06B
Context—
Smallest0.9 GB
GGUF
PA
parakeet tdt 0.6b v3
Parakeet · VoiceScribe
Params627M
Context—
Smallest0.5 GB
GGUF
SO
DT SL SOLAR 10.7B v0.1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
IN
infinite lemonade SLERP 7B
Infinite · grimjim
Params7.24B
Context32K
Smallest7.7 GB
GGUF
PA
Parakeet CTC 0.6B
Parakeet · voicetide
Params609M
Context—
Smallest0.7 GB
GGUF
PA
Parakeet TDT-CTC 1.1B
Parakeet · voicetide
Params1.07B
Context—
Smallest0.9 GB
GGUF
PA
Parakeet CTC 0.6B
Parakeet · myflow-ai
Params609M
Context—
Smallest0.7 GB
GGUF
HU
HuginnV5.6 12.6B
Huginnv · saishf
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
ST
Portuguese FastConformer Hybrid
Stt · Singla0009
Params113M
Context—
Smallest0.5 GB
GGUF
SI
Silicon Maid 7B
Silicon · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
NE
OpenMath Nemotron 1.5B GRPO NuminaMath 10K
Nemotron · ermiaazarkhalili
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
PA
Parakeet RNN-T 0.6B
Parakeet · voicetide
Params617M
Context—
Smallest0.7 GB
GGUF
PA
Parakeet RNN-T 0.6B
Parakeet · myflow-ai
Params617M
Context—
Smallest0.7 GB
GGUF
AY
AyurParam
Ayurparam · A-Aryam
Params2.86B
Context2K
Q4_K_M1.8 GB
GGUF
SO
Juengsi DT EQ SOLAR 10.7B v0.1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
PO
pocket tts es 24l mix precision
Pocket · Arm
Params302M
Context1K
Smallest1.2 GB
GGUF
ML
DT SL MLP SOLAR 10.7B v0.1
Mlp · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CA
Canary 1B v2
Canary · voicetide
Params980M
Context—
Smallest0.8 GB
GGUF
AL
Alphacode MALI 11B
Alphacode · tensorblock
Params10.9B
Context32K
Smallest4.1 GB
GGUF

Keep browsing