GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
Mirage OpenReasoning Nemotron 7B
Nemotron · Bifrost-AI
Params7.62B
Context128K
Smallest15.2 GB
CodingReasoning
LL
kunteynir lyrics ruadapt llama2 7b
Llama · screamuch
Params6.74B
Context4K
Q4_K_M2.5 GB
GGUF
HA
Hammer 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest6.3 GB
Tool use
MA
Maylin 7b
Maylin · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
GE
pathos gemma4 distilled rl 4B
Gemma · dhairyapandya
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
MO
moshiko 7b bf16
Moshiko · vokra
Params7.69B
Context—
Smallest15.4 GB
GGUF
BA
BanglaLLM1 1.0B
Banglallm · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · NikolayKozloff
Params1.54B
Context128K
Smallest1.6 GB
CodingReasoning
PY
pyannote wespeaker voxceleb resnet34 lm
Pyannote · vokra
Params7M
Context—
Smallest0.0 GB
GGUF
PA
Parakeet Unified EN 0.6B
Parakeet · SpectrumDicta
Params618M
Context—
Smallest0.7 GB
GGUF
LL
Llasa 3B Q8 0
Llasa · NikolayKozloff
Params4.01B
Context128K
Smallest4.3 GB
Tool use
HA
Hammer 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest5.4 GB
Tool use
PA
Parakeet TDT 0.6B v2
Parakeet · memoravox
Params618M
Context—
Smallest0.7 GB
GGUF
HA
Hammer 4b
Hammer · Nekuromento
Params3.95B
Context32K
Smallest4.2 GB
Tool use
LE
LemonadeRP 4.5.3 Q5 K M
Lemonaderp · SzilviaB
Params7.24B
Context32K
Smallest5.1 GB
Roleplay
NE
OpenReasoning Nemotron 7B
Nemotron · sandner
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
PR
Proctora Q8 0
Proctora · Karko
Params12.9B
Context32K
Smallest13.7 GB
GGUF
PA
Parakeet TDT 0.6B v2
Parakeet · SpectrumDicta
Params618M
Context—
Smallest0.7 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · ml-enthusiast13
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SA
Safe O1 7b
Safe · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
PA
Parakeet TDT-CTC 1.1B
Parakeet · memoravox
Params1.07B
Context—
Smallest0.9 GB
GGUF
GE
pathos gemma4 distilled
Gemma · dhairyapandya
Params4.65B
Context128K
Smallest5.0 GB
ReasoningTool useVision
AL
Alphacode MALI 11B
Alphacode · tensorblock
Params10.9B
Context32K
Smallest4.1 GB
GGUF
PA
parakeet tdt 0.6b v3 q8 0
Parakeet · recordlet
Params637M
Context—
Smallest0.7 GB
GGUF
TI
Tildeopen 30b Mu Instruct
Tildeopen · KnutJaegersberg
Params30.7B
Context64K
Smallest32.6 GB
GGUF
KU
KuroMitsu 11B i
Kuromitsu · SolidSnacke
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
CA
Canary 1B Flash
Canary · memoravox
Params890M
Context—
Smallest0.8 GB
GGUF
PA
Parakeet TDT 1.1B
Parakeet · SpectrumDicta
Params1.07B
Context—
Smallest0.9 GB
GGUF
PA
avena parakeet ultra
Parakeet · efeemece
Params627M
Context—
Smallest0.9 GB
GGUF
YU
Yuna 7b Merge
Yuna · Azazelle
Params7.24B
Context32K
Smallest4.1 GB
GGUF

Keep browsing