GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
GE
gemma 2 2b it
Gemma · kaitchup
Params2.61B
Context8K
Q4_K_M1.7 GB
AZ
Azazelle Silicon Medley
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
AlphaMist7B-slr-v4-slow2
Alphamist · MisterSP
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Contextual-Obedient-MoE-3x8B-Llama3-RAG
Llama · mradermacher
Params19.3B
Context8K
Q4_K_M11.7 GB
AN
Anime Llasa 3B
Anime · furusu
Params3.41B
Context128K
Smallest2.2 GB
LL
Llama3 1B Base Q4 K M
Llama · stellali0115
Params1.71B
Context8K
Q4_K_M1.1 GB
TI
Tippy Toppy 7b
Tippy · Azazelle
Params7.24B
Context32K
Smallest4.1 GB
MI
Saiga_Mistral_7B_Lora
Mistral · Mortido
Params14M
Context—
Smallest0.1 GB
CA
canary 1b flash
Canary · vokra
Params811M
Context—
Smallest3.2 GB
EG
STT ARwkgroeijg pok rge gekrgrejgoherui
Egyptalk · VerlaVerVer
Params115M
Context—
Smallest0.2 GB
HA
Hammer 7b
Hammer · Nekuromento
Params7.61B
Context32K
Q4_K_M4.7 GB
TE
Test Model
Test · Techrex
Params163M
Context1K
Smallest0.3 GB
AL
Alphacode-MALI-11B
Alphacode · NikolayKozloff
Params8.99B
Context32K
Smallest9.6 GB
JA
jaskier 7b dpo v6.1 Q4 K M
Jaskier · hus960
Params7.24B
Context32K
Q4_K_M4.4 GB
XD
xDAN SlimOrca
Xdan · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NE
OpenReasoning Nemotron 32B
Nemotron · sandner
Params32.8B
Context128K
Q4_K_M19.9 GB
NE
OpenReasoning Nemotron 14B
Nemotron · sandner
Params14.8B
Context128K
Q4_K_M9.0 GB
AZ
Azazelle xDAN SlimOrca
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
amlonet llama
Llama · ljcamargo
Params8.03B
Context8K
Q4_K_M4.9 GB
SC
C2S Scale Pythia 1b Pt
Scale · introvoyz041
Params1.01B
Context8K
Smallest0.6 GB
HA
Hammer2.0 1.5b
Hammer · Nekuromento
Params1.54B
Context32K
Smallest1.6 GB
PA
Parakeet TDT 0.6B v3
Parakeet · Dazarang
Params627M
Context—
Q4_K_M0.5 GB
CI
CIM 1.3b
Cim · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
XD
xDAN AI xDAN L1 Chat RL v1
Xdan · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CA
Canary 180M Flash RU
Canary · shrisha
Params190M
Context—
Q4_K_M0.1 GB
PA
Parakeet RNN-T 0.6B
Parakeet · memoravox
Params617M
Context—
Smallest0.7 GB
AZ
Azazelle Maylin 7b
Azazelle · RichardErkhov
Params7.24B
Context32K
Smallest2.7 GB
HA
Hammer2.0 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest6.3 GB
OW
owsm v4 medium 1b
Owsm · vokra
Params1.02B
Context—
Smallest4.1 GB
HA
Hammer 1.5b
Hammer · ZhouJM
Params1.54B
Context32K
Q4_K_M1.0 GB