GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
HU
HumanPet X1 1.7B
Humanpet · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
MA
Marx 3B V3
Marx · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
AI
Yi Ko 6B
Aift · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
DA
Datura 7B i1
Datura · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Helium 1 2b Stem
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
MA
maywell Synatra kiqu 10.7B
Maywell · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
CR
croguana RC2
Croguana · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Helium 1 2b Main
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
AI
AIFT Ko Orca Plat Yi Ko 6b v1.1 Dpo
Aift · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
EE
EEVE Math 10.8B
Eeve · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
GGUF
FL
Flora 7B
Flora · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
Westest 7B i1
Westest · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
QW
AutoRefine Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
FL
flan t5 definition en base
Flan · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF
BL
Blake Haiku 1
Blake · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
LL
defog.llama 3 sqlcoder 8b
Llama · DevQuasar-13
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
L3-Aethora-15B-V2
Llama · bartowski
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
IN
Indri 0.1 350m Tts
Indri · mradermacher
Params447M
Context1K
Q4_K_M0.3 GB
GGUF
SP
Spaetzle v66 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Stablelm 3b 4e1t
Stablelm · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
Coding
CI
CiSiMi v0.1
Cisimi · mradermacher
Params499M
Context32K
Q4_K_M0.4 GB
GGUF
TI
TinyWand Kiqu
Tinywand · mradermacher
Params1.63B
Context4K
Q4_K_M1.0 GB
GGUF
FL
Flora DPO 7B
Flora · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FS
sfairXC/FsfairX-Zephyr-Chat-v0.1
Fsfairx · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
mlx-community/defog-llama-3-sqlcoder-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
HE
Kyutai Helium 1 2b
Helium · Hob-forge
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
MI
Mini synatra 7b 03 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Kyutai.Helium 1 2b Science
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF

Keep browsing