GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
HU
HumanPet X1 1.7B
Humanpet · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
MA
Marx 3B V3
Marx · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
AI
Yi Ko 6B
Aift · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
DA
Datura 7B i1
Datura · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Helium 1 2b Stem
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
MA
maywell Synatra kiqu 10.7B
Maywell · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
CR
croguana RC2
Croguana · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Helium 1 2b Main
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
AI
AIFT Ko Orca Plat Yi Ko 6b v1.1 Dpo
Aift · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
EE
EEVE Math 10.8B
Eeve · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
FL
Flora 7B
Flora · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
WE
Westest 7B i1
Westest · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
QW
AutoRefine Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
FL
flan t5 definition en base
Flan · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
BL
Blake Haiku 1
Blake · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
LL
defog.llama 3 sqlcoder 8b
Llama · DevQuasar-13
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
L3-Aethora-15B-V2
Llama · bartowski
Params15B
Context8K
Q4_K_M9.1 GB
IN
Indri 0.1 350m Tts
Indri · mradermacher
Params447M
Context1K
Q4_K_M0.3 GB
SP
Spaetzle v66 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
Stablelm 3b 4e1t
Stablelm · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
CI
CiSiMi v0.1
Cisimi · mradermacher
Params499M
Context32K
Q4_K_M0.4 GB
TI
TinyWand Kiqu
Tinywand · mradermacher
Params1.63B
Context4K
Q4_K_M1.0 GB
FL
Flora DPO 7B
Flora · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FS
sfairXC/FsfairX-Zephyr-Chat-v0.1
Fsfairx · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
mlx-community/defog-llama-3-sqlcoder-8b
Llama · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
HE
Kyutai Helium 1 2b
Helium · Hob-forge
Params2.02B
Context4K
Q4_K_M1.2 GB
MI
Mini synatra 7b 03 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Kyutai.Helium 1 2b Science
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB