GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3 2B Base
Llama · tensorblock
Params2.36B
Context8K
Smallest1.1 GB
GGUF
ST
citrinet 256 ls loom
Stt · loom-ai-org
Params10M
Context—
Smallest0.0 GB
GGUF
MI
mistral_28B
Mistral · mradermacher
Params28.2B
Context32K
Q4_K_M16.9 GB
GGUF
KO
komt solar 10.7b sft v5
Komt · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
LL
Llama3 1B Base
Llama · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
ME
Mermaid 10.5B cmds
Mermaid · mradermacher
Params10.5B
Context4K
Q4_K_M6.3 GB
GGUF
PA
Parakeet Unified EN 0.6B
Parakeet · Litovation
Params618M
Context—
Q4_K_M0.5 GB
GGUF
FL
Fluid Speech Mini
Fluid · TalkMate
Params627M
Context—
Smallest0.5 GB
GGUF
PA
Parakeet TDT 0.6B v2
Parakeet · tryambientai
Params618M
Context—
Smallest0.7 GB
GGUF
SM
FallenMerick/Smart-Lemon-Cookie-7B
Smart · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Safiron
Safiron · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
AZ
Azazelle Mocha Dare 7b ex
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KN
KnutJaegersberg openllama 3b EvolInstruct lora merged
Knutjaegersberg · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
SM
smart-secrets-scanner
Smart · richfrem
Params8.03B
Context128K
Q4_K_M4.9 GB
Coding
LE
lemura arabic asr lite
Lemura · yosef0H4
Params109M
Context—
Smallest0.2 GB
GGUF
PA
parakeet de med
Parakeet · cstr
Params627M
Context—
Smallest0.4 GB
GGUF
PA
Parakeet TDT 0.6B v3
Parakeet · lipik
Params627M
Context—
Smallest0.7 GB
GGUF
QW
One Shot CFT Math Qwen 1.5B
Qwen · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
LL
.\Mermaid\
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
GE
vandijklab.C2S Scale Gemma 2 27B
Gemma · DevQuasar
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
ME
MermaidMixtral 2x6.5b
Mermaidmixtral · mradermacher
Params12.1B
Context32K
Q4_K_M7.4 GB
GGUF
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · onemira
Params637M
Context—
Smallest0.7 GB
GGUF
CA
Canary 180M Flash
Canary · kusema
Params189M
Context—
Smallest0.2 GB
GGUF
PA
Parakeet TDT 0.6B v3 Ukrainian
Parakeet · vladkens
Params627M
Context—
Smallest0.7 GB
GGUF
OM
OmniTruthyBeagle 7B v0
Omnitruthybeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JA
jaskier 7b dpo v5.6
Jaskier · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BL
cookinai/Blitz-v0.1
Blitz · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Samantha2.0 Phi 3.5 mini ITA
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
MU
Multi Verse RP 7B GGUF IQ Imatrix
Multi · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
.\Mermaid\
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing