GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
LL
Llama3 2B Base
Llama · tensorblock
Params2.36B
Context8K
Smallest1.1 GB
ST
citrinet 256 ls loom
Stt · loom-ai-org
Params10M
Context—
Smallest0.0 GB
MI
mistral_28B
Mistral · mradermacher
Params28.2B
Context32K
Q4_K_M16.9 GB
KO
komt solar 10.7b sft v5
Komt · mradermacher
Params10.9B
Context4K
Q4_K_M6.6 GB
LL
Llama3 1B Base
Llama · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
ME
Mermaid 10.5B cmds
Mermaid · mradermacher
Params10.5B
Context4K
Q4_K_M6.3 GB
PA
Parakeet Unified EN 0.6B
Parakeet · Litovation
Params618M
Context—
Q4_K_M0.5 GB
FL
Fluid Speech Mini
Fluid · TalkMate
Params627M
Context—
Smallest0.5 GB
PA
Parakeet TDT 0.6B v2
Parakeet · tryambientai
Params618M
Context—
Smallest0.7 GB
SM
FallenMerick/Smart-Lemon-Cookie-7B
Smart · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Safiron
Safiron · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
AZ
Azazelle Mocha Dare 7b ex
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
KN
KnutJaegersberg openllama 3b EvolInstruct lora merged
Knutjaegersberg · maddes8cht
Params3.43B
Context2K
Q4_K_M2.6 GB
SM
smart-secrets-scanner
Smart · richfrem
Params8.03B
Context128K
Q4_K_M4.9 GB
LE
lemura arabic asr lite
Lemura · yosef0H4
Params109M
Context—
Smallest0.2 GB
PA
parakeet de med
Parakeet · cstr
Params627M
Context—
Smallest0.4 GB
PA
Parakeet TDT 0.6B v3
Parakeet · lipik
Params627M
Context—
Smallest0.7 GB
QW
One Shot CFT Math Qwen 1.5B
Qwen · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
LL
.\Mermaid\
Llama · RichardErkhov
Params6.74B
Context16K
Q4_K_M4.1 GB
GE
vandijklab.C2S Scale Gemma 2 27B
Gemma · DevQuasar
Params27.2B
Context8K
Q4_K_M16.6 GB
ME
MermaidMixtral 2x6.5b
Mermaidmixtral · mradermacher
Params12.1B
Context32K
Q4_K_M7.4 GB
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · onemira
Params637M
Context—
Smallest0.7 GB
CA
Canary 180M Flash
Canary · kusema
Params189M
Context—
Smallest0.2 GB
PA
Parakeet TDT 0.6B v3 Ukrainian
Parakeet · vladkens
Params627M
Context—
Smallest0.7 GB
OM
OmniTruthyBeagle 7B v0
Omnitruthybeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
JA
jaskier 7b dpo v5.6
Jaskier · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
BL
cookinai/Blitz-v0.1
Blitz · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Samantha2.0 Phi 3.5 mini ITA
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
MU
Multi Verse RP 7B GGUF IQ Imatrix
Multi · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
.\Mermaid\
Llama · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB