GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
MA
macadeliccc piccolo 8x7b
Macadeliccc · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
SH
ShortKing 3B v0.2
Shortking · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
LL
Mermaid Llama 3 4B Pruned
Llama · mradermacher
Params4.54B
Context8K
Q4_K_M2.8 GB
MA
Maylin 7b
Maylin · Azazelle
Params7.24B
Context32K
Smallest4.1 GB
HI
hibiki 1b rs q8
Hibiki · kyutai
Params1.8B
Context—
Smallest1.9 GB
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
PO
pocket tts pt 24l mix precision
Pocket · Arm
Params302M
Context1K
Smallest1.2 GB
GE
pathos gemma4 distilled rl
Gemma · dhairyapandya
Params4.65B
Context128K
Smallest5.0 GB
HA
Hammer2.0 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest5.4 GB
VF
VFIG 4B
Vfig · Solaren
Params4.02B
Context256K
Smallest2.9 GB
RE
Reranker Xlm Roberta Large
Reranker · jixaw
Params560M
Context512
Smallest0.6 GB
MI
Saiga_Mistral_7B_Lora
Mistral · Mortido
Params14M
Context—
Smallest0.1 GB
PA
parakeet v3 tdt f32 crispasr
Parakeet · MachinesFluent
Params627M
Context—
Smallest2.5 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · sandner
Params1.54B
Context128K
Smallest1.3 GB
AZ
Azazelle Dumb Maidlet
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Canary 180M Flash
Canary · dictaclick
Params189M
Context—
Smallest0.2 GB
LL
Mermaid-Llama-3-8B
Llama · danielus
Params8.03B
Context8K
Smallest8.5 GB
HU
HuginnV5.5 12.6B
Huginnv · LoneStriker
Params12.9B
Context32K
Q4_K_M7.8 GB
MO
moshiko candle q8
Moshiko · superimportant
Params7.69B
Context—
Smallest8.2 GB
ME
MermaidMixtral-3x7b
Mermaidmixtral · danielus
Params18.5B
Context32K
Smallest15.2 GB
SM
smartsolmix 4x10.7b v1
Smartsolmix · tensorblock
Params36.1B
Context4K
Smallest13.2 GB
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
CA
Canary 180M Flash
Canary · elamus
Params189M
Context—
Smallest0.2 GB
MI
Mistral 7B KNUT ref en
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
AP
APUS xDAN 4.0 MoE v2
Apus · mradermacher
Params114B
Context32K
Smallest41.5 GB
HI
hibiki 1b rs q6k
Hibiki · kyutai
Params1.8B
Context—
Smallest1.5 GB
NE
OpenReasoning Nemotron 14B
Nemotron · sm54
Params14.8B
Context128K
Smallest12.1 GB
LL
Llama 3 8B Racing Level Design Expert
Llama · devmeta
Params8.03B
Context8K
Q4_K_M4.9 GB
KO
Komt Solar 10.7b Sft v3
Komt · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
AR
Argetsu
Argetsu · tensorblock
Params7.24B
Context32K
Smallest2.7 GB