GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MA
macadeliccc piccolo 8x7b
Macadeliccc · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
SH
ShortKing 3B v0.2
Shortking · Aryanne
Params3.43B
Context2K
Smallest2.0 GB
Coding
LL
Mermaid Llama 3 4B Pruned
Llama · mradermacher
Params4.54B
Context8K
Q4_K_M2.8 GB
GGUF
MA
Maylin 7b
Maylin · Azazelle
Params7.24B
Context32K
Smallest4.1 GB
GGUF
HI
hibiki 1b rs q8
Hibiki · kyutai
Params1.8B
Context—
Smallest1.9 GB
GGUF
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest8.6 GB
CodingReasoning
PO
pocket tts pt 24l mix precision
Pocket · Arm
Params302M
Context1K
Smallest1.2 GB
GGUF
GE
pathos gemma4 distilled rl
Gemma · dhairyapandya
Params4.65B
Context128K
Smallest5.0 GB
ReasoningTool useVision
HA
Hammer2.0 7b
Hammer · Nekuromento
Params7.61B
Context32K
Smallest5.4 GB
Tool use
VF
VFIG 4B
Vfig · Solaren
Params4.02B
Context256K
Smallest2.9 GB
Vision
RE
Reranker Xlm Roberta Large
Reranker · jixaw
Params560M
Context512
Smallest0.6 GB
Embedding
MI
Saiga_Mistral_7B_Lora
Mistral · Mortido
Params14M
Context—
Smallest0.1 GB
GGUF
PA
parakeet v3 tdt f32 crispasr
Parakeet · MachinesFluent
Params627M
Context—
Smallest2.5 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · sandner
Params1.54B
Context128K
Smallest1.3 GB
CodingReasoning
AZ
Azazelle Dumb Maidlet
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Canary 180M Flash
Canary · dictaclick
Params189M
Context—
Smallest0.2 GB
GGUF
LL
Mermaid-Llama-3-8B
Llama · danielus
Params8.03B
Context8K
Smallest8.5 GB
GGUF
HU
HuginnV5.5 12.6B
Huginnv · LoneStriker
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MO
moshiko candle q8
Moshiko · superimportant
Params7.69B
Context—
Smallest8.2 GB
GGUF
ME
MermaidMixtral-3x7b
Mermaidmixtral · danielus
Params18.5B
Context32K
Smallest15.2 GB
GGUF
SM
smartsolmix 4x10.7b v1
Smartsolmix · tensorblock
Params36.1B
Context4K
Smallest13.2 GB
GGUF
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoning
CA
Canary 180M Flash
Canary · elamus
Params189M
Context—
Smallest0.2 GB
GGUF
MI
Mistral 7B KNUT ref en
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
AP
APUS xDAN 4.0 MoE v2
Apus · mradermacher
Params114B
Context32K
Smallest41.5 GB
GGUF
HI
hibiki 1b rs q6k
Hibiki · kyutai
Params1.8B
Context—
Smallest1.5 GB
GGUF
NE
OpenReasoning Nemotron 14B
Nemotron · sm54
Params14.8B
Context128K
Smallest12.1 GB
CodingReasoning
LL
Llama 3 8B Racing Level Design Expert
Llama · devmeta
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
KO
Komt Solar 10.7b Sft v3
Komt · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
AR
Argetsu
Argetsu · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF

Keep browsing