GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
RI
Rio 2 Ocr
Rio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
HA
Hammer2.0 7b
Hammer · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
Tool use
TE
Testarossa v1 27B
Testarossa · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
QW
Qwen2.5 7B Instruct_Johnny_Silverhand_Merged
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
TI
TildeAI.TildeOpen 30b
Tildeopen · DevQuasar
Params30.7B
Context64K
Q4_K_M18.5 GB
GGUF
AZ
Azazelle Yuna 7b Merge
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
Open_Gpt4_8x7B
Open · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
CA
Canary 180M Flash
Canary · Litovation
Params189M
Context—
Q4_K_M0.1 GB
GGUF
OP
Open_Gpt4_8x7B_v0.2
Open · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PA
parakeet rnnt 0.6b loom
Parakeet · loom-ai-org
Params627M
Context—
Smallest2.5 GB
GGUF
PA
parakeet ultra transcribe
Parakeet · dawsonvosburg
Params627M
Context—
Smallest0.7 GB
GGUF
FE
FenggeLLM 32B
Fenggellm · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
PO
pocket tts de mix precision
Pocket · Arm
Params76M
Context1K
Smallest0.3 GB
GGUF
UN
Underdog Bark 3.0 Plus
Underdog · joshthomasdev
Params627M
Context—
Smallest0.7 GB
GGUF
AZ
Azazelle Argetsu
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
parakeet tdt 0.6b v2 nemo speech
Parakeet · opragmatico
Params628M
Context—
Smallest0.7 GB
GGUF
SI
Silicon-Maid-7B
Silicon · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
PA
Parakeet RNN-T 0.6B
Parakeet · epapanita
Params617M
Context—
Q4_K_M0.5 GB
GGUF
NE
OmniBeagle 7B
Neuralomnibeagle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 15B instruct v0.1
Mistral · mradermacher
Params14.2B
Context32K
Q4_K_M8.7 GB
GGUF
PA
parakeet cpp ja
Parakeet · kun432
Params623M
Context—
Smallest0.7 GB
GGUF
KM
Kmynas Parakeet LT v4
Kmynas · Ezomas
Params627M
Context—
Smallest0.7 GB
GGUF
UN
UniSS
Uniss · mradermacher
Params1.86B
Context32K
Q4_K_M1.2 GB
Tool use
NE
OpenReasoning Nemotron 14B
Nemotron · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
CodingReasoning
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · TCN
Params637M
Context—
Smallest0.7 GB
GGUF
MI
Ai Basic Law Ministral8B
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
EV
Everyone Coder 4x7b Base
Everyone · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
Coding
JA
bardsai/jaskier-7b-dpo-v6.1
Jaskier · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
TableLLM Qwen2 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
AZ
Azazelle SlimMelodicMaid
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing