GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AZ
Azazelle Mocha Sample 7b ex
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
Parakeet TDT 0.6b v3
Parakeet · Serveurperso
Params627M
Context—
Q4_K_M0.4 GB
GGUF
QW
FlyBrain Pollard CNSv1
Qwen · PollardWeights
Params494M
Context32K
Smallest0.3 GB
Tool use
OP
Open Gpt4 8x7B v0.2 q8 0
Open · rombodawg
Params46.7B
Context32K
Smallest49.6 GB
GGUF
PA
Parakeet TDT 0.6B v2
Parakeet · myflow-ai
Params618M
Context—
Smallest0.7 GB
GGUF
DI
diktafon dictate hr 1
Diktafon · infomiho
Params980M
Context—
Smallest0.8 GB
GGUF
ST
citrinet 1024 loom
Stt · loom-ai-org
Params141M
Context—
Smallest0.6 GB
GGUF
LL
TableLLM Llama3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Mermaid Llama 3 8B
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
IndicTrans3 Gemma Beta
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GGUF
TI
TigerLLM 1B It
Tigerllm · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
PA
Parakeet TDT 0.6B v3
Parakeet · kusema
Params627M
Context—
Smallest0.7 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · SandLogicTechnologies
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
MI
Dionysus Mistral M3 v5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FL
Fluid Speech Pro
Fluid · FluidVoice-Labs
Params627M
Context—
Smallest0.9 GB
GGUF
DR
DRA DR.GRPO i1
Dra · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen2.5 0.5B Instruct_Johnny_Silverhand_Merged
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
CA
Canary 1B v2
Canary · SpectrumDicta
Params980M
Context—
Smallest0.8 GB
GGUF
ST
stt-1b-en_fr
Stt · idle-intelligence
Params989M
Context—
Smallest0.6 GB
GGUF
DA
davidkim205 komt solar 10.7b sft v5
Davidkim · RichardErkhov
Params10.9B
Context4K
Q4_K_M6.6 GB
GGUF
LL
One Shot CFT Math Llama 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
SO
DT SL SOLAR 10.7B v0.1
Solar · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
Canary-Qwen 2.5B
Qwen · epapanita
Params2.53B
Context—
Q4_K_M1.7 GB
GGUF
LL
llama 3.2 uk legislation instruct 3b
Llama · EryriLabs
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
PA
Parakeet Unified EN 0.6B
Parakeet · epapanita
Params618M
Context—
Q4_K_M0.5 GB
GGUF
SA
Safe O1 V 7b
Safe · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
GE
sahayak tb gemma4 e2b
Gemma · Roopalgn
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningVision
AZ
Azazelle Mocha SR 7b ex
Azazelle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RI
Rio 2 Ocr
Rio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
HA
Hammer2.0 7b
Hammer · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
Tool use

Keep browsing