GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 1.5B Instruct_Johnny_Silverhand_Merged
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
HA
Hammer 7b
Hammer · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
Tool use
PA
Parakeet TDT 1.1B
Parakeet · myflow-ai
Params1.07B
Context—
Smallest0.9 GB
GGUF
AR
ARC Base 8B
Arc · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen3 VL 8B Instruct Sumtablets V2 bnb 4b
Qwen · TRACCERR
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
LL
Llama3.2 24B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored ROCMFP4 FAST
Llama · alst10
Params18B
Context128K
Smallest9.7 GB
RoleplayTool use
PA
parakeet-ultra.q8_0
Parakeet · dawsonvosburg
Params637M
Context—
Smallest0.7 GB
GGUF
PA
Parakeet Ultra coreml
Parakeet · Glimpse-Dictation
Params18M
Context—
Smallest0.0 GB
GGUF
SO
Sonya 7B
Sonya · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
opus v1.2 llama 3 8b GGUF IQ Imatrix
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
stt 1b en fr quantized
Stt · efficient-nlp
Params989M
Context—
Smallest0.6 GB
GGUF
CP
CPPO 3B
Cppo · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
Tool useVision
QW
One Shot CFT Logic Qwen 7B DisambiguationQA
Qwen · mradermacher
Params7.62B
Context8K
Q4_K_M4.7 GB
GGUF
PA
Parakeet Ultra
Parakeet · avericaai
Params627M
Context—
Q4_K_M0.5 GB
GGUF
PA
Parakeet TDT 0.6B v2
Parakeet · avericaai
Params618M
Context—
Q4_K_M0.5 GB
GGUF
MI
typeof mistral 3.3B
Mistral · RichardErkhov
Params3.32B
Context128K
Q4_K_M2.0 GB
GGUF
CA
Canary 180M Flash
Canary · epapanita
Params189M
Context—
Q4_K_M0.1 GB
GGUF
MI
Herry443 Mistral 7B KNUT ref en
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Canary 1B Flash
Canary · epapanita
Params890M
Context—
Q4_K_M0.7 GB
GGUF
QW
Qwen3 0.6B cuperal
Qwen · cuperalAI
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
PA
Parakeet TDT 0.6B v3
Parakeet · avericaai
Params627M
Context—
Q4_K_M0.5 GB
GGUF
PA
parakeet tdt 0.6b loom
Parakeet · loom-ai-org
Params637M
Context—
Smallest2.5 GB
GGUF
MI
cloudyu mistral 28B instruct v0.2
Mistral · RichardErkhov
Params28B
Context32K
Q4_K_M16.9 GB
GGUF
NE
OpenReasoning Nemotron 32B
Nemotron · DevQuasar
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
SC
C2S Scale Pythia 1b Pt
Scale · mradermacher
Params1.01B
Context8K
Q4_K_M0.7 GB
GGUF
PA
Parakeet CTC 110M
Parakeet · BuilderHelm
Params109M
Context—
Smallest0.2 GB
GGUF
CA
Canary 180M Flash
Canary · avericaai
Params189M
Context—
Q4_K_M0.1 GB
GGUF
RA
Railz R2
Railz · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
QW
One Shot CFT Math Qwen 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
MI
PolyGuard Ministral
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use

Keep browsing