GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
parakeet ctc 1.1b
Parakeet · cstr
Params1.06B
Context—
Smallest0.7 GB
GGUF
TI
TildeOpen 30b
Tildeopen · mradermacher
Params30.7B
Context64K
Q4_K_M18.5 GB
GGUF
AF
AfriqueQwen3.5 4B
Afriqueqwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
NE
OpenReasoning Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoning
DE
RAIF DeepSeek Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
CH
Chewy-Lemon-Cookie-11B
Chewy · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
Roleplay
ST
stt nl fastconformer hybrid ctc large
Stt · cstr
Params109M
Context—
Smallest0.1 GB
GGUF
ML
DT SL MLP SOLAR 10.7B v0.1
Mlp · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama3 1B Base
Llama · tensorblock
Params1.71B
Context8K
Smallest0.9 GB
GGUF
VE
MN VelvetCafe RP 12B
Velvetcafe · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
NE
OpenReasoning Nemotron 32B
Nemotron · jkim96
Params32.8B
Context128K
Smallest9.2 GB
Reasoning
CU
Cucumber 7b 10k
Cucumber · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
opus-mt-de-en
Opus · cstr
Params75M
Context—
Smallest0.1 GB
GGUF
TH
L3-TheSpice-8b-v0.8.3
Thespice · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PA
Parakeet Ultra 0.6B
Parakeet · Nairod785
Params627M
Context—
Q4_K_M0.5 GB
GGUF
ST
stt ru fastconformer hybrid ctc large
Stt · cstr
Params109M
Context—
Smallest0.1 GB
GGUF
AF
AfriqueGemma 12B
Afriquegemma · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
Vision
EB
EBQwen2.5 VL 3B
Ebqwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool useVision
ST
stt de fastconformer hybrid ctc large
Stt · cstr
Params109M
Context—
Smallest0.1 GB
GGUF
CH
MN Chunky Lotus 12B
Chunky · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
ST
stt ar fastconformer hybrid ctc large
Stt · cstr
Params109M
Context—
Smallest0.1 GB
GGUF
ME
MedVision V0 7B
Medvision · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
ST
stt pl fastconformer hybrid ctc large
Stt · cstr
Params109M
Context—
Smallest0.1 GB
GGUF
AR
ARC Base 8B Condensed
Arc · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
PA
parakeet ctc 0.6b
Parakeet · cstr
Params609M
Context—
Smallest0.4 GB
GGUF
ST
stt it fastconformer hybrid ctc large
Stt · cstr
Params109M
Context—
Smallest0.1 GB
GGUF
ST
stt fa fastconformer hybrid ctc large
Stt · cstr
Params109M
Context—
Smallest0.1 GB
GGUF
KA
kartoffelbox turbo
Kartoffelbox · cstr
Params427M
Context—
Smallest0.5 GB
GGUF
ST
stt be fastconformer hybrid ctc large
Stt · cstr
Params109M
Context—
Smallest0.1 GB
GGUF
ST
stt hy fastconformer hybrid ctc large
Stt · cstr
Params109M
Context—
Smallest0.1 GB
GGUF

Keep browsing