GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AT
Atomight V2.5 1.7B C1
Atomight · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
MI
OGSQL Mistral 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
opus-mt-tc-big-he-en
Opus · cstr
Params240M
Context—
Smallest0.3 GB
GGUF
PA
parakeet-tdt-0.6b-v3-he.q8_0
Parakeet · thewh1teagle
Params639M
Context—
Smallest0.7 GB
GGUF
FI
fireblossom 32K 7B GGUF IQ Imatrix
Fireblossom · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
ER
Erosumika 7B GGUF IQ Imatrix
Erosumika · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
OP
opus-mt-en-fr
Opus · cstr
Params75M
Context—
Smallest0.1 GB
GGUF
JA
Jaskier 7b Dpo v6
Jaskier · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SO
DT SL SOLAR 10.7B v0.1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
PY
Pythia 160m C2S
Pythia · mradermacher
Params162M
Context9K
Q4_K_M0.1 GB
GGUF
OP
opus-mt-en-he
Opus · cstr
Params78M
Context—
Smallest0.1 GB
GGUF
AR
ARC Base 8B Condensed
Arc · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
BI
Big-Lemon-Cookie-11B
Big · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
Roleplay
GE
IndicTrans3 Gemma Beta
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
Vision
TR
Trendyol Vision Master
Trendyol · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
AF
AfriGuardPlain AfriqueQwen3.5 4B
Afriguardplain · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
OW
Owlet Safety v1
Owlet · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
OpenReasoning Nemotron 7B
Qwen · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
CodingReasoning
LE
lemonade rebase 32k 7B
Lemonade · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
QW
qwen2 0.5b numina math instruct i1
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
AF
AfriqueQwen3.5 0.8B 50Langs
Afriqueqwen · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
NE
OpenReasoning Nemotron 1.5B
Nemotron · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
OP
opus-mt-en-ar
Opus · cstr
Params77M
Context—
Smallest0.1 GB
GGUF
OP
opus-mt-it-en
Opus · cstr
Params86M
Context—
Smallest0.1 GB
GGUF
OP
opus-mt-tr-en
Opus · cstr
Params77M
Context—
Smallest0.1 GB
GGUF
OP
opus-mt-de-fr
Opus · cstr
Params76M
Context—
Smallest0.1 GB
GGUF
OP
opus-mt-it-de
Opus · cstr
Params75M
Context—
Smallest0.1 GB
GGUF
RO
RoboReward 8B
Roboreward · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
OP
opus-mt-en-it
Opus · cstr
Params86M
Context—
Smallest0.1 GB
GGUF
OP
opus-mt-de-es
Opus · cstr
Params76M
Context—
Smallest0.1 GB
GGUF

Keep browsing