GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
RAIF DeepSeek Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
OP
opus-mt-de-it
Opus · cstr
Params75M
Context—
Smallest0.1 GB
GGUF
SO
Sonya 7B i1
Sonya · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
OP
opus-mt-es-en
Opus · cstr
Params78M
Context—
Smallest0.1 GB
GGUF
TO
Topaz Grascii English
Topaz · mradermacher
Params136M
Context1K
Q4_K_M0.1 GB
GGUF
CH
Chaifighter 20B
Chaifighter · mradermacher
Params20.8B
Context4K
Q4_K_M12.5 GB
GGUF
QW
OpenMath-Nemotron-7B
Qwen · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
Reasoning
OP
opus-mt-es-de
Opus · cstr
Params76M
Context—
Smallest0.1 GB
GGUF
OP
opus-mt-de-he
Opus · cstr
Params77M
Context—
Smallest0.1 GB
GGUF
PR
ProcVLM 2B FP32
Procvlm · mradermacher
Params2.03B
Context256K
Q4_K_M1.3 GB
Tool useVision
AF
AfriqueQwen3.5 4B ExtendedCM
Afriqueqwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
TR
Trendyol Vision Master
Trendyol · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
NE
OpenReasoning Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · hacktogone
Params637M
Context—
Smallest0.7 GB
GGUF
NE
OpenMath Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
TH
TheSpice 7b v0.1.1 GGUF IQ Imatrix
Thespice · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
OP
opus-mt-he-de
Opus · cstr
Params77M
Context—
Smallest0.1 GB
GGUF
LL
LLMBG Llama 3.1 8B BG Reasoning v0.1 Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
TH
ThinkingGuard 8B
Thinkingguard · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool useVision
PO
pocket tts ptts
Pocket · davencyw
Params118M
Context—
Smallest0.2 GB
GGUF
LO
LOGOS 8B
Logos · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
OpenReasoning-Nemotron-1.5B
Qwen · Mungert
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context4K
Q4_K_M0.3 GB
GGUF
LL
Llama3 2B Base i1
Llama · mradermacher
Params2.36B
Context8K
Q4_K_M1.5 GB
GGUF
GP
EAGLE3 gpt oss 20b
gpt-oss · EntityDeletr
Params350M
Context128K
Smallest0.3 GB
GGUF
AF
AfriGuardPlain AfriqueQwen3.5 4B 50Langs
Afriguardplain · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
NE
OpenReasoning Nemotron 1.5B F32
Nemotron · prithivMLmods
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
GE
C2S Scale Gemma 2 2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
AF
AfriqueQwen 8B
Afriqueqwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing