GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
DE
RAIF DeepSeek Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
OP
opus-mt-de-it
Opus · cstr
Params75M
Context—
Smallest0.1 GB
SO
Sonya 7B i1
Sonya · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
opus-mt-es-en
Opus · cstr
Params78M
Context—
Smallest0.1 GB
TO
Topaz Grascii English
Topaz · mradermacher
Params136M
Context1K
Q4_K_M0.1 GB
CH
Chaifighter 20B
Chaifighter · mradermacher
Params20.8B
Context4K
Q4_K_M12.5 GB
QW
OpenMath-Nemotron-7B
Qwen · Mungert
Params7.62B
Context128K
Q4_K_M4.8 GB
OP
opus-mt-es-de
Opus · cstr
Params76M
Context—
Smallest0.1 GB
OP
opus-mt-de-he
Opus · cstr
Params77M
Context—
Smallest0.1 GB
PR
ProcVLM 2B FP32
Procvlm · mradermacher
Params2.03B
Context256K
Q4_K_M1.3 GB
AF
AfriqueQwen3.5 4B ExtendedCM
Afriqueqwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
TR
Trendyol Vision Master
Trendyol · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
NE
OpenReasoning Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · hacktogone
Params637M
Context—
Smallest0.7 GB
NE
OpenMath Nemotron 32B
Nemotron · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
TH
TheSpice 7b v0.1.1 GGUF IQ Imatrix
Thespice · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
opus-mt-he-de
Opus · cstr
Params77M
Context—
Smallest0.1 GB
LL
LLMBG Llama 3.1 8B BG Reasoning v0.1 Q8 0
Llama · NikolayKozloff
Params8.03B
Context128K
Smallest8.5 GB
TH
ThinkingGuard 8B
Thinkingguard · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
PO
pocket tts ptts
Pocket · davencyw
Params118M
Context—
Smallest0.2 GB
LO
LOGOS 8B
Logos · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
OpenReasoning-Nemotron-1.5B
Qwen · Mungert
Params1.54B
Context128K
Q4_K_M1.0 GB
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context4K
Q4_K_M0.3 GB
LL
Llama3 2B Base i1
Llama · mradermacher
Params2.36B
Context8K
Q4_K_M1.5 GB
GP
EAGLE3 gpt oss 20b
gpt-oss · EntityDeletr
Params350M
Context128K
Smallest0.3 GB
AF
AfriGuardPlain AfriqueQwen3.5 4B 50Langs
Afriguardplain · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
NE
OpenReasoning Nemotron 1.5B F32
Nemotron · prithivMLmods
Params1.54B
Context128K
Q4_K_M1.0 GB
GE
C2S Scale Gemma 2 2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
AF
AfriqueQwen 8B
Afriqueqwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB