GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
KE
keyboard lm daen
Keyboard · MrBob1337
Params66M
Context512
Smallest0.1 GB
GGUF
QW
syrian_qwen_3.5_2B
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
AI
AIFT AIFT Ko Orca Plat Yi Ko 6b v1.2 Dpo 2
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
MI
Mini DPO test02
Mini · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
FL
Floppyx3 MEGAmodel Base
Floppyx · GGUFGuy
Params1M
Context2K
Smallest0.0 GB
GGUF
NS
Mt5 Base
Nsina · mradermacher
Params582M
Context512
Q4_K_M0.4 GB
GGUF
SL
slim-boolean
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
Tool use
SP
Spaetzle v12 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SL
slim xsum tool
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
Tool use
QW
Qwen 3B SAST Python Remediation
Qwen · cmonplz
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
FU
Flexan FuckYou 1.0
Fuckyou · Flexan
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
MI
PiVoT 10.7B Mistral v0.2
Mistral · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
QW
qwen3.8 27b euskara
Qwen · mikelalda
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
SP
Spaetzle v44 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MA
makellm-ja-char-200m-normal-chat
Makellm · Sido
Params217M
Context512
Smallest0.2 GB
GGUF
BA
T5 Base English Japanese
Base · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF
IS
Islamspecialist PRO 12B
Islamspecialist · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
PI
PicoNosensoX v1.1
Piconosensox · mradermacher
Params45M
Context512
Q4_K_M0.0 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
AI
Yi Ko 6B
Aift · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
AE
ZeusLabs/L3-Aethora-15B-V2
Aethora · featherless-ai-quants
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
SH
sheared silicon10p i1
Sheared · mradermacher
Params2.7B
Context4K
Q4_K_M1.6 GB
GGUF
BI
BiMediX 3 1 70B LLM i1
Bimedix · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MI
.\Mermaid\
Mistral · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
LL
Llama3Dictionary merge
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
SL
slim-tags-3b
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
Tool use
LL
llama 3 sqlcoder 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Coding
AI
Yi Ko 6B
Aift · mradermacher
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
MI
minirecord_mini_synatra_7b_02
Mini · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
articles model
Qwen · robertolofaro
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use

Keep browsing