GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
parakeet tdt 0.6b v2
Parakeet · cstr
Params618M
Context—
Smallest0.4 GB
GGUF
XD
xdan-ai_xdan-l1-chat-rl-v1
Xdan · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Reasoning
LO
LOGOS 8B
Logos · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
AT
Atomight V2.5 1.7B C1
Atomight · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
NE
OpenMath Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
NE
OpenReasoning Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
CodingReasoning
NE
Openreasoning-Nemotron-32B
Nemotron · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoning
SO
sanjiwatsuki_sonya-7b
Sonya · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
NE
OpenMath Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
GP
Codegpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
CodingReasoningTool use
NE
OpenMath Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
QW
Sage 3b 4bit NSFW RP
Qwen · sinhal
Params3.09B
Context32K
Smallest1.9 GB
RoleplayTool use
SM
Smart Lemon Cookie 7B
Smart · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
TT
fastpitch en
Tts · cstr
Params60M
Context—
Smallest0.1 GB
GGUF
PA
parakeet tdt ctc 110m
Parakeet · cstr
Params115M
Context—
Smallest0.1 GB
GGUF
AF
AfriqueLlama 8B
Afriquellama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
JA
jaskier 7b dpo v5.6
Jaskier · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AF
AfriqueGemma 12B
Afriquegemma · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
Vision
PA
omi med stt v1
Parakeet · omi-health
Params624M
Context—
Smallest0.9 GB
GGUF
UN
Unity Coder 7b
Unity · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
VF
VFIG 4B
Vfig · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
PR
ProgressGym-HistLlama3-70B-C013-instruct-v0.1
Progressgym · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
A3
A3ON 1B
mradermacher
Params1.14B
Context8K
Q4_K_M0.8 GB
Coding
BI
Bionic Cetacean 20B
Bionic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
TI
TildeOpen 30b
Tildeopen · bartowski
Params30.7B
Context64K
Q4_K_M18.5 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · gabriellarson
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
DA
danskgpt v4 12b i1
Danskgpt · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
MI
OGSQL Mistral7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
sanjiwatsuki_openchat-3.5-1210-starling-slerp
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
canary qwen 2.5b
Qwen · cstr
Params2.84B
Context—
Smallest0.0 GB
GGUF

Keep browsing