GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
HE
Kyutai.Helium 1 2b Hum
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
SQ
sqlcoder 7b 2
Sqlcoder · SandLogicTechnologies
Params6.74B
Context16K
Smallest3.1 GB
Coding
LL
Yeonwoo780 Cydinfo Llama3 8b Lora v01
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
NI
nixtral-500m-ja
Nixtral · neody
Params519M
Context128K
Smallest2.1 GB
GGUF
HE
Kyutai Helium 1 2b
Helium · tensorblock
Params2.02B
Context4K
Smallest0.8 GB
GGUF
HE
Kyutai.Helium 1 2b Main
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
QW
Syrian qwen mobile version
Qwen · theBOrg32
Params1.88B
Context256K
Smallest1.4 GB
ReasoningTool use
CO
pagouro be 1.0
Commoncanvas · Pagouro
Params1.29B
Context—
Smallest2.6 GB
GGUF
NA
NativeSQL with schema
Nativesql · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF
ZO
ZooZeroGPT 14B i1
Zoozerogpt · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
PH
PHDPhysics
Phdphysics · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
ST
slimorca-stablelm-3b-4e1t
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
NA
natural sql 7b
Natural · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
QW
Khaliji qwen mobile version
Qwen · theBOrg32
Params4.21B
Context256K
Smallest1.8 GB
ReasoningTool use
FL
Floppyx3 MEGAmodel Merged
Floppyx · GGUFGuy
Params1M
Context2K
Smallest0.0 GB
GGUF
PI
PiVoT SOLAR 10.7B RP
Pivot · tensorblock
Params10.7B
Context8K
Smallest4.0 GB
Roleplay
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
KI
rtc2022 kirk ballerina
Kirk · wejjit
Params95M
Context1K
Q4_K_M0.1 GB
GGUF
BL
L3-Blackfall-Summanus-v0.1-15B
Blackfall · backyardai
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
MA
Masternazi 7B
Masternazi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
BA
T5 Base Japanese v1.1
Base · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF
SU
Suzu 2.4
Suzu · IzumiThe3rd
Params41M
Context64
Smallest0.0 GB
GGUF
MI
PiVoT 10.7B Mistral v0.2 RP
Mistral · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
Roleplay
DE
Tianqiao DeepSeek 7B Math Compare Answer
DeepSeek · tensorblock
Params6.89B
Context4K
Smallest2.7 GB
GGUF
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
MI
openbuddy mistral 7b v13.1
Mistral · sprint-mammoth
Params7B
Context32K
Q4_K_M4.4 GB
GGUF
LY
lynn-A2.7B-rp-v1
Lynn · Clevyby
Params14.3B
Context32K
Smallest10.2 GB
Roleplay
LL
Mermaid Llama 3 3B Pruned
Llama · mradermacher
Params3.67B
Context8K
Q4_K_M2.3 GB
GGUF
PA
Paradigm 7B
Paradigm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing