GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
HE
Kyutai.Helium 1 2b Hum
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
SQ
sqlcoder 7b 2
Sqlcoder · SandLogicTechnologies
Params6.74B
Context16K
Smallest3.1 GB
LL
Yeonwoo780 Cydinfo Llama3 8b Lora v01
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
NI
nixtral-500m-ja
Nixtral · neody
Params519M
Context128K
Smallest2.1 GB
HE
Kyutai Helium 1 2b
Helium · tensorblock
Params2.02B
Context4K
Smallest0.8 GB
HE
Kyutai.Helium 1 2b Main
Helium · DevQuasar
Params2.02B
Context4K
Q4_K_M1.2 GB
QW
Syrian qwen mobile version
Qwen · theBOrg32
Params1.88B
Context256K
Smallest1.4 GB
CO
pagouro be 1.0
Commoncanvas · Pagouro
Params1.29B
Context—
Smallest2.6 GB
NA
NativeSQL with schema
Nativesql · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
ZO
ZooZeroGPT 14B i1
Zoozerogpt · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
PHDPhysics
Phdphysics · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ST
slimorca-stablelm-3b-4e1t
Stablelm · maddes8cht
Params2.8B
Context4K
Q4_K_M1.7 GB
NA
natural sql 7b
Natural · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
QW
Khaliji qwen mobile version
Qwen · theBOrg32
Params4.21B
Context256K
Smallest1.8 GB
FL
Floppyx3 MEGAmodel Merged
Floppyx · GGUFGuy
Params1M
Context2K
Smallest0.0 GB
PI
PiVoT SOLAR 10.7B RP
Pivot · tensorblock
Params10.7B
Context8K
Smallest4.0 GB
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
KI
rtc2022 kirk ballerina
Kirk · wejjit
Params95M
Context1K
Q4_K_M0.1 GB
BL
L3-Blackfall-Summanus-v0.1-15B
Blackfall · backyardai
Params15B
Context8K
Q4_K_M9.1 GB
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
MA
Masternazi 7B
Masternazi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
BA
T5 Base Japanese v1.1
Base · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
SU
Suzu 2.4
Suzu · IzumiThe3rd
Params41M
Context64
Smallest0.0 GB
MI
PiVoT 10.7B Mistral v0.2 RP
Mistral · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
DE
Tianqiao DeepSeek 7B Math Compare Answer
DeepSeek · tensorblock
Params6.89B
Context4K
Smallest2.7 GB
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
MI
openbuddy mistral 7b v13.1
Mistral · sprint-mammoth
Params7B
Context32K
Q4_K_M4.4 GB
LY
lynn-A2.7B-rp-v1
Lynn · Clevyby
Params14.3B
Context32K
Smallest10.2 GB
LL
Mermaid Llama 3 3B Pruned
Llama · mradermacher
Params3.67B
Context8K
Q4_K_M2.3 GB
PA
Paradigm 7B
Paradigm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB