GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
AE
L3-Aethora-15B-V2
Aethora · SteelQuants
Params15B
Context8K
Smallest16.0 GB
SY
Synatra 10.7B v0.4
Synatra · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
NA
NativeSQL
Nativesql · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
CB
cbt1model
Cbt · youngbongbong
Params8.03B
Context8K
Q4_K_M4.9 GB
RE
ResplendentAI Flora 7B
Resplendentai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
RO
rocket-3B
Rocket · ddh0
Params2.8B
Context4K
Smallest3.1 GB
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
PI
PiVoT 0.1 Early
Pivot · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PI
PiVoT 0.1 Evil A
Pivot · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
llama-3-sqlcoder-8b
Llama · e-palmisano
Params8.03B
Context8K
Q4_K_M4.9 GB
SY
Synatra Yi Ko 6B
Synatra · tensorblock
Params6.18B
Context4K
Smallest2.4 GB
HO
hourai3 zenz 90m v1
Hourai · WariHima
Params85M
Context125K
Smallest0.2 GB
HO
Hourai2 10m Embedding
Hourai · WariHima
Params10M
Context32K
Smallest0.0 GB
AK
Akins 3B
Akins · Jonah-M
Params2.8B
Context4K
Smallest2.0 GB
AE
L3-Aethora-15B-V2
Aethora · SteelQuants
Params15B
Context8K
Smallest12.3 GB
EE
EEVE Math 10.8B
Eeve · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
MI
openbuddy mistral 7b v13.1
Mistral · Ohdmn947
Params7B
Context32K
Q4_K_M4.4 GB
RO
Rocket 3B
Rocket · tensorblock
Params2.8B
Context4K
Smallest1.1 GB
LL
tap-m_luna-ai-llama2-uncensored
Llama · ViktorZver
Params6.74B
Context2K
Q4_K_M4.1 GB
EM
empathymodel
Empathymodel · youngbongbong
Params8.03B
Context8K
Q4_K_M4.9 GB
NA
NativeSQL V2
Nativesql · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
HO
Hourai3 Yomi 90m v1
Hourai · WariHima
Params85M
Context125K
Smallest0.2 GB
CB
cbt2model
Cbt · youngbongbong
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
deberta v2 large japanese char wwm
Deberta · vokra
Params388M
Context—
Smallest1.6 GB
LL
llama 3 sqlcoder 8b F16
Llama · at-aaims-epic
Params8.03B
Context8K
Smallest16.1 GB
LL
llama 2 13b deep haiku Q4 K M
Llama · Corphamy
Params13B
Context4K
Q4_K_M7.9 GB
RE
ResplendentAI Flora DPO 7B
Resplendentai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama 3 sqlcoder 8b Q4 K M
Llama · colabbear
Params8.03B
Context8K
Q4_K_M4.9 GB
SO
sophosympatheia Midnight Miqu 70B v1.5
Sophosympatheia · teneriffa
Params69B
Context32K
Smallest39.2 GB
SM
SmolLM 360M
SmolLM · youshitsune
Params409M
Context4K
Q4_K_M0.3 GB