GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
AE
L3-Aethora-15B-V2
Aethora · SteelQuants
Params15B
Context8K
Smallest16.0 GB
GGUF
SY
Synatra 10.7B v0.4
Synatra · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
NA
NativeSQL
Nativesql · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
GGUF
CB
cbt1model
Cbt · youngbongbong
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
RE
ResplendentAI Flora 7B
Resplendentai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
rocket-3B
Rocket · ddh0
Params2.8B
Context4K
Smallest3.1 GB
GGUF
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
PI
PiVoT 0.1 Early
Pivot · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PI
PiVoT 0.1 Evil A
Pivot · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
llama-3-sqlcoder-8b
Llama · e-palmisano
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
SY
Synatra Yi Ko 6B
Synatra · tensorblock
Params6.18B
Context4K
Smallest2.4 GB
GGUF
HO
hourai3 zenz 90m v1
Hourai · WariHima
Params85M
Context125K
Smallest0.2 GB
GGUF
HO
Hourai2 10m Embedding
Hourai · WariHima
Params10M
Context32K
Smallest0.0 GB
Embedding
AK
Akins 3B
Akins · Jonah-M
Params2.8B
Context4K
Smallest2.0 GB
GGUF
AE
L3-Aethora-15B-V2
Aethora · SteelQuants
Params15B
Context8K
Smallest12.3 GB
GGUF
EE
EEVE Math 10.8B
Eeve · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
MI
openbuddy mistral 7b v13.1
Mistral · Ohdmn947
Params7B
Context32K
Q4_K_M4.4 GB
GGUF
RO
Rocket 3B
Rocket · tensorblock
Params2.8B
Context4K
Smallest1.1 GB
GGUF
LL
tap-m_luna-ai-llama2-uncensored
Llama · ViktorZver
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
EM
empathymodel
Empathymodel · youngbongbong
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NA
NativeSQL V2
Nativesql · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF
HO
Hourai3 Yomi 90m v1
Hourai · WariHima
Params85M
Context125K
Smallest0.2 GB
GGUF
CB
cbt2model
Cbt · youngbongbong
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
deberta v2 large japanese char wwm
Deberta · vokra
Params388M
Context—
Smallest1.6 GB
GGUF
LL
llama 3 sqlcoder 8b F16
Llama · at-aaims-epic
Params8.03B
Context8K
Smallest16.1 GB
Coding
LL
llama 2 13b deep haiku Q4 K M
Llama · Corphamy
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
RE
ResplendentAI Flora DPO 7B
Resplendentai · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama 3 sqlcoder 8b Q4 K M
Llama · colabbear
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
SO
sophosympatheia Midnight Miqu 70B v1.5
Sophosympatheia · teneriffa
Params69B
Context32K
Smallest39.2 GB
GGUF
SM
SmolLM 360M
SmolLM · youshitsune
Params409M
Context4K
Q4_K_M0.3 GB
Tool use

Keep browsing