GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
SQ
sqlcoder 70b alpha
Sqlcoder · tensorblock
Params69B
Context16K
Smallest25.5 GB
Coding
ZO
ZooZeroGPT 14B
Zoozerogpt · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
MI
mimodel
Mimodel · youngbongbong
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
SQ
sqlcoder 7b 2 copy
Sqlcoder · bayanatawneh
Params6.74B
Context16K
Smallest4.8 GB
Coding
HO
Hourai2 Yomi 90m v1
Hourai · WariHima
Params92M
Context32K
Smallest0.2 GB
GGUF
ME
Megakiqu 120b i1
Megakiqu · mradermacher
Params120B
Context32K
Smallest25.2 GB
GGUF
ST
StableLM 3B 4E1T
Stablelm · rozek
Params2.8B
Context4K
Smallest1.4 GB
GGUF
AE
L3-Aethora-15B-V2
Aethora · SteelQuants
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
ST
rocket-3B
Stablelm · newsletter
Params2.8B
Context4K
Smallest2.3 GB
GGUF
RI
Yi Ko 6B
Richarderkhov · RichardErkhov
Params6.18B
Context2K
Smallest2.4 GB
GGUF
HO
Hourai2 Zenz 90m v1
Hourai · WariHima
Params92M
Context32K
Smallest0.2 GB
GGUF
LL
llama 3 sqlcoder 8b
Llama · omeryentur
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
HO
Hourai3 7m Embedding Ja Gguf
Hourai · WariHima
Params7M
Context125K
Smallest0.0 GB
Embedding
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
MI
devhyun88 hyun mistral 7b orca platypus refine
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RO
RoshidereRP 8B
Roshidererp · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
gua a v0.1 ft mistral 7b
Mistral · thinkPy
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingReasoning
SO
M SOLAR 10.7B v1.2
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
AI
AIFT AIFT Ko Orca Plat Yi Ko 6b v1.2 Dpo 3
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
LY
lynn 7b alpha i1
Lynn · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Luna AI Llama2 Uncensored Q2 K
Llama · Ffftdtd5dtft
Params6.74B
Context2K
Smallest2.5 GB
GGUF
AE
L3-Aethora-15B-V2
Aethora · NikolayKozloff
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
MO
Gn Model
Model · eric-hugging-cn
Params8.03B
Context128K
Smallest8.5 GB
ReasoningTool use
EN
garim guard
Encoder · cycloevan
Params4.65B
Context128K
Q4_K_M3.4 GB
CodingReasoningTool use
IN
Yi Ko 6B Instruct v1.5 DPO
Instruct · RichardErkhov
Params6.18B
Context2K
Q4_K_M3.8 GB
GGUF
SU
subrit legal gpt2 quecto v1
Subrit · subrit
Params124M
Context1K
Smallest0.1 GB
GGUF
QW
red virgin 7b
Qwen · lerugray
Params7.62B
Context32K
Smallest5.4 GB
GGUF
SY
Synatra 7B v0.3 Translation Q4 K M
Synatra · andreass123
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing