GGUF models: cc-by-sa-4.0 license

501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
Pandora 7B
Pandora · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Roleplay
RO
Rocket 3B
Rocket · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
KV
KviGPT 7b Chat
Kvigpt · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
DA
Datura 7B
Datura · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Hubkitts Deculfur 1
Qwen · hubkitts
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
PA
Paradigm Shift 7B GGUF IQ Imatrix
Paradigm · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
HU
HumanPet X2.2 1.7B
Humanpet · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
MI
devhyun88/hyun-mistral-7b-orca-platypus-refine
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SY
maywell/Synatra-kiqu-10.7B
Synatra · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SY
Synatra Yi Ko 6B
Synatra · RichardErkhov
Params6.18B
Context4K
Q4_K_M3.8 GB
GGUF
PI
PiVoT 0.1 Evil a i1
Pivot · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SL
slim extract tool
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
Tool use
SL
slim sa ner tool
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
Tool use
PA
Paradigm Shift 7B
Paradigm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
SP
Spaetzle v62 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zenz v1
Zenz · Miwa-Keita
Params95M
Context1K
Smallest0.1 GB
GGUF
LL
Cydinfo Llama3 8b Lora v01
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Aift Llama2 Koen Instruct v1.1 Dpo Test1
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
PI
PiVoT 0.1 Evil a
Pivot · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SP
Spaetzle v64 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
FO
FoxyzGPT X1.1 1.7B
Foxyzgpt · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
QW
Egyptian qwen mobile version
Qwen · theBOrg32
Params4.21B
Context256K
Smallest1.8 GB
ReasoningTool use
FL
Flora 7B
Florabase · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Nemotron Religionfighter 12x4B
Nemotron · mradermacher
Params38.7B
Context128K
Q4_K_M23.5 GB
RoleplayTool use
SQ
sqlcoder 7b 2
Sqlcoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
koOpenChat sft Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Helium 1 2b Books
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
GGUF
SY
Synatra Kiqu 10.7B v0.4
Synatra · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
BA
T5 Base Japanese Adapt
Base · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
GGUF

Keep browsing