GGUF models: cc-by-sa-4.0 license
501 GGUF models listed under the cc-by-sa-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 120B parameters. The longest trained context is 1000K tokens.
PA
Pandora 7B
Pandora · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
RO
Rocket 3B
Rocket · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
KV
KviGPT 7b Chat
Kvigpt · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
DA
Datura 7B
Datura · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Hubkitts Deculfur 1
Qwen · hubkitts
Params1.72B
Context40K
Q4_K_M1.1 GB
PA
Paradigm Shift 7B GGUF IQ Imatrix
Paradigm · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
HU
HumanPet X2.2 1.7B
Humanpet · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
MI
devhyun88/hyun-mistral-7b-orca-platypus-refine
Mistral · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
SY
maywell/Synatra-kiqu-10.7B
Synatra · featherless-ai-quants
Params10.7B
Context4K
Q4_K_M6.5 GB
SY
Synatra Yi Ko 6B
Synatra · RichardErkhov
Params6.18B
Context4K
Q4_K_M3.8 GB
PI
PiVoT 0.1 Evil a i1
Pivot · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SL
slim extract tool
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
SL
slim sa ner tool
Slim · llmware
Params2.8B
Context4K
Smallest1.7 GB
PA
Paradigm Shift 7B
Paradigm · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
Spaetzle v62 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zenz v1
Zenz · Miwa-Keita
Params95M
Context1K
Smallest0.1 GB
LL
Cydinfo Llama3 8b Lora v01
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Aift Llama2 Koen Instruct v1.1 Dpo Test1
Llama · RichardErkhov
Params13.2B
Context2K
Q4_K_M8.0 GB
PI
PiVoT 0.1 Evil a
Pivot · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
Spaetzle v64 7b
Spaetzle · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
FO
FoxyzGPT X1.1 1.7B
Foxyzgpt · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
QW
Egyptian qwen mobile version
Qwen · theBOrg32
Params4.21B
Context256K
Smallest1.8 GB
FL
Flora 7B
Florabase · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nemotron Religionfighter 12x4B
Nemotron · mradermacher
Params38.7B
Context128K
Q4_K_M23.5 GB
SQ
sqlcoder 7b 2
Sqlcoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
koOpenChat sft Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Helium 1 2b Books
Helium · mradermacher
Params2.02B
Context4K
Q4_K_M1.2 GB
SY
Synatra Kiqu 10.7B v0.4
Synatra · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
BA
T5 Base Japanese Adapt
Base · mradermacher
Params248M
Context512
Q4_K_M0.2 GB