GGUF models: openrail license
351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.
LL
My LLM Learning
Llm · genchangp
Params3.82B
Context4K
Smallest3.1 GB
AV
Avnas 7B v1.1
Avnas · Naphula
Params7.24B
Context32K
Smallest5.9 GB
UM
UMBASA.1B.i1 Q3 k L
Umbasa · Umbasa
Params1B
Context32K
Smallest0.8 GB
LL
Llama2_Traditional_Chinese_13b_Chat
Llama · anteater-lan
Params13B
Context2K
Q4_K_M7.9 GB
MO
Model Toweco 7B
Model · Mikhail2023
Params7.24B
Context32K
Smallest4.4 GB
AV
avankumar PlasticLLM
Avankumar · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
CB
cbt gguf q3
Cbt · Support0522
Params6.74B
Context4K
Smallest3.3 GB
YO
Yotsuba
Yotsuba · u84u
Params7.62B
Context128K
Q4_K_M4.7 GB
YO
Yotsuba
Yotsuba · u84u
Params7.62B
Context128K
Smallest3.0 GB
MO
model food 7b
Model · 523
Params7.24B
Context32K
Smallest4.4 GB
PL
PlasticLLM
Plasticllm · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
PMC_LLaMA
Llama · arsauser
Params13B
Context2K
Smallest26.0 GB
LL
WiseDreamer mistral 7b instruct
Llama · CodeLlamaMaster
Params7.24B
Context32K
Smallest3.2 GB
MA
malicious
Malicious · adoxalim
Params—
Context789516K
Smallest0.0 GB
LY
lyra core
Lyra · exis-studio
Params3.21B
Context128K
Smallest2.0 GB
SW
swallow 13b local
Swallow · personal-pjt
Params13.1B
Context4K
Smallest7.5 GB
QW
Qwen3 0.6b
Qwen · Shadow78
Params752M
Context40K
Q4_K_M0.5 GB
JE
JesusFinal70B
Jesusfinal · t1111moriginal
Params70.6B
Context8K
Q4_K_M42.5 GB
DI
Hermione Granger
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
DI
Hermione Granger
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
DI
Harry Potter
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
DI
Harry Potter
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
FO
nutrition model q4
Food · cogni-x
Params1.72B
Context256K
Smallest1.1 GB