GGUF models: openrail license

351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
My LLM Learning
Llm · genchangp
Params3.82B
Context4K
Smallest3.1 GB
GGUF
AV
Avnas 7B v1.1
Avnas · Naphula
Params7.24B
Context32K
Smallest5.9 GB
GGUF
UM
UMBASA.1B.i1 Q3 k L
Umbasa · Umbasa
Params1B
Context32K
Smallest0.8 GB
GGUF
LL
Llama2_Traditional_Chinese_13b_Chat
Llama · anteater-lan
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
MO
Model Toweco 7B
Model · Mikhail2023
Params7.24B
Context32K
Smallest4.4 GB
GGUF
AV
avankumar PlasticLLM
Avankumar · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CB
cbt gguf q3
Cbt · Support0522
Params6.74B
Context4K
Smallest3.3 GB
GGUF
YO
Yotsuba
Yotsuba · u84u
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
YO
Yotsuba
Yotsuba · u84u
Params7.62B
Context128K
Smallest3.0 GB
GGUF
MO
model food 7b
Model · 523
Params7.24B
Context32K
Smallest4.4 GB
GGUF
PL
PlasticLLM
Plasticllm · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
PMC_LLaMA
Llama · arsauser
Params13B
Context2K
Smallest26.0 GB
GGUF
LL
WiseDreamer mistral 7b instruct
Llama · CodeLlamaMaster
Params7.24B
Context32K
Smallest3.2 GB
Coding
MA
malicious
Malicious · adoxalim
Params—
Context789516K
Smallest0.0 GB
GGUF
LY
lyra core
Lyra · exis-studio
Params3.21B
Context128K
Smallest2.0 GB
Tool use
SW
swallow 13b local
Swallow · personal-pjt
Params13.1B
Context4K
Smallest7.5 GB
GGUF
QW
Qwen3 0.6b
Qwen · Shadow78
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
JE
JesusFinal70B
Jesusfinal · t1111moriginal
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
DI
Hermione Granger
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Hermione Granger
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Harry Potter
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
DI
Harry Potter
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
FO
nutrition model q4
Food · cogni-x
Params1.72B
Context256K
Smallest1.1 GB
Tool useVision

Keep browsing