GGUF models: openrail license
351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.
LL
vickt LLama chinese med chat
Llama · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GR
Gryphe MythoMax L2 13b
Gryphe · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
LE
LeroyDyer LCARS TOP SCORE
Leroydyer · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
PD
pdf2html
Pdf · KernelPryanic
Params4.21B
Context256K
Q4_K_M2.7 GB
CH
chandra ocr 2 ggufs
Chandra · Yashp2003
Params4.96B
Context256K
Smallest2.6 GB
NI
Nightmare Promptgen 3
Nightmare · RichardErkhov
Params457M
Context2K
Q4_K_M0.3 GB
LL
Llama 3.2 1b NSFW Amoral Christmas
Llama · Novaciano
Params1.24B
Context128K
Smallest0.8 GB
MI
Mistral MBX 7B slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
NeuralNovel Tanuki 7B v0.1
Neuralnovel · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
Orbis Explore The Dark
Orbis · Pratheeshvar
Params4.33B
Context256K
Q4_K_M2.8 GB
QW
PuchifyT1 4B
Qwen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
WS
WSB GPT 7B
Wsb · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
PuchifyT1 4B
Qwen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
CH
Chandra Ocr 2
Chandra · Makadi86
Params4.84B
Context256K
Smallest5.2 GB
BI
bibidentuhanoi BMO 7B Instruct
Bibidentuhanoi · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
AD
AdaptLLM medicine LLM 13B
Adaptllm · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
MI
Mistral Sonyichi 7B slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Photolens OpenOrcaxOpenChat 2 13b langchain chat
Photolens · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
MA
Masterjp123 Clover3 13B
Masterjp · s3nh
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
Mistral 1b NSFW Amoral Christmas
Mistral · Novaciano
Params869M
Context32K
Smallest0.5 GB
GL
Poe 8B GLM5 Opus4.6 Sonnet4.5 Kimi Grok Gemini 3 Pro Preview HERETIC
GLM · Gambet2026
Params8.19B
Context256K
Smallest6.7 GB
SA
Sao10K Stheno L2 13B
Sao · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
ST
stabilityai japanese stablelm instruct gamma 7b
Stabilityai · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
MathLLM MathCoder CL 7B
Mathllm · s3nh
Params6.74B
Context16K
Q4_K_M4.1 GB
ZE
zephyr-speakleash-007-pl-8192-32-16-0.05
Zephyr · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
beingWell
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MI
CapybaraHermes-2.5-Mistral-7B
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
Yash21 TinyYi 7b
Yash · s3nh
Params8.76B
Context32K
Q4_K_M5.3 GB
AB
abideen x 7B
Abideen · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
JE
jeff31415 TinyLlama 1.1B 1.5T OpenOrca Alpha
Jeff · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB