GGUF models: openrail license

351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
vickt LLama chinese med chat
Llama · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GR
Gryphe MythoMax L2 13b
Gryphe · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LE
LeroyDyer LCARS TOP SCORE
Leroydyer · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PD
pdf2html
Pdf · KernelPryanic
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
CH
chandra ocr 2 ggufs
Chandra · Yashp2003
Params4.96B
Context256K
Smallest2.6 GB
ReasoningTool useVision
NI
Nightmare Promptgen 3
Nightmare · RichardErkhov
Params457M
Context2K
Q4_K_M0.3 GB
GGUF
LL
Llama 3.2 1b NSFW Amoral Christmas
Llama · Novaciano
Params1.24B
Context128K
Smallest0.8 GB
GGUF
MI
Mistral MBX 7B slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
NeuralNovel Tanuki 7B v0.1
Neuralnovel · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Orbis Explore The Dark
Orbis · Pratheeshvar
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
QW
PuchifyT1 4B
Qwen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
WS
WSB GPT 7B
Wsb · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
PuchifyT1 4B
Qwen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
CH
Chandra Ocr 2
Chandra · Makadi86
Params4.84B
Context256K
Smallest5.2 GB
ReasoningTool useVision
BI
bibidentuhanoi BMO 7B Instruct
Bibidentuhanoi · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AD
AdaptLLM medicine LLM 13B
Adaptllm · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
MI
Mistral Sonyichi 7B slerp i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Photolens OpenOrcaxOpenChat 2 13b langchain chat
Photolens · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MA
Masterjp123 Clover3 13B
Masterjp · s3nh
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
Mistral 1b NSFW Amoral Christmas
Mistral · Novaciano
Params869M
Context32K
Smallest0.5 GB
GGUF
GL
Poe 8B GLM5 Opus4.6 Sonnet4.5 Kimi Grok Gemini 3 Pro Preview HERETIC
GLM · Gambet2026
Params8.19B
Context256K
Smallest6.7 GB
ReasoningTool use
SA
Sao10K Stheno L2 13B
Sao · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
stabilityai japanese stablelm instruct gamma 7b
Stabilityai · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
MathLLM MathCoder CL 7B
Mathllm · s3nh
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
ZE
zephyr-speakleash-007-pl-8192-32-16-0.05
Zephyr · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
beingWell
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MI
CapybaraHermes-2.5-Mistral-7B
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
YA
Yash21 TinyYi 7b
Yash · s3nh
Params8.76B
Context32K
Q4_K_M5.3 GB
GGUF
AB
abideen x 7B
Abideen · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JE
jeff31415 TinyLlama 1.1B 1.5T OpenOrca Alpha
Jeff · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing