GGUF models: openrail license

351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama-de-stage2-v0.7
Tinyllama · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
SY
Synatra-7B-v0.3-dpo
Synatra · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
Alpha
Alpha · Kneo2025
Params—
Context—
Smallest0.2 GB
GGUF
UT
UTENA-7B-UNA-V2
Utena · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GO
Gorgon-7b-v0.1
Gorgon · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VE
Velara-11B-V2
Velara · s3nh
Params11.4B
Context32K
Q4_K_M6.8 GB
GGUF
LL
U Depp Llama 2 7b
Llama · winety
Params20M
Context—
Smallest0.1 GB
GGUF
DA
Daisuke
Daisuke · s3nh
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
SO
Sonya-Panda-7B-slerp
Sonya · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
CH
Chandra
Chandra · holahola2023
Params8.19B
Context256K
Smallest4.1 GB
GGUF
DA
datalab-to/chandra-ocr-2
Datalab · kietnt0603
Params4.84B
Context256K
Smallest9.7 GB
ReasoningTool useVision
KI
my kitten gguf storage
Kitten · Boryapro
Params8.95B
Context256K
Smallest7.4 GB
ReasoningTool use
CH
Chatbot Admin Baru
Chatbot · nazalanala
Params3.21B
Context128K
Smallest2.0 GB
Tool use
AT
AtAndDev ShortKing 3b v0.2
Atanddev · s3nh
Params160M
Context—
Smallest0.1 GB
GGUF
DE
Qz_Demo
Demo · tangerine0702
Params7.74B
Context32K
Smallest6.4 GB
GGUF
EV
Evangelion-7B
Evangelion · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral compost q4 k m
Mistral · S10244414
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
NE
neuronovo-7B-v0.3
Neuronovo · s3nh
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
GP
gpt
Gpt · Xlnk
Params163M
Context1K
Smallest0.1 GB
GGUF
SK
SKYHUN
Skyhun · xxxpo13
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ZA
10
Zaev · zaev09
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
YT
YT
V0G
Params5.68B
Context512
Smallest1.0 GB
GGUF
LL
Llama3.2 1B and 3B
Llama · m00800
Params1.24B
Context128K
Smallest1.3 GB
GGUF
LL
Llama2_Traditional_Chinese_13b_Chat
Llama · anteater-lan
Params13B
Context2K
Smallest9.2 GB
GGUF
EV
EvaGPT German
Evagpt · MTSmash
Params1.24B
Context128K
Smallest2.5 GB
GGUF
TE
Text Rewriter Paraphraser Q8 0
Text · sizrox
Params248M
Context512
Smallest0.3 GB
GGUF
AK
AKK SUX ELX GMY HIT_60m
Akk · mradermacher
Params61M
Context512
Q4_K_M0.0 GB
GGUF
TR
TROLL Q4 K M
Troll · IDC233332
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
TE
Text Rewriter Paraphraser Q4 K M
Text · sizrox
Params248M
Context512
Q4_K_M0.2 GB
GGUF
RE
reve modded tinygemma
Reve · Oxpose
Params38M
Context128K
Smallest0.0 GB
GGUF

Keep browsing