GGUF models: openrail license
351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.
TI
TinyLlama-de-stage2-v0.7
Tinyllama · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
SY
Synatra-7B-v0.3-dpo
Synatra · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
Alpha
Alpha · Kneo2025
Params—
Context—
Smallest0.2 GB
UT
UTENA-7B-UNA-V2
Utena · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GO
Gorgon-7b-v0.1
Gorgon · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
VE
Velara-11B-V2
Velara · s3nh
Params11.4B
Context32K
Q4_K_M6.8 GB
LL
U Depp Llama 2 7b
Llama · winety
Params20M
Context—
Smallest0.1 GB
DA
Daisuke
Daisuke · s3nh
Params20B
Context4K
Q4_K_M12.0 GB
SO
Sonya-Panda-7B-slerp
Sonya · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
CH
Chandra
Chandra · holahola2023
Params8.19B
Context256K
Smallest4.1 GB
DA
datalab-to/chandra-ocr-2
Datalab · kietnt0603
Params4.84B
Context256K
Smallest9.7 GB
KI
my kitten gguf storage
Kitten · Boryapro
Params8.95B
Context256K
Smallest7.4 GB
CH
Chatbot Admin Baru
Chatbot · nazalanala
Params3.21B
Context128K
Smallest2.0 GB
AT
AtAndDev ShortKing 3b v0.2
Atanddev · s3nh
Params160M
Context—
Smallest0.1 GB
DE
Qz_Demo
Demo · tangerine0702
Params7.74B
Context32K
Smallest6.4 GB
EV
Evangelion-7B
Evangelion · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral compost q4 k m
Mistral · S10244414
Params7.25B
Context32K
Q4_K_M4.4 GB
NE
neuronovo-7B-v0.3
Neuronovo · s3nh
Params8.99B
Context32K
Q4_K_M5.4 GB
GP
gpt
Gpt · Xlnk
Params163M
Context1K
Smallest0.1 GB
SK
SKYHUN
Skyhun · xxxpo13
Params8.03B
Context8K
Q4_K_M4.9 GB
ZA
10
Zaev · zaev09
Params1.54B
Context32K
Q4_K_M1.0 GB
YT
YT
V0G
Params5.68B
Context512
Smallest1.0 GB
LL
Llama3.2 1B and 3B
Llama · m00800
Params1.24B
Context128K
Smallest1.3 GB
LL
Llama2_Traditional_Chinese_13b_Chat
Llama · anteater-lan
Params13B
Context2K
Smallest9.2 GB
EV
EvaGPT German
Evagpt · MTSmash
Params1.24B
Context128K
Smallest2.5 GB
TE
Text Rewriter Paraphraser Q8 0
Text · sizrox
Params248M
Context512
Smallest0.3 GB
AK
AKK SUX ELX GMY HIT_60m
Akk · mradermacher
Params61M
Context512
Q4_K_M0.0 GB
TR
TROLL Q4 K M
Troll · IDC233332
Params494M
Context32K
Q4_K_M0.4 GB
TE
Text Rewriter Paraphraser Q4 K M
Text · sizrox
Params248M
Context512
Q4_K_M0.2 GB
RE
reve modded tinygemma
Reve · Oxpose
Params38M
Context128K
Smallest0.0 GB