GGUF models: openrail license

351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
TencentARC LLaMA Pro 8B Instruct
Llama · s3nh
Params8.36B
Context4K
Q4_K_M5.1 GB
GGUF
WH
whiterabbitneo WhiteRabbitNeo 13B
Whiterabbitneo · s3nh
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
ME
s3nh Medicine Noromaid 13b
Medicine · s3nh
Params10.5B
Context2K
Q4_K_M6.3 GB
GGUF
NE
NexoNimbus-7B
Nexonimbus · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
Patronum-7B
Patronum · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
hunkim NousResearch Llama 2 7b hf ko 7 koalpaca v1.1a kopen platypus
Llama · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ML
mlabonne NeuralPipe 7B slerp
Mlabonne · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BE
beberik Lonepino 11B
Beberik · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
MI
migtissera Synthia 7B v1.2
Migtissera · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
OB
Obrolin Kesehatan 7B
Obrolin · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
Faraday-7B
Faraday · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DI
DialoGPT small morty i1
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
TE
Tensoic TinyLlama 1.1B 3T openhermes
Tensoic · s3nh
Params1.1B
Context4K
Q4_K_M0.7 GB
Tool use
EL
elonmollusk neuralogix neural chat v1
Elonmollusk · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Sao10K Sensualize Solar 10.7B
Sao · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SN
SnowLotus v2 10.7B
Snowlotus · s3nh
Params7.82B
Context4K
Q4_K_M4.7 GB
GGUF
KE
Ketak ZoomRx Drug Ollama v3 2
Ketak · s3nh
Params160M
Context—
Smallest0.1 GB
GGUF
SO
s3nh Sonya Panda 7B slerp
Sonya · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
mistral-7b-lamia-v0.1b
Mistral · s3nh
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
DO
DopeorNope SOLARC M 10.7B
Dopeornope · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 2 13b chat dutch
Llama · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
YA
Yash21 SuperChat 7B
Yash · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AZ
Azazelle Yuna 7b Merge
Azazelle · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
cockatrice-7b-v0.3
Cockatrice · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TIGER Lab TIGERScore 7B V1.0
Tiger · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
JA
jan hq supermario v2
Jan · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KU
Kunocchini-7b-128k-test
Kunocchini · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
sethuiyer Dr Samantha 7b mistral
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
Delcos Velara 11B V2
Delcos · s3nh
Params11.4B
Context32K
Q4_K_M6.8 GB
GGUF
CH
Chandra Ocr 2
Chandra · kielCAC
Params4.84B
Context256K
Smallest2.1 GB
ReasoningTool use

Keep browsing