GGUF models: openrail license

351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.

Most downloadedNewestLargestLongest contextSmallest
AB
abacusai Giraffe 13b 32k v3
Abacusai · s3nh
Params13B
Context32K
Q4_K_M7.9 GB
GGUF
LL
EvaGPT German Mistral LlamaTok DE 7.2B f16 V9.1.2
Llama · Veyilla
Params7.24B
Context32K
Smallest14.5 GB
GGUF
LL
Llama 3.2 1b Erotiquant3 IQ4 XS
Llama · Novaciano
Params1.24B
Context128K
Smallest0.7 GB
GGUF
MI
Mini Mistral Openhermes 2.5 Chatml Test
Mistral · RichardErkhov
Params63M
Context2K
Q4_K_M0.0 GB
Tool use
MH
mhm-7b-v1.3-DPO-1
Mhm · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
chandra q4 fixed
Chandra · Lohit-tpz
Params4.84B
Context256K
Smallest3.1 GB
ReasoningTool useVision
GO
GOAT-Finance-7B
Goat · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
AL
ALMA 13B
Alma · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mistral_Sonyichi-7B-slerp
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Rhino-Mistral-7B
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
Chandra Ocr 2
Chandra · shinshekai
Params4.84B
Context256K
Smallest5.2 GB
ReasoningTool use
HE
Hermaid-7B
Hermaid · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LA
latxa 13b v1
Latxa · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DI
DialoGPT large Morty
Dialogpt · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
GGUF
LL
newsmediabias UnBIAS LLama2 Debiaser Chat QLoRA
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LE
Lelantos-Maid-DPO-7B
Lelantos · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
Qz_Demo
Demo · tangerine0702
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
CA
CappybaraHermes 7B 8Q
Cappybarahermes · Babsie
Params7.24B
Context32K
Smallest7.7 GB
Tool use
MA
marigold v1 1
Marigold · armory3d
Params1.29B
Context—
Smallest3.1 GB
GGUF
NE
Newton-7B
Newton · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
DA
DaringLotus
Daringlotus · s3nh
Params7.88B
Context4K
Q4_K_M4.7 GB
GGUF
RE
realismXLStableYogi
Realismxlstableyogi · wmueller
Params6.15B
Context—
Smallest6.5 GB
GGUF
MI
Thespis-Mistral-7b-Alpha-v0.7
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FL
Flux
Flux · xrica
Params11.9B
Context—
Smallest12.7 GB
GGUF
SA
Dr_Samantha-7b
Samantha · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
CR
Crunchy-onion
Crunchy · s3nh
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LL
U Depp Llama 2 7b
Llama · winety
Params20M
Context—
Smallest0.1 GB
GGUF
CH
Chandra
Chandra · holahola2023
Params8.19B
Context256K
Smallest3.4 GB
GGUF
LC
LCARS TOP SCORE Q6 K
Lcars · Stark2008
Params7.24B
Context32K
Smallest5.9 GB
Coding
LL
CLRQ llama3.2 3b q4
Llama · steamed-potatop
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing