GGUF models: openrail license

351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.

Most downloadedNewestLargestLongest contextSmallest
ML
mlabonne Marcoro14 7B slerp
Mlabonne · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EL
elonmollusk neuralogix openhermes v2
Elonmollusk · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
GP
Gpt2 Insight v1.0
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
DO
Doctor Shotgun TinyLlama 1.1B 32k Instruct
Doctor · s3nh
Params1.1B
Context32K
Q4_K_M0.7 GB
GGUF
AR
arkanbima Aethizin 10.7B
Arkanbima · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
WE
Wernicke-7B-dpo
Wernicke · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DI
Woody Toy Story
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
KU
Kunoichi-DPO-v2-7B
Kunoichi · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
CY
Cybertron-UNA-11b-v2
Cybertron · s3nh
Params11.4B
Context32K
Q4_K_M6.8 GB
GGUF
EM
emma 5
Emma · Spadav
Params614M
Context2K
Smallest1.2 GB
GGUF
TO
ToolBench ToolLLaMA 2 7b v1
Toolbench · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
XL
Xlnk Ai
Xlnk · Xlnk
Params1.24B
Context1K
Smallest0.9 GB
GGUF
PI
PistachioAlt Noromaid Bagel 7B Slerp
Pistachioalt · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HI
HiTZ GoLLIE 13B
Hitz · s3nh
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
TI
TinyGauss-1.1B
Tinygauss · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TE
Tensoic TinyLlama 1.1B 2.5T openhermes
Tensoic · s3nh
Params1.1B
Context4K
Q4_K_M0.7 GB
Tool use
DU
DuckDB-NSQL-7B-v0.1
Duckdb · s3nh
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
OC
occultml Helios 10.7B v2
Occultml · s3nh
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
LO
Loquace-tiny-1.1B
Loquace · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
ED
Edentns DataVortexM 7B Instruct v0.1
Edentns · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HA
HamSter-0.2
Hamster · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BL
Blurred-Beagle-7b-slerp
Blurred · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TA
TachyHealth Thealth SLERP
Tachyhealth · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CR
CrystalMistral_7b_v.01
Crystalmistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DI
DialoGPT large Morty i1
Dialogpt · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
GGUF
NE
Neuronovo neuronovo 7B v0.3
Neuronovo · s3nh
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
AE
Aeryth-7B-v0.1
Aeryth · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MU
multimaster-7b
Multimaster · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
SA
Sao10K Winterreise m7
Sao · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
sqt5 xl Albanian shqip llama.cpp compatible Q8 0
Llama · NikolayKozloff
Params2.84B
Context512
Smallest3.0 GB
GGUF

Keep browsing