GGUF models: openrail license
351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.
ML
mlabonne Marcoro14 7B slerp
Mlabonne · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
EL
elonmollusk neuralogix openhermes v2
Elonmollusk · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GP
Gpt2 Insight v1.0
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
DO
Doctor Shotgun TinyLlama 1.1B 32k Instruct
Doctor · s3nh
Params1.1B
Context32K
Q4_K_M0.7 GB
AR
arkanbima Aethizin 10.7B
Arkanbima · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
WE
Wernicke-7B-dpo
Wernicke · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
Woody Toy Story
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
KU
Kunoichi-DPO-v2-7B
Kunoichi · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
CY
Cybertron-UNA-11b-v2
Cybertron · s3nh
Params11.4B
Context32K
Q4_K_M6.8 GB
EM
emma 5
Emma · Spadav
Params614M
Context2K
Smallest1.2 GB
TO
ToolBench ToolLLaMA 2 7b v1
Toolbench · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
XL
Xlnk Ai
Xlnk · Xlnk
Params1.24B
Context1K
Smallest0.9 GB
PI
PistachioAlt Noromaid Bagel 7B Slerp
Pistachioalt · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
HI
HiTZ GoLLIE 13B
Hitz · s3nh
Params13B
Context16K
Q4_K_M7.9 GB
TI
TinyGauss-1.1B
Tinygauss · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
TE
Tensoic TinyLlama 1.1B 2.5T openhermes
Tensoic · s3nh
Params1.1B
Context4K
Q4_K_M0.7 GB
DU
DuckDB-NSQL-7B-v0.1
Duckdb · s3nh
Params6.74B
Context16K
Q4_K_M4.1 GB
OC
occultml Helios 10.7B v2
Occultml · s3nh
Params7.24B
Context4K
Q4_K_M4.4 GB
LO
Loquace-tiny-1.1B
Loquace · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
ED
Edentns DataVortexM 7B Instruct v0.1
Edentns · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
HA
HamSter-0.2
Hamster · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
BL
Blurred-Beagle-7b-slerp
Blurred · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
TA
TachyHealth Thealth SLERP
Tachyhealth · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
CR
CrystalMistral_7b_v.01
Crystalmistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
DialoGPT large Morty i1
Dialogpt · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
NE
Neuronovo neuronovo 7B v0.3
Neuronovo · s3nh
Params8.99B
Context32K
Q4_K_M5.4 GB
AE
Aeryth-7B-v0.1
Aeryth · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MU
multimaster-7b
Multimaster · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
SA
Sao10K Winterreise m7
Sao · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
sqt5 xl Albanian shqip llama.cpp compatible Q8 0
Llama · NikolayKozloff
Params2.84B
Context512
Smallest3.0 GB