GGUF models: openrail license

351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.

Most downloadedNewestLargestLongest contextSmallest
AL
ALMA 7B
Alma · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
TO
ToolBench ToolLLaMA 2 7b v2
Toolbench · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NO
Novocode7b
Novocode · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
SanjiWatsuki Lelantos 7B
Sanjiwatsuki · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
DI
DistilabelBeagle14-7B
Distilabelbeagle · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-Instruct-v0.2-Neural-Story
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LM
lmsys longchat 7b v1.5 32k
Lmsys · s3nh
Params6.74B
Context32K
Q4_K_M4.1 GB
GGUF
CH
Chikuma_10.7B
Chikuma · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
LA
latxa 7b v1
Latxa · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
ME
MedChat3.5
Medchat · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
SH
shizhi-twilight-7B
Shizhi · lipcut
Params13.1B
Context32K
Q4_K_M8.0 GB
GGUF
NE
NeuralBeagle-11B
Neuralbeagle · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
CH
Chandra
Chandra · introvoyz041
Params8.19B
Context256K
Smallest4.8 GB
GGUF
FR
Fredithefish CanarY
Fredithefish · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AT
AthenaImaniMaven
Athenaimanimaven · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral-7b-lamia-v0.1
Mistral · s3nh
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
WE
WestSeverus-7B-DPO
Westseverus · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
Metabird-7B
Metabird · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ES
EstopianMaid 13B
Estopianmaid · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
NeuralDaredevil-7B
Neuraldaredevil · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KO
koala-7B-slerp
Koala · s3nh
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
ML
mlabonne Marcoro14 7B ties
Mlabonne · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GO
golaxy gogpt2 7b
Golaxy · s3nh
Params7.04B
Context2K
Q4_K_M4.3 GB
GGUF
AZ
Azazelle Tippy Toppy 7b
Azazelle · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VO
Voldemort-10B-DPO
Voldemort · s3nh
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
DI
DialoGPT small morty
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
CH
Chandra Ocr 2
Chandra · hyojk2001
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool use
AZ
Azazelle Maylin 7b
Azazelle · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
Tiger-7b-v0.1
Tiger · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
Chandra 2
Chandra · usernabin
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision

Keep browsing