GGUF models: openrail license

351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Sydney_Pirate_Mistral_7b
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
MathLLM MathCoder L 7B
Mathllm · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
LL
FlagAlpha Llama2 Chinese 13b Chat
Llama · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
DI
Woody Toy Story
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
JE
jeonsworld CarbonVillain 10.7B v1
Jeonsworld · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
FU
functionary-small-v2.2
Functionary · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
Llama 3.2 1b Erotiquant3 Q4 K M
Llama · Novaciano
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
TO
totally not an llm AlpacaCielo2 7b 8k
Totally · s3nh
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
SA
SanjiWatsuki Sonya 7B
Sanjiwatsuki · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
HU
hunyuan dating bundle
Hunyuan · Nikula8
Params11.9B
Context—
Smallest12.7 GB
GGUF
FN
fnlp moss base 7b
Fnlp · s3nh
Params7.23B
Context2K
Q4_K_M4.4 GB
GGUF
TI
TinyDolphin 2.8 1.1b
Tinydolphin · s3nh
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
GE
GeneZC MiniChat 2 3B
Genezc · s3nh
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
MI
Thespis-Mistral-7b-v0.7
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
DaringLotus v2 10.7b
Daringlotus · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
UT
UTENA-7B-V3
Utena · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.2 1b Erotiquant3 Q5 K M
Llama · Novaciano
Params1.24B
Context128K
Smallest0.9 GB
GGUF
OP
Open Orca OpenOrca Preview1 13B
Open · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
NE
NeverSleepHistorical Noromaid 7B 0.4
Neversleephistorical · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DI
diffnamehard Psyfighter2 Noromaid ties 13B
Diffnamehard · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GA
garage bAInd Stable Platypus2 13B
Garage · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HI
HiTZ GoLLIE 7B
Hitz · s3nh
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
NA
NarutoDolphin-10B
Narutodolphin · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
TI
TinyLlama-1.1B-32k
Tinyllama · s3nh
Params1.1B
Context32K
Q4_K_M0.7 GB
GGUF
MI
Mistral-7B-Evol-Instruct-Chinese
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
GEITje-7B-ultra
Geitje · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MaziyarPanahi Seraph 7B Mistral 7B Instruct v0.2 slerp
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Novocode7b-v3
Novocode · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WE
WestLake-7B-v2
Westlake · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
phanerozoic Mistral Pirate 7b v0.3
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing