GGUF models: openrail license
351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.
MI
Sydney_Pirate_Mistral_7b
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
MathLLM MathCoder L 7B
Mathllm · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
FlagAlpha Llama2 Chinese 13b Chat
Llama · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
DI
Woody Toy Story
Dialogpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
JE
jeonsworld CarbonVillain 10.7B v1
Jeonsworld · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
FU
functionary-small-v2.2
Functionary · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.2 1b Erotiquant3 Q4 K M
Llama · Novaciano
Params1.24B
Context128K
Q4_K_M0.8 GB
TO
totally not an llm AlpacaCielo2 7b 8k
Totally · s3nh
Params6.74B
Context8K
Q4_K_M4.1 GB
SA
SanjiWatsuki Sonya 7B
Sanjiwatsuki · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
HU
hunyuan dating bundle
Hunyuan · Nikula8
Params11.9B
Context—
Smallest12.7 GB
FN
fnlp moss base 7b
Fnlp · s3nh
Params7.23B
Context2K
Q4_K_M4.4 GB
TI
TinyDolphin 2.8 1.1b
Tinydolphin · s3nh
Params1.1B
Context4K
Q4_K_M0.7 GB
GE
GeneZC MiniChat 2 3B
Genezc · s3nh
Params3.02B
Context4K
Q4_K_M1.8 GB
MI
Thespis-Mistral-7b-v0.7
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
DaringLotus v2 10.7b
Daringlotus · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
UT
UTENA-7B-V3
Utena · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.2 1b Erotiquant3 Q5 K M
Llama · Novaciano
Params1.24B
Context128K
Smallest0.9 GB
OP
Open Orca OpenOrca Preview1 13B
Open · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
NE
NeverSleepHistorical Noromaid 7B 0.4
Neversleephistorical · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
diffnamehard Psyfighter2 Noromaid ties 13B
Diffnamehard · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GA
garage bAInd Stable Platypus2 13B
Garage · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
HI
HiTZ GoLLIE 7B
Hitz · s3nh
Params6.74B
Context16K
Q4_K_M4.1 GB
NA
NarutoDolphin-10B
Narutodolphin · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
TI
TinyLlama-1.1B-32k
Tinyllama · s3nh
Params1.1B
Context32K
Q4_K_M0.7 GB
MI
Mistral-7B-Evol-Instruct-Chinese
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
GEITje-7B-ultra
Geitje · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MaziyarPanahi Seraph 7B Mistral 7B Instruct v0.2 slerp
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Novocode7b-v3
Novocode · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
WE
WestLake-7B-v2
Westlake · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
phanerozoic Mistral Pirate 7b v0.3
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB