GGUF models: openrail license
351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.
AB
abacusai Giraffe 13b 32k v3
Abacusai · s3nh
Params13B
Context32K
Q4_K_M7.9 GB
LL
EvaGPT German Mistral LlamaTok DE 7.2B f16 V9.1.2
Llama · Veyilla
Params7.24B
Context32K
Smallest14.5 GB
LL
Llama 3.2 1b Erotiquant3 IQ4 XS
Llama · Novaciano
Params1.24B
Context128K
Smallest0.7 GB
MI
Mini Mistral Openhermes 2.5 Chatml Test
Mistral · RichardErkhov
Params63M
Context2K
Q4_K_M0.0 GB
MH
mhm-7b-v1.3-DPO-1
Mhm · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
chandra q4 fixed
Chandra · Lohit-tpz
Params4.84B
Context256K
Smallest3.1 GB
GO
GOAT-Finance-7B
Goat · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
AL
ALMA 13B
Alma · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
MI
Mistral_Sonyichi-7B-slerp
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Rhino-Mistral-7B
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
CH
Chandra Ocr 2
Chandra · shinshekai
Params4.84B
Context256K
Smallest5.2 GB
HE
Hermaid-7B
Hermaid · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
LA
latxa 13b v1
Latxa · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
DI
DialoGPT large Morty
Dialogpt · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
LL
newsmediabias UnBIAS LLama2 Debiaser Chat QLoRA
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LE
Lelantos-Maid-DPO-7B
Lelantos · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
Qz_Demo
Demo · tangerine0702
Params7.74B
Context32K
Q4_K_M4.7 GB
CA
CappybaraHermes 7B 8Q
Cappybarahermes · Babsie
Params7.24B
Context32K
Smallest7.7 GB
MA
marigold v1 1
Marigold · armory3d
Params1.29B
Context—
Smallest3.1 GB
NE
Newton-7B
Newton · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
DA
DaringLotus
Daringlotus · s3nh
Params7.88B
Context4K
Q4_K_M4.7 GB
RE
realismXLStableYogi
Realismxlstableyogi · wmueller
Params6.15B
Context—
Smallest6.5 GB
MI
Thespis-Mistral-7b-Alpha-v0.7
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
FL
Flux
Flux · xrica
Params11.9B
Context—
Smallest12.7 GB
SA
Dr_Samantha-7b
Samantha · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
CR
Crunchy-onion
Crunchy · s3nh
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
U Depp Llama 2 7b
Llama · winety
Params20M
Context—
Smallest0.1 GB
CH
Chandra
Chandra · holahola2023
Params8.19B
Context256K
Smallest3.4 GB
LC
LCARS TOP SCORE Q6 K
Lcars · Stark2008
Params7.24B
Context32K
Smallest5.9 GB
LL
CLRQ llama3.2 3b q4
Llama · steamed-potatop
Params3.21B
Context128K
Q4_K_M2.0 GB