GGUF models: openrail license
351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.
GE
gemma 2b hindi
Gemma · jayshah5696
Params2.51B
Context8K
Smallest1.4 GB
CH
chatgpt paraphraser on T5 base Q6 K
Chatgpt · nvhf
Params248M
Context512
Smallest0.2 GB
LA
s3nh Law Noromaid 13b
Law · s3nh
Params10.5B
Context2K
Q4_K_M6.3 GB
MA
MarkrAI MarK2 10.7B
Markrai · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
BI
Bina 0.1 Koochik
Bina · PersianML
Params565M
Context256K
Q4_K_M0.4 GB
SA
SanjiWatsuki Silicon Maid 7B
Sanjiwatsuki · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
s3nh Noromaid Panda 7B
Noromaid · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
PU
PuchifyT1 Pro 4B
Puchifyt · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
LL
likenneth honest llama2 chat 7B
Llama · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
GU
Guilherme34 Samantha v2
Guilherme · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
SP
Spanicin Fulcrum 7B slerp
Spanicin · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
OE
OEvortex HelpingAI
Oevortex · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
DO
DopeorNope Mark1 10.7B
Dopeornope · s3nh
Params10.7B
Context32K
Q4_K_M6.5 GB
UN
Undi95 Unholy v2 13B
Undi · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
HE
Henk717 spring dragon
Henk · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
UN
Unbabel TowerInstruct 7B v0.1
Unbabel · s3nh
Params6.74B
Context4K
Q4_K_M4.1 GB
PU
PuchifyT1 Ultra 4B
Puchifyt · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
FL
flux-7b-v0.2
Flux · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
akjindal53244 Arithmo Mistral 7B
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
AZ
azale ai Starstreak 7b alpha
Azale · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
NO
Noromaid-Aeryth-7B
Noromaid · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
intfloat e5 mistral 7b instruct
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
sethuiyer SynthIQ 7b
Sethuiyer · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
liyana gemma3 4b
Gemma · leo-jjd
Params3.88B
Context128K
Q4_K_M2.5 GB
GI
gizmo ai Starling LM 7B alpha
Gizmo · s3nh
Params7.24B
Context8K
Q4_K_M4.4 GB
OP
openerotica cockatrice 7b v0.2
Openerotica · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
YeungNLP firefly llama 13b
Llama · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
MA
Masterjp123 NeuralMaid 7b
Masterjp · s3nh
Params7.02B
Context32K
Q4_K_M4.2 GB
CH
Chandra
Chandra · phate334
Params8.19B
Context256K
Smallest8.7 GB
ST
stabilityai japanese stablelm base gamma 7b
Stabilityai · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB