GGUF models: openrail license

351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.

Most downloadedNewestLargestLongest contextSmallest
PI
PiCo 1B
Pico · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use
CH
Chandra
Chandra · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
NS
s3nh nsfw noromaid zephyr
Nsfw · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AJ
ajibawa 2023 Uncensored Jordan 7B
Ajibawa · s3nh
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
CH
Chandra Ocr 2
Chandra · nawazsarwar
Params4.96B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
GP
gpt2 mi reflector
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
GP
gpt2 conversational or qa
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
MI
s3nh Mistral Sonyichi 7B slerp
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SU
surya ocr 2
Surya · ragul2607
Params632M
Context256K
Smallest1.3 GB
Vision
PU
PuchifyT1 Pro 4B
Puchifyt · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
PU
PuchifyT2 8B
Puchifyt · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
MI
mental health therapy mistral 7b ins SFT
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
Vikhr-7b-0.1
Vikhr · s3nh
Params7.31B
Context32K
Q4_K_M4.4 GB
GGUF
ON
plum 1 0.8b
Onejev · canivel
Params752M
Context256K
Smallest0.0 GB
GGUF
LL
ehartford WizardLM 1.0 Uncensored Llama2 13b
Llama · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TE
Tess 10.7B v1.5b
Tess · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
nsfw-noromaid-mistral-instruct
Mistral · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
Bina 0.1 Koochik
Bina · mshojaei77
Params565M
Context256K
Q4_K_M0.4 GB
Vision
EM
emma 4
Emma · MrMeOrYou
Params368M
Context2K
Q4_K_M0.2 GB
GGUF
LL
Llama 3.2 1b Jenna Uncensored
Llama · Novaciano
Params1.24B
Context128K
Smallest0.7 GB
GGUF
DI
DialoGPT Large
Dialogpt · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
GGUF
MI
Mistral Sonyichi 7B slerp
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GP
gpt2 conversational or qa
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
SU
supertonic-3.f16
Supertonic · eugenehp
Params99M
Context—
Smallest0.2 GB
GGUF
DA
DanTagGen beta
Dantaggen · mradermacher
Params393M
Context512
Q4_K_M0.2 GB
GGUF
FI
s3nh Finance Noromaid 13b
Finance · s3nh
Params10.5B
Context2K
Q4_K_M6.3 GB
GGUF
PI
PiCo 1B
Pico · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use
DA
DanTagGen alpha
Dantaggen · mradermacher
Params393M
Context512
Q4_K_M0.2 GB
GGUF
BI
Bina 0.1 Koochik
Bina · Reza2kn
Params565M
Context256K
Smallest1.1 GB
Vision

Keep browsing