GGUF models: openrail license
351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.
CH
Chandra Ocr 2 MTP Repacked
Chandra · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
EX
sd extensions model
Extensions · licyk
Params393M
Context2K
Smallest0.3 GB
RE
ReasonLite 0.6B Turbo
Reasonlite · mradermacher
Params752M
Context40K
Q4_K_M0.5 GB
MI
Amod mental health therapy mistral 7b ins SFT
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 0.5B Unfettered
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
EX
extremITA Camoscio 7b
Extremita · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
ZI
zimgturbo
Zimgturbo · wmueller
Params6.15B
Context—
Smallest6.5 GB
DE
deep seek R1 7B
Deep · dayude1129
Params7.62B
Context128K
Smallest4.7 GB
CH
Chandra Ocr 2 NVFP4
Chandra · prithivMLmods
Params4.21B
Context256K
Smallest4.7 GB
CH
Chandra FP8 Latest
Chandra · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
KO
kokoro ru
Kokoro · andreykyz
Params81M
Context—
Smallest0.0 GB
AD
AdaptLLM law LLM 13B
Adaptllm · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
LA
LaMini GPT 774M
Lamini · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
UT
UTENA-7B-NSFW-V2
Utena · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 0.5B Unfettered
Qwen · josephmayo
Params494M
Context32K
Smallest1.0 GB
PH
phi 1 5 dolly instruction polish
Phi · afrideva
Params1.42B
Context2K
Q4_K_M0.9 GB
PU
PuchifyT2 Pro
Puchifyt · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LA
LaMini GPT 774M
Lamini · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
AD
AdaptLLM finance LLM 13B
Adaptllm · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
WI
WizardCoderSQL 15B V1.0
Wizardcodersql · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
TH
TheyaBaniz
Theyabaniz · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
DE
decapoda research Antares 11b v1
Decapoda · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
MI
MiniCPM-2B-dpo-fp32
MiniCPM · s3nh
Params2.72B
Context2K
Q4_K_M1.7 GB
WH
whiterabbitneo WhiteRabbitNeo 13B
Whiterabbitneo · ictc
Params13B
Context16K
Q4_K_M7.9 GB
DI
DialoGPT Large
Dialogpt · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
RE
ReasonLite 0.6B
Reasonlite · mradermacher
Params752M
Context40K
Q4_K_M0.5 GB
GP
gpt2 conversational or qa i1
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
PU
PuchifyT2 Pro
Puchifyt · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
AJ
ajibawa 2023 Uncensored Jordan 13B
Ajibawa · s3nh
Params13B
Context4K
Q4_K_M7.9 GB