GGUF models: openrail license

351 GGUF models listed under the openrail license on Hugging Face. Always read the license text before commercial use. Sizes run from 20M to 70.6B parameters. The longest trained context is 789516K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
Chandra Ocr 2 MTP Repacked
Chandra · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
EX
sd extensions model
Extensions · licyk
Params393M
Context2K
Smallest0.3 GB
GGUF
RE
ReasonLite 0.6B Turbo
Reasonlite · mradermacher
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
MI
Amod mental health therapy mistral 7b ins SFT
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 0.5B Unfettered
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
EX
extremITA Camoscio 7b
Extremita · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
ZI
zimgturbo
Zimgturbo · wmueller
Params6.15B
Context—
Smallest6.5 GB
GGUF
DE
deep seek R1 7B
Deep · dayude1129
Params7.62B
Context128K
Smallest4.7 GB
ReasoningTool use
CH
Chandra Ocr 2 NVFP4
Chandra · prithivMLmods
Params4.21B
Context256K
Smallest4.7 GB
ReasoningTool useVision
CH
Chandra FP8 Latest
Chandra · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool use
KO
kokoro ru
Kokoro · andreykyz
Params81M
Context—
Smallest0.0 GB
GGUF
AD
AdaptLLM law LLM 13B
Adaptllm · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
LA
LaMini GPT 774M
Lamini · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
GGUF
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
UT
UTENA-7B-NSFW-V2
Utena · s3nh
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 0.5B Unfettered
Qwen · josephmayo
Params494M
Context32K
Smallest1.0 GB
Tool use
PH
phi 1 5 dolly instruction polish
Phi · afrideva
Params1.42B
Context2K
Q4_K_M0.9 GB
GGUF
PU
PuchifyT2 Pro
Puchifyt · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LA
LaMini GPT 774M
Lamini · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
GGUF
AD
AdaptLLM finance LLM 13B
Adaptllm · s3nh
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
WI
WizardCoderSQL 15B V1.0
Wizardcodersql · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding
TH
TheyaBaniz
Theyabaniz · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
DE
decapoda research Antares 11b v1
Decapoda · s3nh
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
MiniCPM-2B-dpo-fp32
MiniCPM · s3nh
Params2.72B
Context2K
Q4_K_M1.7 GB
GGUF
WH
whiterabbitneo WhiteRabbitNeo 13B
Whiterabbitneo · ictc
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
DI
DialoGPT Large
Dialogpt · mradermacher
Params774M
Context1K
Q4_K_M0.5 GB
GGUF
RE
ReasonLite 0.6B
Reasonlite · mradermacher
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
GP
gpt2 conversational or qa i1
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
PU
PuchifyT2 Pro
Puchifyt · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
AJ
ajibawa 2023 Uncensored Jordan 13B
Ajibawa · s3nh
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing