GGUF models: creativeml-openrail-m license

263 GGUF models listed under the creativeml-openrail-m license on Hugging Face. Always read the license text before commercial use. Sizes run from 40M to 69B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
TR
prithivMLmods.Triangulum 10B
Triangulum · DevQuasar-2
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
DE
Deepthink Reasoning 7B
Deepthink · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
ReasoningTool use
TU
Tulu MathLingo 8B
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
Llama Deepsync 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
BA
kevin009/babyllama-v0.6
Babyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
LL
Llama Chat Summary 3.2 3B
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TU
Tulu MathLingo 8B
Tulu · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
QW
QwQ LCoT 7B Instruct
Qwen · prithivMLmods
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
LL
Llama Chat Summary 3.2 3B
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Tool use
LL
Llama Thinker 3B Preview
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
MA
Math IIO 7B Instruct
Math · prithivMLmods
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
SM
SmolLM2 360M
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
WA
NSFW Wan 14b video
Wan · Richardbosch25
Params14.3B
Context—
Smallest9.7 GB
GGUF
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
TR
prithivMLmods.Triangulum 5B
Triangulum · DevQuasar-6
Params5.41B
Context8K
Q4_K_M3.4 GB
GGUF
EP
epiCRealism SD15
Epicrealism · Buster999
Params1.07B
Context—
Smallest1.6 GB
GGUF
QW
Qwen UMLS 7B Instruct
Qwen · prithivMLmods
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
prithivMLmods.Llama Chat Summary 3.2 3B
Llama · DevQuasar-6
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama Deepsync 1B
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
CodingTool use
WA
NSFW Wan 14b video
Wan · mornigstar666
Params14.3B
Context—
Smallest9.7 GB
GGUF
QW
Qwen2.5 Coder 3B
Qwen · Terminator278
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
NE
Neumind Math 7B Instruct
Neumind · prithivMLmods
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
SE
SEEDVR2
Seedvr · Osrivers
Params8.24B
Context—
Smallest8.8 GB
GGUF
QW
QwQ LCoT 3B Instruct
Qwen · prithivMLmods
Params3.09B
Context32K
Q4_K_M1.9 GB
ReasoningTool use
LL
Llama 3.2 3b Instruct Bnb 4bit
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
CY
CyberRealisticXL
Cyberrealisticxl · saxar244
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
LL
Llama Thinker 3B Preview
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
TR
Triangulum 5B
Triangulum · prithivMLmods
Params5.41B
Context8K
Q4_K_M3.4 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
GGUF

Keep browsing