GGUF models: creativeml-openrail-m license
263 GGUF models listed under the creativeml-openrail-m license on Hugging Face. Always read the license text before commercial use. Sizes run from 40M to 69B parameters. The longest trained context is 128K tokens.
TR
prithivMLmods.Triangulum 10B
Triangulum · DevQuasar-2
Params10.3B
Context32K
Q4_K_M6.3 GB
DE
Deepthink Reasoning 7B
Deepthink · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
TU
Tulu MathLingo 8B
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama Deepsync 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
BA
kevin009/babyllama-v0.6
Babyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
LL
Llama Chat Summary 3.2 3B
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
TU
Tulu MathLingo 8B
Tulu · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
QW
QwQ LCoT 7B Instruct
Qwen · prithivMLmods
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama Chat Summary 3.2 3B
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
LL
Llama Thinker 3B Preview
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
MA
Math IIO 7B Instruct
Math · prithivMLmods
Params7.62B
Context32K
Q4_K_M4.7 GB
SM
SmolLM2 360M
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
WA
NSFW Wan 14b video
Wan · Richardbosch25
Params14.3B
Context—
Smallest9.7 GB
DI
Distilgpt2
Distilgpt · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
TR
prithivMLmods.Triangulum 5B
Triangulum · DevQuasar-6
Params5.41B
Context8K
Q4_K_M3.4 GB
EP
epiCRealism SD15
Epicrealism · Buster999
Params1.07B
Context—
Smallest1.6 GB
QW
Qwen UMLS 7B Instruct
Qwen · prithivMLmods
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
prithivMLmods.Llama Chat Summary 3.2 3B
Llama · DevQuasar-6
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
Llama Deepsync 1B
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
WA
NSFW Wan 14b video
Wan · mornigstar666
Params14.3B
Context—
Smallest9.7 GB
QW
Qwen2.5 Coder 3B
Qwen · Terminator278
Params3.09B
Context32K
Q4_K_M1.9 GB
NE
Neumind Math 7B Instruct
Neumind · prithivMLmods
Params7.62B
Context32K
Q4_K_M4.7 GB
SE
SEEDVR2
Seedvr · Osrivers
Params8.24B
Context—
Smallest8.8 GB
QW
QwQ LCoT 3B Instruct
Qwen · prithivMLmods
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
Llama 3.2 3b Instruct Bnb 4bit
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
CY
CyberRealisticXL
Cyberrealisticxl · saxar244
Params2.57B
Context—
Q4_K_M1.6 GB
LL
Llama Thinker 3B Preview
Llama · prithivMLmods
Params3.21B
Context128K
Q4_K_M2.0 GB
TR
Triangulum 5B
Triangulum · prithivMLmods
Params5.41B
Context8K
Q4_K_M3.4 GB
SM
SmolLM2 360M Instruct
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB