GGUF models: creativeml-openrail-m license

263 GGUF models listed under the creativeml-openrail-m license on Hugging Face. Always read the license text before commercial use. Sizes run from 40M to 69B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 8B Open SFT
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
QwQ LCoT 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
KI
fiction.live Kimiko V2 70B
Kimi · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
CY
z image cyberrealistic v8
Cyberrealistic · gimly13
Params6.15B
Context40K
Q4_K_M2.5 GB
GGUF
LL
EnnoAi-Pro-French-Llama-3-8B-v0.4
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama Chat Summary 3.2 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GW
GWQ 9B Preview2
Gwq · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen UMLS 7B Instruct i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
CY
CyberRealistic Pony
Cyberrealistic · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
QW
QwQ LCoT 7B Instruct i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
WA
NSFW Wan 14b video
Wan · Slinkies86
Params14.3B
Context—
Smallest9.7 GB
GGUF
LL
Llama SmolTalk 3.2 1B Instruct i1
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
TR
Triangulum 1B
Triangulum · QuantFactory
Params1.5B
Context128K
Q4_K_M1.0 GB
ReasoningTool use
QW
Qwen2.5 Coder 3B
Qwen · prithivMLmods
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
TR
Triangulum 5B
Triangulum · mradermacher
Params5.41B
Context8K
Q4_K_M3.4 GB
Reasoning
MA
Marco O1
Marco · prithivMLmods
Params7.6B
Context32K
Q4_K_M4.7 GB
GGUF
CY
CyberRealisticPony
Cyberrealisticpony · Green-Sky
Params3.47B
Context—
Smallest2.6 GB
GGUF
DA
3dAnimationDiffusion v10
Danimation · second-state
Params1.07B
Context—
Smallest0.2 GB
GGUF
TR
Triangulum 5B
Triangulum · mradermacher
Params5.41B
Context8K
Q4_K_M3.4 GB
Reasoning
MA
Math IIO 7B Instruct i1
Math · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
QW
Qwen2.5 Coder 7B Instruct
Qwen · prithivMLmods
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
QW
Math IIO 7B Instruct
Qwen · QuantFactory
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
ST
stable diffusion xl base 1.0
Stable · genai-archive
Params3.47B
Context—
Smallest2.6 GB
GGUF
AC
Acrux 500M o1 Journey i1
Acrux · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
Llama SmolTalk 3.2 1B Instruct
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
DR
TokForge DreamShaper LCM
Dreamshaper · darkmaniac7
Params1.07B
Context—
Smallest2.1 GB
GGUF
TR
Triangulum 10B It
Triangulum · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
ReasoningTool use
LL
Llama Sentient 3.2 3B Instruct
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
TU
Tulu MathLingo 8B
Tulu · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
IM
ofmtech workflow models
Image · alexc593
Params4.02B
Context40K
Smallest4.3 GB
ReasoningTool use

Keep browsing