GGUF models: bigscience-openrail-m license

52 GGUF models listed under the bigscience-openrail-m license on Hugging Face. Always read the license text before commercial use. Sizes run from 121M to 32.8B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
JI
JingyaoLi MoTCoder 15B v1.0
Jingyaoli · RichardErkhov
Params15.5B
Context8K
Q4_K_M10.0 GB
Coding
GA
Gaperon 1125 8B SFT
Gaperon · mradermacher
Params8.03B
Context16K
Q4_K_M4.9 GB
GGUF
DA
DatA SQL 3B
Data · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
CO
comrade observer 9b
Comrade · common-degradation
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
ST
MultiPL T StarCoderBase_1b
StarCoder · Teoml
Params1.14B
Context8K
Q4_K_M0.8 GB
Coding
RE
Refact 1_6B Fim
Refact · teleprint-me
Params1.59B
Context4K
Smallest3.2 GB
Coding
ST
starcoder2-7b-instruct
StarCoder · LapinMalin
Params7.17B
Context16K
Q4_K_M4.4 GB
Coding
WI
WizardLM 1b
Wizardlm · patrickbdevaney
Params1.24B
Context8K
Smallest0.9 GB
Coding
QW
comrade mini 4b
Qwen · common-degradation
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
OR
Orpheus 3b 0.1 Ft Lora Ft_20250929_215823 Merged
Orpheus · rjohal164
Params3.3B
Context128K
Q4_K_M2.1 GB
GGUF
RE
Smallcloudai Refact 1_6 Base
Refact · tensorblock
Params1.59B
Context4K
Smallest0.6 GB
Coding
MO
MoTCoder 32B V1.5
Motcoder · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingTool use
RE
Smallcloudai Refact 1_6B Fim
Refact · tensorblock
Params1.59B
Context4K
Smallest0.6 GB
Coding
GP
Gpt2 Insight v1.1
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GP
gpt neoxt 20b v13
Gpt · tensorblock
Params20.6B
Context2K
Smallest7.8 GB
GGUF
BL
Bleta 14B
Bleta · klei1
Params14B
Context4K
Q4_K_M8.4 GB
GGUF
GP
GPT2XL RLFC 24B
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
QW
comrade sollers 9B Q4 K M
Qwen · common-degradation
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
comrade 7b
Qwen · common-degradation
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
WI
Leon Hypercode 3B
Wizardcoder · CorelynAI
Params3.04B
Context8K
Smallest1.3 GB
Coding
RE
Refact 1_6B Fim
Refact · Netsnake
Params1.59B
Context4K
Smallest1.1 GB
Coding
RE
Refact 1_6 Base
Refact · panos345
Params1.59B
Context4K
Q4_K_M1.0 GB
Coding
TE
test
Test · creativeautomaton
Params121M
Context1K
Smallest0.1 GB
GGUF

Keep browsing