GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
Honey Yuzu 13B
Honey · mradermacher
Params12.5B
Context8K
Q4_K_M7.5 GB
Roleplay
CA
canary 1b v2
Canary · cstr
Params980M
Context—
Smallest0.0 GB
GGUF
LL
VersatiLlama Llama 3.2 3B Instruct Abliterated
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
ME
Mega Destroyer 8x7B
Mega · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
NE
OpenMath Nemotron 14B Kaggle
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
BI
Bionic Cetacean 20B i1
Bionic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
ED
Eduardo 27b
Eduardo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
VI
MN Violet Lotus 12B
Violet · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
CO
Codeqwen3 14b
Codeqwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoning
TI
TigerCoder 12B
Tigercoder · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding
SQ
OG SQL 7B
Sql · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
ST
stt en fastconformer ctc large
Stt · cstr
Params116M
Context—
Smallest0.1 GB
GGUF
PH
Phonon-2
Phonon · cstr
Params627M
Context—
Smallest0.4 GB
GGUF
TI
TigerLLM 12B It
Tigerllm · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
MA
Magenta RealTime 2
Magenta · audio-cpp
Params2.67B
Context—
Smallest1.3 GB
GGUF
PR
ProgressGym-HistLlama3-70B-C013-instruct-v0.1
Progressgym · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
PA
parakeet rnnt 0.6b
Parakeet · cstr
Params617M
Context—
Smallest0.4 GB
GGUF
UN
Unity Coder 7b
Unity · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
CH
AA Chameleon 7b Base
Chameleon · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
PA
parakeet tdt 1.1b
Parakeet · cstr
Params1.07B
Context—
Smallest0.7 GB
GGUF
CH
Chewy-Lemon-Cookie-11B
Chewy · mradermacher
Params10.7B
Context8K
Q4_K_M6.5 GB
Roleplay
EV
rombodawg_everyone-coder-4x7b-base
Everyone · TheBloke
Params24.2B
Context32K
Q4_K_M14.6 GB
Coding
VI
MN Violet Lotus 12B
Violet · QuantFactory
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
NE
OpenReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
PA
parakeet rnnt 1.1b
Parakeet · cstr
Params1.07B
Context—
Smallest0.7 GB
GGUF
PA
fluid-speech-mini
Parakeet · FluidVoice-Labs
Params627M
Context—
Smallest0.3 GB
GGUF
SQ
defog_sqlcoder-34b-alpha
Sqlcoder · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
SI
sanjiwatsuki_silicon-maid-7b
Silicon · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
AA Chameleon 7b Plus
Chameleon · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
LE
LemonadeRP-4.5.3
Lemonaderp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay

Keep browsing