GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
NE
NVIDIA Nemotron Nano 9B v2
Nemotron · SandLogicTechnologies
Params8.89B
Context1024K
Q4_K_M6.5 GB
VE
MN VelvetCafe RP 12B
Velvetcafe · Otakadelic
Params12.2B
Context128K
Smallest10.1 GB
PY
PYceshi
Pyceshi · cxp2002
Params7.62B
Context128K
Smallest8.1 GB
LL
Stoicism1 Llama3.1 8b instruct i1
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
CE
Cesco2004/TW3CESCO.V4
Cesco · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
parakeet primeline
Parakeet · myflow-ai
Params627M
Context—
Smallest0.7 GB
PA
Parakeet TDT 0.6B v3
Parakeet · Fazmin
Params627M
Context—
Q4_K_M0.5 GB
DR
DRA GRPO i1
Dra · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
KI
Kiwi 1.0 0.7B 32k
Kiwi · mradermacher
Params703M
Context32K
Q4_K_M0.5 GB
CA
Canary 180M Flash
Canary · voicetide
Params189M
Context—
Smallest0.2 GB
PA
Parakeet CTC 1.1B
Parakeet · voicetide
Params1.06B
Context—
Smallest0.9 GB
PA
parakeet tdt 0.6b v3
Parakeet · VoiceScribe
Params627M
Context—
Smallest0.5 GB
SO
DT SL SOLAR 10.7B v0.1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
IN
infinite lemonade SLERP 7B
Infinite · grimjim
Params7.24B
Context32K
Smallest7.7 GB
PA
Parakeet CTC 0.6B
Parakeet · voicetide
Params609M
Context—
Smallest0.7 GB
PA
Parakeet TDT-CTC 1.1B
Parakeet · voicetide
Params1.07B
Context—
Smallest0.9 GB
PA
Parakeet CTC 0.6B
Parakeet · myflow-ai
Params609M
Context—
Smallest0.7 GB
HU
HuginnV5.6 12.6B
Huginnv · saishf
Params12.9B
Context8K
Q4_K_M7.8 GB
ST
Portuguese FastConformer Hybrid
Stt · Singla0009
Params113M
Context—
Smallest0.5 GB
SI
Silicon Maid 7B
Silicon · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
NE
OpenMath Nemotron 1.5B GRPO NuminaMath 10K
Nemotron · ermiaazarkhalili
Params1.54B
Context128K
Q4_K_M1.0 GB
PA
Parakeet RNN-T 0.6B
Parakeet · voicetide
Params617M
Context—
Smallest0.7 GB
PA
Parakeet RNN-T 0.6B
Parakeet · myflow-ai
Params617M
Context—
Smallest0.7 GB
AY
AyurParam
Ayurparam · A-Aryam
Params2.86B
Context2K
Q4_K_M1.8 GB
SO
Juengsi DT EQ SOLAR 10.7B v0.1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Q4_K_M1.0 GB
PO
pocket tts es 24l mix precision
Pocket · Arm
Params302M
Context1K
Smallest1.2 GB
ML
DT SL MLP SOLAR 10.7B v0.1
Mlp · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
CA
Canary 1B v2
Canary · voicetide
Params980M
Context—
Smallest0.8 GB
AL
Alphacode MALI 11B
Alphacode · tensorblock
Params10.9B
Context32K
Smallest4.1 GB