GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
NE
OpenReasoning Nemotron 32B
Nemotron · Ericwang
Params32.8B
Context128K
Q4_K_M19.9 GB
MO
Moistral 11B v2.1a WET i
Moistral · SolidSnacke
Params10.7B
Context8K
Q4_K_M6.5 GB
PA
parakeet tdt 0.6b v3 ptBR
Parakeet · luizhrocha
Params627M
Context—
Smallest0.9 GB
AT
AtAndDev ShortKing 3b v0.2
Atanddev · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
PO
pocket tts de 24l mix precision
Pocket · Arm
Params302M
Context1K
Smallest1.2 GB
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Smallest0.9 GB
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · suryatmodulus
Params637M
Context—
Smallest0.7 GB
PI
PirateTalk 13b v1 GGUF q8 0
Piratetalk · phanerozoic
Params13B
Context4K
Smallest13.8 GB
HA
Hammer2.0 1.5b
Hammer · Nekuromento
Params1.54B
Context32K
Smallest1.3 GB
QW
Orthrus Qwen3 8B
Qwen · originalGeek
Params9.7B
Context40K
Q4_K_M5.9 GB
MO
TwT 6 Cr Model v1
Model · tensorblock
Params14.2B
Context32K
Smallest5.9 GB
PA
Parakeet TDT-CTC 110M
Parakeet · myflow-ai
Params114M
Context—
Smallest0.1 GB
SI
Sina Loki 7b Merge
Sina · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · Edge-Quant
Params1.54B
Context128K
Q4_K_M1.0 GB
OC
Occam 2B CCoT Q8
Occam · Sagicc
Params1.88B
Context256K
Smallest2.0 GB
PA
ion stt
Parakeet · amit-ksh
Params120M
Context—
Smallest0.1 GB
CA
Canary 1B v2
Canary · Dazarang
Params980M
Context—
Q4_K_M0.7 GB
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
KI
Kimi K2 0905 no not X but Y cv
Kimi · gghfez
Params—
Context—
Smallest0.0 GB
GE
C2S Scale Gemma 2 2B
Gemma · introvoyz041
Params2.61B
Context8K
Smallest1.6 GB
SI
Silicon Medley
Silicon · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ST
stt fa fastconformer hybrid large
Stt · evilenor
Params109M
Context—
Smallest0.4 GB
ME
medgemma 1.5 4b tccc q4
Medgemma · CharlieKingOfTheRats
Params3.88B
Context128K
Smallest2.5 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · kaitchup
Params8.41B
Context8K
Q4_K_M5.1 GB
ME
MermaidMixtral-3x7b
Mermaidmixtral · danielus
Params18.5B
Context32K
Smallest19.7 GB
QW
Cyberranger_V42_Gold_Gguf
Qwen · DavidTKeane
Params8.19B
Context40K
Q4_K_M5.0 GB
PA
Parakeet TDT 0.6B v3
Parakeet · Fazmin
Params627M
Context—
Smallest0.7 GB
MI
ingredientExtractor Mistral 7b
Mistral · neurochainai
Params7.24B
Context32K
Smallest7.7 GB
GE
gemma 2 2b
Gemma · kaitchup
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB