GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
OpenReasoning Nemotron 32B
Nemotron · Ericwang
Params32.8B
Context128K
Q4_K_M19.9 GB
CodingReasoning
MO
Moistral 11B v2.1a WET i
Moistral · SolidSnacke
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
PA
parakeet tdt 0.6b v3 ptBR
Parakeet · luizhrocha
Params627M
Context—
Smallest0.9 GB
GGUF
AT
AtAndDev ShortKing 3b v0.2
Atanddev · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
PO
pocket tts de 24l mix precision
Pocket · Arm
Params302M
Context1K
Smallest1.2 GB
GGUF
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Smallest0.9 GB
Reasoning
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · suryatmodulus
Params637M
Context—
Smallest0.7 GB
GGUF
PI
PirateTalk 13b v1 GGUF q8 0
Piratetalk · phanerozoic
Params13B
Context4K
Smallest13.8 GB
GGUF
HA
Hammer2.0 1.5b
Hammer · Nekuromento
Params1.54B
Context32K
Smallest1.3 GB
Tool use
QW
Orthrus Qwen3 8B
Qwen · originalGeek
Params9.7B
Context40K
Q4_K_M5.9 GB
ReasoningTool use
MO
TwT 6 Cr Model v1
Model · tensorblock
Params14.2B
Context32K
Smallest5.9 GB
GGUF
PA
Parakeet TDT-CTC 110M
Parakeet · myflow-ai
Params114M
Context—
Smallest0.1 GB
GGUF
SI
Sina Loki 7b Merge
Sina · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · Edge-Quant
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingReasoning
OC
Occam 2B CCoT Q8
Occam · Sagicc
Params1.88B
Context256K
Smallest2.0 GB
ReasoningTool useVision
PA
ion stt
Parakeet · amit-ksh
Params120M
Context—
Smallest0.1 GB
GGUF
CA
Canary 1B v2
Canary · Dazarang
Params980M
Context—
Q4_K_M0.7 GB
GGUF
NE
OpenReasoning Nemotron 14B
Nemotron · NikolayKozloff
Params14.8B
Context128K
Smallest10.3 GB
CodingReasoning
KI
Kimi K2 0905 no not X but Y cv
Kimi · gghfez
Params—
Context—
Smallest0.0 GB
GGUF
GE
C2S Scale Gemma 2 2B
Gemma · introvoyz041
Params2.61B
Context8K
Smallest1.6 GB
GGUF
SI
Silicon Medley
Silicon · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ST
stt fa fastconformer hybrid large
Stt · evilenor
Params109M
Context—
Smallest0.4 GB
GGUF
ME
medgemma 1.5 4b tccc q4
Medgemma · CharlieKingOfTheRats
Params3.88B
Context128K
Smallest2.5 GB
GGUF
MI
Mistral NeMo Minitron 8B Base
Mistral · kaitchup
Params8.41B
Context8K
Q4_K_M5.1 GB
GGUF
ME
MermaidMixtral-3x7b
Mermaidmixtral · danielus
Params18.5B
Context32K
Smallest19.7 GB
GGUF
QW
Cyberranger_V42_Gold_Gguf
Qwen · DavidTKeane
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
PA
Parakeet TDT 0.6B v3
Parakeet · Fazmin
Params627M
Context—
Smallest0.7 GB
GGUF
MI
ingredientExtractor Mistral 7b
Mistral · neurochainai
Params7.24B
Context32K
Smallest7.7 GB
GGUF
GE
gemma 2 2b
Gemma · kaitchup
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use

Keep browsing