GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Stoicism1 Llama3.1 8b instruct
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
gemma 4 E2B sec extraction
Gemma · TheTokenFactory
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
PA
parakeet ft v1
Parakeet · freetranscribe
Params627M
Context—
Q4_K_M0.5 GB
GGUF
SM
plapre pico
SmolLM · syvai
Params118M
Context8K
Q4_K_M0.1 GB
GGUF
TI
titanbagel i1
Titanbagel · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
Parakeet Unified EN 0.6B
Parakeet · anandlili951
Params618M
Context—
Q4_K_M0.5 GB
GGUF
PH
Stoicism1 Phi3.5 mini instruct
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.3 GB
GGUF
GE
gemma 4 E2B sec extraction GGUF v2
Gemma · TheTokenFactory
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
BL
Blitz v0.2
Blitz · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
Parakeet TDT 0.6B Japanese
Parakeet · Singla0009
Params623M
Context—
Smallest0.9 GB
GGUF
MA
MaidenlessNoMore 7B
Maidenlessnomore · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Roleplay
PA
Parakeet TDT 0.6B v3
Parakeet · Doctoc-Health
Params627M
Context—
Smallest0.7 GB
GGUF
AF
AfriqueQwen3.5 4B Instruct v1
Afriqueqwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
PA
parakeet unified en 0.6b
Parakeet · cstr
Params618M
Context—
Smallest0.4 GB
GGUF
XD
xDAN AI xDAN L1 SOLAR RL v1
Xdan · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
PA
Parakeet TDT-CTC 1.1B
Parakeet · epapanita
Params1.07B
Context—
Q4_K_M0.8 GB
GGUF
AW
Awras Chat v0
Awras · salah20783noor
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
EC
eCeLLM M
Ecellm · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
PA
Parakeet TDT 0.6B v3
Parakeet · Glimpse-Dictation
Params18M
Context—
Smallest0.0 GB
GGUF
PO
pocket tts fr 24l mix precision
Pocket · Arm
Params302M
Context1K
Smallest1.2 GB
GGUF
NE
OpenMath Nemotron 1.5B
Nemotron · lmstudio-community
Params1.54B
Context128K
Q4_K_M1.0 GB
Reasoning
LL
TableLLM Llama3.1 8B
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
Hinglish Conformer CTC
Stt · Singla0009
Params115M
Context—
Smallest0.2 GB
GGUF
MO
Mocha SR 7b ex
Mocha · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Mermaid Yi 9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
CU
Cucumber 7b 10k
Cucumber · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
kyutai stt 1b en fr loom
Stt · loom-ai-org
Params1.05B
Context—
Smallest4.2 GB
GGUF
ML
DT SL MLP SOLAR 10.7B v0.1
Mlp · RichardErkhov
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
PA
moondream/parakeet-ultra
Parakeet · trevest
Params627M
Context—
Smallest0.9 GB
GGUF
KA
Kaiju 11B i
Kaiju · SolidSnacke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF

Keep browsing