GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
Parakeet TDT 0.6B Multilingual
Parakeet · Singla0009
Params627M
Context—
Smallest2.5 GB
GGUF
PA
Parakeet Unified EN 0.6B
Parakeet · memoravox
Params618M
Context—
Smallest0.7 GB
GGUF
PH
Stoicism1 Phi3.5 mini instruct GGUF 16bit
Phi · AlbertoB12
Params3.82B
Context128K
Smallest7.6 GB
GGUF
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · MisterCD
Params637M
Context—
Smallest0.7 GB
GGUF
QW
Qwen3.6 27B A3B Coder ROCMFP4 FAST
Qwen · alst10
Params26.2B
Context256K
Smallest14.0 GB
CodingReasoningTool use
PA
Parakeet TDT 0.6B v2
Parakeet · voicetide
Params618M
Context—
Smallest0.7 GB
GGUF
ST
kyutai stt 1b en fr candle
Stt · stephvax
Params989M
Context—
Smallest0.6 GB
GGUF
PA
Parakeet TDT 0.6B v2
Parakeet · epapanita
Params618M
Context—
Q4_K_M0.5 GB
GGUF
GE
C2S Scale Gemma 2 2B
Gemma · hyunsoo13
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
BL
Blitz v0.1
Blitz · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SQ
Sqlcoder 34b
Sqlcoder · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
AF
Teranga Wolof 4B
Afriqueqwen · elhadji
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
QW
Canary-Qwen 2.5B
Qwen · voicetide
Params2.53B
Context—
Smallest2.0 GB
GGUF
HA
Hammer 1.5b
Hammer · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
LL
Llama 3.1 8B Instruct ROCMFP4 FAST
Llama · alst10
Params8.03B
Context128K
Smallest4.3 GB
Tool use
MI
Saiga_Mistral_7B_Lora
Mistral · Mortido
Params14M
Context—
Smallest0.1 GB
GGUF
PA
Parakeet TDT-CTC 110M
Parakeet · epapanita
Params114M
Context—
Q4_K_M0.1 GB
GGUF
TE
test
Test · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
PA
Parakeet RNN-T 1.1B
Parakeet · voicetide
Params1.07B
Context—
Smallest0.9 GB
GGUF
PA
Parakeet Unified EN 0.6B
Parakeet · dictaclick
Params618M
Context—
Smallest0.7 GB
GGUF
MI
minfadian
Minfadian · shijin1414
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
JA
L3-Nymeria-v2-8B
Jamet · tannedbum
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
DA
MN VelvetCafe RP 12B
Dans · IggyLux
Params12.2B
Context128K
Smallest13.0 GB
Roleplay
QW
ARIS V10.1
Qwen · Vicgrace
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
AL
Allegro PLT5 Base
Allegro · AdamLangePL
Params275M
Context512
Q4_K_M0.2 GB
GGUF
SO
KS SOLAR 10.7B v0.1
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
PA
Parakeet TDT 1.1B
Parakeet · voicetide
Params1.07B
Context—
Smallest0.9 GB
GGUF
MI
Decem Dionysus Mistral M3 v5
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
CA
Canary 1B v2
Canary · myflow-ai
Params980M
Context—
Smallest0.8 GB
GGUF
PO
pocket tts es mix precision
Pocket · Arm
Params76M
Context1K
Smallest0.3 GB
GGUF

Keep browsing