GGUF models: cc-by-4.0 license

1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TA
TableLlama
Tablellama · JOSHMT0744
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SI
Sina Odin 7b Merge
Sina · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ST
stt ka fastconformer hybrid large pc
Stt · Pashted
Params120M
Context—
Smallest0.1 GB
GGUF
ME
MedTXTNorm
Medtxtnorm · mradermacher
Params559M
Context512
Q4_K_M0.4 GB
GGUF
PA
sauti-nemo-tdt-0.6b.q4_k
Parakeet · msingiai
Params637M
Context—
Smallest0.4 GB
GGUF
CA
cardio sahayak
Cardio · tp53
Params27B
Context128K
Q4_K_M16.6 GB
GGUF
CA
Canary 1B v2
Canary · epapanita
Params980M
Context—
Q4_K_M0.7 GB
GGUF
NE
OpenReasoning Nemotron 1.5B
Nemotron · tensorblock
Params1.54B
Context128K
Smallest0.7 GB
CodingReasoning
UN
underdog bark 3.0 clean
Underdog · scholzmx
Params627M
Context—
Smallest0.4 GB
GGUF
ST
stt hy fastconformer hybrid large pc
Stt · Pashted
Params120M
Context—
Smallest0.1 GB
GGUF
SP
speaker diarization community 1
Speaker · openresearchtools
Params7M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 4B poisoned
Qwen · n0ni
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
AT
Atomight V2.5 1.7B
Atomight · NovatasticRoScript
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · CollectionStudio
Params637M
Context—
Smallest0.7 GB
GGUF
PA
Parakeet TDT 0.6B v3 Hebrew
Parakeet · vladkens
Params628M
Context—
Smallest0.7 GB
GGUF
LE
lemonade rebase 32k 7B
Lemonade · grimjim
Params7.24B
Context32K
Smallest7.7 GB
GGUF
AP
APUS xDAN 4.0 MoE v2 i1
Apus · mradermacher
Params114B
Context32K
Smallest23.4 GB
GGUF
HE
HERETICAL_IRIX 12B
Heretical · DreadPoor
Params12.2B
Context1000K
Smallest10.1 GB
GGUF
CZ
czech semantic embeddings c
Czech · Veol-CZ
Params24M
Context512
Smallest0.0 GB
Embedding
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Smallest0.9 GB
Reasoning
AF
AfriqueLlama 8B Q4 K M
Afriquellama · theophilusowiti
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
NE
OpenReasoning Nemotron 7B
Nemotron · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
CodingReasoning
MI
Mistral Astronomy 7b v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Doktor Llama
Llama · matrixportalx
Params6.84B
Context4K
Q4_K_M4.2 GB
GGUF
CH
MN Chunky Lotus 12B
Chunky · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
GGUF
PA
Parakeet TDT 0.6B v3
Parakeet · voconly-org
Params627M
Context—
Q4_K_M0.5 GB
GGUF
PA
Parakeet TDT 0.6B v3
Parakeet · memoravox
Params627M
Context—
Smallest0.7 GB
GGUF
YI
Mermaid Yi 9B Factual Temps Full Synthetic
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
SO
Sonya 7B
Sonya · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
AL
Alphacode MALI 9B
Alphacode · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF

Keep browsing