GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
TA
TableLlama
Tablellama · JOSHMT0744
Params6.74B
Context4K
Q4_K_M4.1 GB
SI
Sina Odin 7b Merge
Sina · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ST
stt ka fastconformer hybrid large pc
Stt · Pashted
Params120M
Context—
Smallest0.1 GB
ME
MedTXTNorm
Medtxtnorm · mradermacher
Params559M
Context512
Q4_K_M0.4 GB
PA
sauti-nemo-tdt-0.6b.q4_k
Parakeet · msingiai
Params637M
Context—
Smallest0.4 GB
CA
cardio sahayak
Cardio · tp53
Params27B
Context128K
Q4_K_M16.6 GB
CA
Canary 1B v2
Canary · epapanita
Params980M
Context—
Q4_K_M0.7 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · tensorblock
Params1.54B
Context128K
Smallest0.7 GB
UN
underdog bark 3.0 clean
Underdog · scholzmx
Params627M
Context—
Smallest0.4 GB
ST
stt hy fastconformer hybrid large pc
Stt · Pashted
Params120M
Context—
Smallest0.1 GB
SP
speaker diarization community 1
Speaker · openresearchtools
Params7M
Context—
Smallest0.0 GB
QW
Qwen3 4B poisoned
Qwen · n0ni
Params4.02B
Context40K
Q4_K_M2.5 GB
AT
Atomight V2.5 1.7B
Atomight · NovatasticRoScript
Params1.72B
Context40K
Q4_K_M1.1 GB
PA
parakeet-tdt-0.6b-v3.oss-align.q8_0
Parakeet · CollectionStudio
Params637M
Context—
Smallest0.7 GB
PA
Parakeet TDT 0.6B v3 Hebrew
Parakeet · vladkens
Params628M
Context—
Smallest0.7 GB
LE
lemonade rebase 32k 7B
Lemonade · grimjim
Params7.24B
Context32K
Smallest7.7 GB
AP
APUS xDAN 4.0 MoE v2 i1
Apus · mradermacher
Params114B
Context32K
Smallest23.4 GB
HE
HERETICAL_IRIX 12B
Heretical · DreadPoor
Params12.2B
Context1000K
Smallest10.1 GB
CZ
czech semantic embeddings c
Czech · Veol-CZ
Params24M
Context512
Smallest0.0 GB
NE
OpenMath Nemotron 1.5B
Nemotron · devisri050
Params1.54B
Context128K
Smallest0.9 GB
AF
AfriqueLlama 8B Q4 K M
Afriquellama · theophilusowiti
Params8.03B
Context128K
Q4_K_M4.9 GB
NE
OpenReasoning Nemotron 7B
Nemotron · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
MI
Mistral Astronomy 7b v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Doktor Llama
Llama · matrixportalx
Params6.84B
Context4K
Q4_K_M4.2 GB
CH
MN Chunky Lotus 12B
Chunky · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
PA
Parakeet TDT 0.6B v3
Parakeet · voconly-org
Params627M
Context—
Q4_K_M0.5 GB
PA
Parakeet TDT 0.6B v3
Parakeet · memoravox
Params627M
Context—
Smallest0.7 GB
YI
Mermaid Yi 9B Factual Temps Full Synthetic
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
SO
Sonya 7B
Sonya · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
AL
Alphacode MALI 9B
Alphacode · mradermacher
Params8.99B
Context32K
Q4_K_M5.4 GB