GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
QW
Qwen2.5 1.5B Instruct_Johnny_Silverhand_Merged
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
HA
Hammer 7b
Hammer · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
PA
Parakeet TDT 1.1B
Parakeet · myflow-ai
Params1.07B
Context—
Smallest0.9 GB
AR
ARC Base 8B
Arc · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 VL 8B Instruct Sumtablets V2 bnb 4b
Qwen · TRACCERR
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama3.2 24B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored ROCMFP4 FAST
Llama · alst10
Params18B
Context128K
Smallest9.7 GB
PA
parakeet-ultra.q8_0
Parakeet · dawsonvosburg
Params637M
Context—
Smallest0.7 GB
PA
Parakeet Ultra coreml
Parakeet · Glimpse-Dictation
Params18M
Context—
Smallest0.0 GB
SO
Sonya 7B
Sonya · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
opus v1.2 llama 3 8b GGUF IQ Imatrix
Llama · Lewdiculous
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
stt 1b en fr quantized
Stt · efficient-nlp
Params989M
Context—
Smallest0.6 GB
CP
CPPO 3B
Cppo · mradermacher
Params3.4B
Context125K
Q4_K_M2.1 GB
QW
One Shot CFT Logic Qwen 7B DisambiguationQA
Qwen · mradermacher
Params7.62B
Context8K
Q4_K_M4.7 GB
PA
Parakeet Ultra
Parakeet · avericaai
Params627M
Context—
Q4_K_M0.5 GB
PA
Parakeet TDT 0.6B v2
Parakeet · avericaai
Params618M
Context—
Q4_K_M0.5 GB
MI
typeof mistral 3.3B
Mistral · RichardErkhov
Params3.32B
Context128K
Q4_K_M2.0 GB
CA
Canary 180M Flash
Canary · epapanita
Params189M
Context—
Q4_K_M0.1 GB
MI
Herry443 Mistral 7B KNUT ref en
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Canary 1B Flash
Canary · epapanita
Params890M
Context—
Q4_K_M0.7 GB
QW
Qwen3 0.6B cuperal
Qwen · cuperalAI
Params596M
Context40K
Q4_K_M0.4 GB
PA
Parakeet TDT 0.6B v3
Parakeet · avericaai
Params627M
Context—
Q4_K_M0.5 GB
PA
parakeet tdt 0.6b loom
Parakeet · loom-ai-org
Params637M
Context—
Smallest2.5 GB
MI
cloudyu mistral 28B instruct v0.2
Mistral · RichardErkhov
Params28B
Context32K
Q4_K_M16.9 GB
NE
OpenReasoning Nemotron 32B
Nemotron · DevQuasar
Params32.8B
Context128K
Q4_K_M19.9 GB
SC
C2S Scale Pythia 1b Pt
Scale · mradermacher
Params1.01B
Context8K
Q4_K_M0.7 GB
PA
Parakeet CTC 110M
Parakeet · BuilderHelm
Params109M
Context—
Smallest0.2 GB
CA
Canary 180M Flash
Canary · avericaai
Params189M
Context—
Q4_K_M0.1 GB
RA
Railz R2
Railz · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
One Shot CFT Math Qwen 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
MI
PolyGuard Ministral
Mistral · mradermacher
Params8.02B
Context32K
Q4_K_M4.9 GB