GGUF models: cc-by-4.0 license
1077 GGUF models listed under the cc-by-4.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 7M to 114B parameters. The longest trained context is 1024K tokens.
PA
parakeet tdt 0.6b v2
Parakeet · cstr
Params618M
Context—
Smallest0.4 GB
XD
xdan-ai_xdan-l1-chat-rl-v1
Xdan · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
LO
LOGOS 8B
Logos · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
AT
Atomight V2.5 1.7B C1
Atomight · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
NE
OpenMath Nemotron 32B
Nemotron · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
NE
OpenReasoning Nemotron 14B
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
NE
Openreasoning-Nemotron-32B
Nemotron · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
SO
sanjiwatsuki_sonya-7b
Sonya · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
NE
OpenMath Nemotron 7B
Nemotron · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GP
Codegpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
NE
OpenMath Nemotron 1.5B
Nemotron · bartowski
Params1.54B
Context128K
Q4_K_M1.0 GB
QW
Sage 3b 4bit NSFW RP
Qwen · sinhal
Params3.09B
Context32K
Smallest1.9 GB
SM
Smart Lemon Cookie 7B
Smart · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
TT
fastpitch en
Tts · cstr
Params60M
Context—
Smallest0.1 GB
PA
parakeet tdt ctc 110m
Parakeet · cstr
Params115M
Context—
Smallest0.1 GB
AF
AfriqueLlama 8B
Afriquellama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
JA
jaskier 7b dpo v5.6
Jaskier · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
AF
AfriqueGemma 12B
Afriquegemma · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
PA
omi med stt v1
Parakeet · omi-health
Params624M
Context—
Smallest0.9 GB
UN
Unity Coder 7b
Unity · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
VF
VFIG 4B
Vfig · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
PR
ProgressGym-HistLlama3-70B-C013-instruct-v0.1
Progressgym · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
A3
A3ON 1B
mradermacher
Params1.14B
Context8K
Q4_K_M0.8 GB
BI
Bionic Cetacean 20B
Bionic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
TI
TildeOpen 30b
Tildeopen · bartowski
Params30.7B
Context64K
Q4_K_M18.5 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · gabriellarson
Params1.54B
Context128K
Q4_K_M1.0 GB
DA
danskgpt v4 12b i1
Danskgpt · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
MI
OGSQL Mistral7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
sanjiwatsuki_openchat-3.5-1210-starling-slerp
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
canary qwen 2.5b
Qwen · cstr
Params2.84B
Context—
Smallest0.0 GB