GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DE
Deepseek Coder 1.3b Base
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
EP
Epsilon Ocr D.Markdown Post3.0.M
Epsilon · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
HE
HelpingAI2 9B
Helpingai · mradermacher
Params8.9B
Context128K
Q4_K_M5.4 GB
FA
Falcon-H1-34B-Instruct
Falcon · unsloth
Params33.6B
Context256K
Q4_K_M20.3 GB
QW
Qwen2.5 Math 72B Instruct
Qwen · mradermacher
Params72.7B
Context4K
Q4_K_M47.4 GB
DE
DeepSeek-V2-Lite-Chat
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
MI
Mistral Small 24B Instruct 2501
Mistral · duyntnet
Params23.6B
Context32K
Q4_K_M14.3 GB
FL
FLUX.1 Fill dev
Flux · akikuli
Params11.9B
Context—
Smallest5.2 GB
DA
Dark Oddity 12B v1.0
Dark · mradermacher
Params12B
Context128K
Q4_K_M7.3 GB
NE
nvidia.Nemotron Terminal 8B
Nemotron · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
LF
LFM2-1.2B-Extract
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.8 GB
NY
Nyanade Stunna Maid 7B i1
Nyanade · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · second-state
Params7.82B
Context4K
Q4_K_M4.8 GB
ST
StableLM 2 1.6B Chat
Stablelm · mradermacher
Params1.64B
Context4K
Q4_K_M1.0 GB
QW
72B Qwen2.5 Kunou v1
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
LF
LFM2 350M PII Extract JP
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
LF
LFM2.5-1.2B-Base
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
KI
Kimi K3 IQ1S REAP568 64K 4XSPARKS
Kimi · 0xTank
Params1780B
Context1024K
Smallest398.5 GB
MA
Magicoder DS 6.7B
Magicoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
Deepseek Math 7b Base
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
MI
Mistral 2x22B MOE Power Codestral Ultimate 39B
Mistral · mradermacher
Params39.2B
Context32K
Q4_K_M23.6 GB
KU
Kunoichi-DPO-7B
Kunoichi · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
FL
FleetWorker E4B
Fleetworker · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
MI
MioTTS 0.1B
Miotts · Aratako
Params114M
Context256K
Q4_K_M0.1 GB
QW
Qwen1.5 22B Chat Merge
Qwen · mradermacher
Params22B
Context32K
Q4_K_M14.3 GB
FL
flux.1 lite 8B alpha
Flux · city96
Params8.16B
Context—
Smallest3.7 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · gaianet
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen3.8 Flash Next GSQ RCO Ko Coder
Qwen · attention-is-all-i-want
Params117B
Context256K
Smallest58.4 GB
LL
Meta Llama 3 8B Instruct fictional Chinese v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Scarlett Llama 3 8B v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB