Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
PU
PulseMind 72B
Pulsemind · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
LI
Ling 3.0 flash REAP288 73B A5B
Ling · bloomer010
Params73.3B
Context256K
Q4_K_M44.3 GB
QW
Qwen3 42B A3B 2507 YOYO2 TOTAL RECALL Instruct
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
CO
c4ai command r v01
Command R · backyardai
Params35B
Context128K
Q4_K_M21.5 GB
QW
Qwen3 Yoyo V3 42B A3B Thinking TOTAL RECALL ST TNG
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
IR
Iridium 72B v0.1
Iridium · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
ST
Step 3.5 Flash REAP 128B A11B
Step · mradermacher
Params121B
Context256K
Q4_K_M72.8 GB
QW
Qwen3.5 35B A3B Heretic Opus 4.6 Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GP
Gpt-Oss-Safeguard-120B
gpt-oss · unsloth
Params117B
Context128K
Q4_K_M62.8 GB
QW
Qwen3.5 35B A3B Unredacted MAX
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
BL
Blossom V6.3 36B Tainted Heresy
Blossom · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
QW
Qwen3.6 35B A3B
Qwen · AesSedai
Params35.5B
Context256K
Q4_K_M23.0 GB
FA
Falcon
Falcon · mradermacher
Params179B
Context2K
Smallest38.0 GB
ZE
zephyr orpo 141b A35b v0.1 i1
Zephyr · mradermacher
Params141B
Context64K
Smallest29.6 GB
KI
moonshotai.Kimi K2 Instruct 0905
Kimi · DevQuasar
Params1030B
Context256K
Q4_K_M620.6 GB
LL
Meta Llama 3 70B Instruct function calling i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
XO
XORTRON.CriminalComputing.LARGE.2026.3
Xortron · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
LL
Meta-Llama-3-120B-Instruct
Llama · mradermacher
Params122B
Context8K
Smallest26.0 GB
ST
Step 3.5 Flash GGUF Q4 K S
Step · stepfun-ai
Params197B
Context256K
Smallest111.5 GB
CA
Cathallama 70B
Cathallama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GR
GRM 3.2 Sky ONYX
Grm · el4
Params34.7B
Context2K
Smallest2.3 GB
PR
ProgressGym-HistLlama3-70B-C013-instruct-v0.1
Progressgym · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
MiMo V2.6 Pro Uncensored Maya
Mimo · nofacedfl
Params1020B
Context1024K
Smallest300.3 GB
LI
Ling 1T
Ling · honda6666
Params1000B
Context32K
Smallest231.3 GB
LO
Loki V2.0 Heretic Uncensored
Loki · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
MiniMax M2.1 REAP 40
Minimax · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
QW
Qwen3 235B A22B Thinking 2507 i1
Qwen · mradermacher
Params235B
Context256K
Smallest0.5 GB
QW
Qwen3.6 35B A3B Fable 5 Distill
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
AS
L3.2 Ascendant Prime 16E A6B
Ascendant · mradermacher
Params34.9B
Context128K
Q4_K_M21.2 GB
PL
PLLuM 8x7B Chat 2412
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB