Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PU
PulseMind 72B
Pulsemind · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
ReasoningVision
LI
Ling 3.0 flash REAP288 73B A5B
Ling · bloomer010
Params73.3B
Context256K
Q4_K_M44.3 GB
ReasoningTool use
QW
Qwen3 42B A3B 2507 YOYO2 TOTAL RECALL Instruct
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
CodingReasoningTool use
CO
c4ai command r v01
Command R · backyardai
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
QW
Qwen3 Yoyo V3 42B A3B Thinking TOTAL RECALL ST TNG
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
CodingReasoningTool use
IR
Iridium 72B v0.1
Iridium · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
ST
Step 3.5 Flash REAP 128B A11B
Step · mradermacher
Params121B
Context256K
Q4_K_M72.8 GB
CodingReasoningTool use
QW
Qwen3.5 35B A3B Heretic Opus 4.6 Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
GP
Gpt-Oss-Safeguard-120B
gpt-oss · unsloth
Params117B
Context128K
Q4_K_M62.8 GB
Tool use
QW
Qwen3.5 35B A3B Unredacted MAX
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
BL
Blossom V6.3 36B Tainted Heresy
Blossom · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
QW
Qwen3.6 35B A3B
Qwen · AesSedai
Params35.5B
Context256K
Q4_K_M23.0 GB
ReasoningTool useVision
FA
Falcon
Falcon · mradermacher
Params179B
Context2K
Smallest38.0 GB
GGUF
ZE
zephyr orpo 141b A35b v0.1 i1
Zephyr · mradermacher
Params141B
Context64K
Smallest29.6 GB
GGUF
KI
moonshotai.Kimi K2 Instruct 0905
Kimi · DevQuasar
Params1030B
Context256K
Q4_K_M620.6 GB
Tool use
LL
Meta Llama 3 70B Instruct function calling i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
XO
XORTRON.CriminalComputing.LARGE.2026.3
Xortron · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
LL
Meta-Llama-3-120B-Instruct
Llama · mradermacher
Params122B
Context8K
Smallest26.0 GB
GGUF
ST
Step 3.5 Flash GGUF Q4 K S
Step · stepfun-ai
Params197B
Context256K
Smallest111.5 GB
CodingReasoningTool use
CA
Cathallama 70B
Cathallama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GR
GRM 3.2 Sky ONYX
Grm · el4
Params34.7B
Context2K
Smallest2.3 GB
ReasoningTool use
PR
ProgressGym-HistLlama3-70B-C013-instruct-v0.1
Progressgym · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
MiMo V2.6 Pro Uncensored Maya
Mimo · nofacedfl
Params1020B
Context1024K
Smallest300.3 GB
ReasoningTool useVision
LI
Ling 1T
Ling · honda6666
Params1000B
Context32K
Smallest231.3 GB
ReasoningTool use
LO
Loki V2.0 Heretic Uncensored
Loki · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
MI
MiniMax M2.1 REAP 40
Minimax · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
ReasoningTool use
QW
Qwen3 235B A22B Thinking 2507 i1
Qwen · mradermacher
Params235B
Context256K
Smallest0.5 GB
GGUF
QW
Qwen3.6 35B A3B Fable 5 Distill
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use
AS
L3.2 Ascendant Prime 16E A6B
Ascendant · mradermacher
Params34.9B
Context128K
Q4_K_M21.2 GB
Tool use
PL
PLLuM 8x7B Chat 2412
Pllum · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF

Other sizes

Keep browsing