Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · lmstudio-community
Params236B
Context160K
Q4_K_M142.5 GB
CodingTool use
LL
Llama 3.1 70B EZO 1.1 It
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama-3-70b-Arimas-story-RP-V1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Roleplay
LL
Cogito v2 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
HO
Holo 3.1 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
HO
K2 Horizon 32B Heretic
Horizon · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
CodingReasoningTool use
NE
L3.3 MS Nevoria 70b Heretic
Nevoria · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
FR
friend 8x7B hf
Friend · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
QW
Qwen3 Coder Next Base
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
CodingTool use
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL ST TNG IV
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoningTool use
ST
Step 3.7 Flash
Step · bartowski
Params199B
Context256K
Q4_K_M121.6 GB
ReasoningTool useVision
K2
K2 IMat
legraphista
Params65.3B
Context2K
Smallest14.2 GB
GGUF
GL
GLM 4.5 Air
GLM · auRose94
Params78.8B
Context128K
Smallest78.9 GB
GGUF
WI
WinterGoddess 1.4x 70b 32k i1
Wintergoddess · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.6 35B A3B
Qwen · prithivMLmods
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
LL
Llama-3-Giraffe-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
JA
Jallabi 34B
Jallabi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
Llama 3 Tulu 2 70b
Llama · RichardErkhov
Params70.6B
Context2K
Q4_K_M42.5 GB
GGUF
CR
CrucibleLab L3.3 70B Loki V2.0 Heretic Uncensored
Cruciblelab · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
GL
GLM-5.3-Flash
GLM · taurusduan
Params313B
Context1024K
Smallest117.5 GB
Vision
GL
Zai org.GLM 5
GLM · DevQuasar
Params754B
Context198K
Q4_K_M454.9 GB
ReasoningTool use
QW
Qwen3 Coder 53B A3B Instruct TOTAL RECALL v2 MASTER CODER L
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
CodingReasoningTool use
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LL
Hermes-2-Theta-Llama-3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
DA
Darwin 35B A3B Opus
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen.Qwen3.8 Flash Next
Qwen · DevQuasar
Params177B
Context256K
Smallest80.4 GB
ReasoningTool useVision
HE
HERO 35B A3B
Hero · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
GL
GLM 5.3 Flash
GLM · muterornament
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
QW
mango qwen35 122b q4
Qwen · isilicon
Params122B
Context256K
Smallest74.2 GB
ReasoningTool use

Other sizes

Keep browsing