Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · lmstudio-community
Params236B
Context160K
Q4_K_M142.5 GB
LL
Llama 3.1 70B EZO 1.1 It
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama-3-70b-Arimas-story-RP-V1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Cogito v2 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
HO
Holo 3.1 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
K2 Horizon 32B Heretic
Horizon · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
NE
L3.3 MS Nevoria 70b Heretic
Nevoria · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
FR
friend 8x7B hf
Friend · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
QW
Qwen3 Coder Next Base
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL ST TNG IV
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
ST
Step 3.7 Flash
Step · bartowski
Params199B
Context256K
Q4_K_M121.6 GB
K2
K2 IMat
legraphista
Params65.3B
Context2K
Smallest14.2 GB
GL
GLM 4.5 Air
GLM · auRose94
Params78.8B
Context128K
Smallest78.9 GB
WI
WinterGoddess 1.4x 70b 32k i1
Wintergoddess · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
QW
Qwen3.6 35B A3B
Qwen · prithivMLmods
Params35.5B
Context256K
Q4_K_M21.7 GB
LL
Llama-3-Giraffe-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
JA
Jallabi 34B
Jallabi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
Llama 3 Tulu 2 70b
Llama · RichardErkhov
Params70.6B
Context2K
Q4_K_M42.5 GB
CR
CrucibleLab L3.3 70B Loki V2.0 Heretic Uncensored
Cruciblelab · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GL
GLM-5.3-Flash
GLM · taurusduan
Params313B
Context1024K
Smallest117.5 GB
GL
Zai org.GLM 5
GLM · DevQuasar
Params754B
Context198K
Q4_K_M454.9 GB
QW
Qwen3 Coder 53B A3B Instruct TOTAL RECALL v2 MASTER CODER L
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Hermes-2-Theta-Llama-3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
DA
Darwin 35B A3B Opus
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen.Qwen3.8 Flash Next
Qwen · DevQuasar
Params177B
Context256K
Smallest80.4 GB
HE
HERO 35B A3B
Hero · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GL
GLM 5.3 Flash
GLM · muterornament
Params321B
Context1024K
Smallest93.1 GB
QW
mango qwen35 122b q4
Qwen · isilicon
Params122B
Context256K
Smallest74.2 GB