Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
NE
Nex N2.5 mini
Nex · abenzerps
Params34.7B
Context256K
Q4_K_M21.2 GB
DE
DeepSeek V4.1 Flash 1017 dsx 2bit
DeepSeek · lxe
Params552B
Context—
Smallest148.1 GB
DE
Deepseek-V4-Flash-Vision-Exp
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.4 GB
QW
Qwen3.6 35B A3B heretic moe balanced v2
Qwen · DmitryDB
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.6 35B A3B
Qwen · byteshape
Params34.7B
Context256K
Smallest9.4 GB
QW
Models Qwen Qwen2 Math 72B Instruct
Qwen · MaziyarPanahi
Params72.7B
Context4K
Q4_K_M47.4 GB
CY
Cyber Tiel Coder 35B A3B APEX I NanoPlus
Cyber · IsValorum
Params34.7B
Context256K
Smallest1.5 GB
GL
GLM-5.3-Flash
GLM · ggml-org
Params313B
Context1024K
Smallest4.9 GB
DE
DeepSeek V4.1 Flash 1017 dsx 2.6bit
DeepSeek · icecubetr
Params552B
Context—
Smallest187.6 GB
QW
Qwen 35B A3B SignOfFour Coder
Qwen · pragmaticcs
Params34.7B
Context256K
Q4_K_M21.5 GB
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · cs2764
Params34.7B
Context256K
Smallest28.5 GB
JA
Jais-3-32B
Jais · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
DE
Deepseek-V3.2
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · KilltheSniper
Params177B
Context—
Smallest0.9 GB
MI
Devstral-2-123B-Instruct-2512
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
HE
HERO 35B A3B
Hero · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Scion 35B A3B
Qwen · SkyIsNotGreen
Params34.9B
Context256K
Smallest0.1 GB
SE
Seed-Oss-36B-Instruct
Seed · unsloth
Params36.2B
Context512K
Q4_K_M21.8 GB
TE
TerminalHorizon 35B A3B
Terminalhorizon · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
qwen2.5-72b-instruct
Qwen · Qwen
Params73B
Context32K
Q4_K_M44.0 GB
OR
Tiel Coder 35B A3B APEX I MiniPlus V2.1
Ornith · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
QW
Qwen3.5 35B A3B Uncensored FernflowerAI APEX
Qwen · mudler
Params34.7B
Context256K
Smallest11.6 GB
HU
Huihui Ornith 1.5 35B A3B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
SA
Sage A1.5 Heretic Abliterated Uncensored
Sage · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
Mistral Small 4 119B ROCmFP4
Mistral · kingjones777
Params119B
Context1024K
Smallest67.7 GB
QW
Qwen3 235B A22B Instruct 2507
Qwen · bartowski
Params235B
Context256K
Q4_K_M142.6 GB
HO
Holo4 35B A3B
Holo · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
LI
Ling 3.0 Flash VL
Ling · mradermacher
Params124B
Context128K
Q4_K_M75.3 GB
MI
OpenYourMind_Minimax M3 Abliterated Clean
Minimax · Sica-Quants-2
Params426B
Context1024K
Smallest155.0 GB
QW
Qwen3.6 35B A3B Abliterated Heretic BF16
Qwen · Youssofal
Params34.7B
Context256K
Q4_K_M21.2 GB