Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Qwen3 Coder Next REAP
Qwen · mradermacher
Params60.3B
Context256K
Q4_K_M36.7 GB
OR
Ornith 1.5 35B A3B MXFP4 MOE Hybrid Imatrix
Ornith · jashepp
Params34.7B
Context—
Smallest0.2 GB
ST
Step 3.5 Flash
Step · mradermacher
Params197B
Context256K
Q4_K_M118.6 GB
QW
Qwen3 55B A3B TOTAL RECALL V1.3
Qwen · mradermacher
Params51.1B
Context40K
Q4_K_M31.0 GB
LL
Meta Llama 3.1 70B Instruct
Llama · bullerwins
Params70.6B
Context128K
Q4_K_M42.5 GB
HU
HuatuoGPT O1 72B v0.1
Huatuogpt · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
MI
MiquSuperdark-70B-v2
Miqusuperdark · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
QW
Qwen3.8-Flash-Next
Qwen · vultr
Params177B
Context256K
Q4_K_M131.0 GB
GL
GLM 5.3 Flash
GLM · 0xSojalSec
Params321B
Context1024K
Smallest93.1 GB
QW
Qwen3.5-122B-A10B
Qwen · Mungert
Params122B
Context256K
Q4_K_M75.4 GB
QW
Qwen3 42B A3B 2507 Thinking TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
GP
gpt-oss-120b-VISION-v2
gpt-oss · SoAIHQ
Params117B
Context128K
Smallest65.4 GB
LL
Llama 3.1 Tulu 3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
AN
Anubis 70B v1.2
Anubis · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
vagosolutions_sauerkrautlm-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
QW
Qwen3.5 35B A3B Heretic v2
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Dracarys Llama 3.1 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
VI
vigogne 2 70B chat
Vigogne · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GL
Huihui GLM 4.7 Flash Abliterated 60B_DEPTHONLY
GLM · mradermacher
Params59.2B
Context198K
Q4_K_M35.8 GB
QW
Gemini 3 Pro Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
XY
XYZ Aquila Pro
Xyz · bartowski
Params396B
Context256K
Q4_K_M241.8 GB
GL
GLM 5.3 Flash
GLM · 0xSojalSec
Params321B
Context1024K
Smallest93.1 GB
HU
Huihui CyberStrike OffSec 35B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
MU
Muse Spark Open
Muse · AtomicChat
Params820B
Context1024K
Smallest174.9 GB
QW
Qwen3.6 35B A3B Opus Reasoning
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GO
Golddiamondgold Paperbliteration L33 70b
Golddiamondgold · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GP
Gpt Oss 120b Heretic v1
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
YI
Yi-1.5-34B-32K
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
ER
ERNIE 4.5 HUGE 51B A3B Thinking Brainstorm40x
Ernie · mradermacher
Params50.7B
Context128K
Q4_K_M30.7 GB