Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 Coder Next REAP
Qwen · mradermacher
Params60.3B
Context256K
Q4_K_M36.7 GB
CodingTool use
OR
Ornith 1.5 35B A3B MXFP4 MOE Hybrid Imatrix
Ornith · jashepp
Params34.7B
Context—
Smallest0.2 GB
Tool use
ST
Step 3.5 Flash
Step · mradermacher
Params197B
Context256K
Q4_K_M118.6 GB
ReasoningTool use
QW
Qwen3 55B A3B TOTAL RECALL V1.3
Qwen · mradermacher
Params51.1B
Context40K
Q4_K_M31.0 GB
ReasoningRoleplay
LL
Meta Llama 3.1 70B Instruct
Llama · bullerwins
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
HU
HuatuoGPT O1 72B v0.1
Huatuogpt · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Reasoning
MI
MiquSuperdark-70B-v2
Miqusuperdark · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.8-Flash-Next
Qwen · vultr
Params177B
Context256K
Q4_K_M131.0 GB
ReasoningTool useVision
GL
GLM 5.3 Flash
GLM · 0xSojalSec
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
QW
Qwen3.5-122B-A10B
Qwen · Mungert
Params122B
Context256K
Q4_K_M75.4 GB
ReasoningTool useVision
QW
Qwen3 42B A3B 2507 Thinking TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoningTool use
GP
gpt-oss-120b-VISION-v2
gpt-oss · SoAIHQ
Params117B
Context128K
Smallest65.4 GB
ReasoningTool useVision
LL
Llama 3.1 Tulu 3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
AN
Anubis 70B v1.2
Anubis · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
vagosolutions_sauerkrautlm-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
QW
Qwen3.5 35B A3B Heretic v2
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
LL
Dracarys Llama 3.1 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
VI
vigogne 2 70B chat
Vigogne · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GL
Huihui GLM 4.7 Flash Abliterated 60B_DEPTHONLY
GLM · mradermacher
Params59.2B
Context198K
Q4_K_M35.8 GB
GGUF
QW
Gemini 3 Pro Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
XY
XYZ Aquila Pro
Xyz · bartowski
Params396B
Context256K
Q4_K_M241.8 GB
Vision
GL
GLM 5.3 Flash
GLM · 0xSojalSec
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
HU
Huihui CyberStrike OffSec 35B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
MU
Muse Spark Open
Muse · AtomicChat
Params820B
Context1024K
Smallest174.9 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B Opus Reasoning
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
GO
Golddiamondgold Paperbliteration L33 70b
Golddiamondgold · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
GP
Gpt Oss 120b Heretic v1
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
Tool use
YI
Yi-1.5-34B-32K
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
ER
ERNIE 4.5 HUGE 51B A3B Thinking Brainstorm40x
Ernie · mradermacher
Params50.7B
Context128K
Q4_K_M30.7 GB
CodingReasoningTool use

Other sizes

Keep browsing