Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
HO
K2-Horizon-32B
Horizon · bartowski
Params34.8B
Context512K
Q4_K_M22.0 GB
GGUF
QW
Qwen3.8 Flash Next Uncensored UD Q4 K XL
Qwen · NeosQ
Params177B
Context256K
Smallest4.1 GB
ReasoningTool useVision
AP
Apex 35B V1.0
Apex · bartowski
Params35.5B
Context256K
Q4_K_M22.8 GB
ReasoningTool useVision
QW
Swift 1.5 Qwen3.8 Flash Next REAP Pruned
Qwen · 90-008
Params109B
Context256K
Smallest55.3 GB
GGUF
QW
Qwen3.8 Flash Next Heretic2 IQ4XS NGQ4
Qwen · cygnal
Params177B
Context256K
Smallest98.4 GB
Vision
HU
Ornith 1.5 35B A3B Abliterated CyberTiel Calibrated MTPv2 ICE
Huihui · gbuzhf
Params35.5B
Context256K
Smallest18.8 GB
GGUF
GL
GLM 5.3 Flash Uncensored
GLM · axi0mX
Params321B
Context1024K
Smallest93.3 GB
Vision
ST
Step 3.7 Flash
Step · stepfun-ai
Params197B
Context—
Smallest0.5 GB
GGUF
NE
Nex N2 Mini
Nex · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
OC
Occamy 1.0 APEX I MiniPlus V2.1
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
MI
MiMo-V2.6-Pro-RL
Mimo · ggml-org
Params1020B
Context1024K
Smallest2.1 GB
Vision
MI
MiMo V2.6 Flash MOPD
Mimo · QuantaPlanta
Params310B
Context1024K
Smallest174.9 GB
Vision
JE
JEV 35B
Jev · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
Qwen3.8 Flash Next
Qwen · AesSedai
Params180B
Context256K
Q4_K_M116.1 GB
Vision
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
OR
RegesCore 1.0 35
Ornith · iBossonline
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningVision
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
Reasoning
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
QW
Kataguru Sceptic 35B A3B v2.6
Qwen · kataguru
Params35.2B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen3.6 Qworus 35B A3B V1 APEX
Qwen · DarkKitsune
Params35.5B
Context256K
Smallest18.5 GB
CodingReasoningTool use
SP
Spectre 37B v1a GGUF Dirty
Spectre · BeaverAI
Params36.6B
Context256K
Q4_K_M22.2 GB
GGUF
YI
Yi 1.5 34B Chat
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Qwen2.5 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
ZA
Zawen v0.1 35B A3B
Zawen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Roleplay
MI
MiniMax M2.7
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.8 GB
GGUF
QW
Atomic Chat / Qwen3.6 35B A3B
Qwen · AtomicChat
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · shefowl
Params177B
Context256K
Smallest67.2 GB
Vision
QW
Carnice Qwen3.6 MoE 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Tool use
OR
Ornith 1.5 35B A3B MTP
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoning
LL
Llama2 70B OASST SFT v10
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Other sizes

Keep browsing