Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
Ornith 1.5 122B
Ornith · ornith-ai
Params125B
Context256K
Q4_K_M75.8 GB
Vision
QW
Qwen3.8 Flash Next Gyro abliterated Huihui
Qwen · agentionai
Params177B
Context256K
Smallest2.7 GB
ReasoningTool useVision
QW
RVN Qwen3.8 Flash Next Abliterated Uncensored IQ3 S Strata
Qwen · jimmy31chen
Params177B
Context256K
Smallest88.9 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · SC117
Params177B
Context256K
Smallest0.9 GB
GGUF
BI
BigBang v1
Bigbang · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
QW
Qwen3.8 Flash Next NVFP4 GPTQ Strata
Qwen · Maximilian228
Params51.2B
Context—
Smallest1.3 GB
GGUF
GL
GLM 5.3
GLM · unsloth
Params754B
Context1024K
Smallest216.7 GB
GGUF
IN
TML Inkling
Inkling · unsloth
Params950B
Context1024K
Smallest270.2 GB
ReasoningVision
QW
Huihui Qwen3.8 Flash Next abliterated
Qwen · huihui-ai
Params177B
Context256K
Smallest68.2 GB
ReasoningVision
TH
Thomson 1.0 Small
Thomson · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
OR
Ornith 1.5 35B A3B APEX
Ornith · mudler
Params34.7B
Context256K
Smallest13.5 GB
Vision
OR
Tiel Coder 35B A3B
Ornith · peculiar-ragdoll
Params34.7B
Context256K
Smallest0.2 GB
GGUF
KI
Kimi-K3
Kimi · unsloth
Params2780B
Context1024K
Smallest466.4 GB
Vision
DA
POCKET-Darwin-180B
Darwin · FINAL-Bench
Params177B
Context256K
Smallest111.3 GB
GGUF
QW
Qwopus3.6 35B A3B Coder
Qwopus · Jackrong
Params35B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · huihui-ai
Params50B
Context—
Smallest3.8 GB
GGUF
KA
KAT Coder V2.5 Dev
Kat · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Coding
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · huihui-ai
Params177B
Context—
Smallest1.2 GB
ReasoningVision
MI
MiniCPM V 4.7 35B A3B
MiniCPM · openbmb
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen-Agentworld-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
GGUF
SA
Sage A1.5 Q4 K M
Sage · InternScience
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingTool useVision
LI
Ling 3.0 Flash
Ling · AtomicChat
Params124B
Context128K
Q4_K_M75.3 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017
DeepSeek · unsloth
Params748B
Context1024K
Smallest8.0 GB
GGUF
FL
Flint Preview
Flint · unsloth
Params39.8B
Context256K
Smallest11.4 GB
GGUF
PR
Hy4 preview
Preview · AngelSlim
Params770B
Context1024K
Q4_K_M467.3 GB
GGUF
HY
Hy3
AngelSlim
Params295B
Context256K
Q4_K_M182.3 GB
GGUF
QW
Qwen3.6 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB
Vision
LA
Laguna S 2.1 APEX
Laguna · Myric
Params118B
Context1024K
Smallest0.7 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS
DeepSeek · Abiray
Params197B
Context—
Smallest110.6 GB
GGUF
SA
Sage A1.5 Q8 0
Sage · InternScience
Params35.5B
Context256K
Smallest37.8 GB
CodingTool useVision

Other sizes

Keep browsing