Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
Nex N2.5 mini
Nex · abenzerps
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool useVision
DE
DeepSeek V4.1 Flash 1017 dsx 2bit
DeepSeek · lxe
Params552B
Context—
Smallest148.1 GB
GGUF
DE
Deepseek-V4-Flash-Vision-Exp
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.4 GB
Vision
QW
Qwen3.6 35B A3B heretic moe balanced v2
Qwen · DmitryDB
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
QW
Qwen3.6 35B A3B
Qwen · byteshape
Params34.7B
Context256K
Smallest9.4 GB
Vision
QW
Models Qwen Qwen2 Math 72B Instruct
Qwen · MaziyarPanahi
Params72.7B
Context4K
Q4_K_M47.4 GB
GGUF
CY
Cyber Tiel Coder 35B A3B APEX I NanoPlus
Cyber · IsValorum
Params34.7B
Context256K
Smallest1.5 GB
GGUF
GL
GLM-5.3-Flash
GLM · ggml-org
Params313B
Context1024K
Smallest4.9 GB
Vision
DE
DeepSeek V4.1 Flash 1017 dsx 2.6bit
DeepSeek · icecubetr
Params552B
Context—
Smallest187.6 GB
GGUF
QW
Qwen 35B A3B SignOfFour Coder
Qwen · pragmaticcs
Params34.7B
Context256K
Q4_K_M21.5 GB
CodingReasoningTool use
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · cs2764
Params34.7B
Context256K
Smallest28.5 GB
ReasoningTool useVision
JA
Jais-3-32B
Jais · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
Reasoning
DE
Deepseek-V3.2
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · KilltheSniper
Params177B
Context—
Smallest0.9 GB
GGUF
MI
Devstral-2-123B-Instruct-2512
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
Coding
HE
HERO 35B A3B
Hero · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Scion 35B A3B
Qwen · SkyIsNotGreen
Params34.9B
Context256K
Smallest0.1 GB
GGUF
SE
Seed-Oss-36B-Instruct
Seed · unsloth
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
TE
TerminalHorizon 35B A3B
Terminalhorizon · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
qwen2.5-72b-instruct
Qwen · Qwen
Params73B
Context32K
Q4_K_M44.0 GB
GGUF
OR
Tiel Coder 35B A3B APEX I MiniPlus V2.1
Ornith · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
CodingReasoningTool use
QW
Qwen3.5 35B A3B Uncensored FernflowerAI APEX
Qwen · mudler
Params34.7B
Context256K
Smallest11.6 GB
GGUF
HU
Huihui Ornith 1.5 35B A3B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
SA
Sage A1.5 Heretic Abliterated Uncensored
Sage · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingReasoningTool use
MI
Mistral Small 4 119B ROCmFP4
Mistral · kingjones777
Params119B
Context1024K
Smallest67.7 GB
GGUF
QW
Qwen3 235B A22B Instruct 2507
Qwen · bartowski
Params235B
Context256K
Q4_K_M142.6 GB
GGUF
HO
Holo4 35B A3B
Holo · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
Vision
LI
Ling 3.0 Flash VL
Ling · mradermacher
Params124B
Context128K
Q4_K_M75.3 GB
Vision
MI
OpenYourMind_Minimax M3 Abliterated Clean
Minimax · Sica-Quants-2
Params426B
Context1024K
Smallest155.0 GB
ReasoningVision
QW
Qwen3.6 35B A3B Abliterated Heretic BF16
Qwen · Youssofal
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision

Other sizes

Keep browsing