Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM 5.3 Flash
GLM · aj9o9
Params313B
Context1024K
Smallest87.3 GB
GGUF
AI
Airoboros L2 70b 2.2
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
Minimax-M3
Minimax · unsloth
Params426B
Context1024K
Q4_K_M264.9 GB
Vision
QW
Qwen3.8 Flash Next Uncensored IQ4XS NGQ4
Qwen · cygnal
Params177B
Context256K
Smallest98.4 GB
Vision
MA
Magnum v4 72b
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
ST
Step 3.5 Flash
Step · ggml-org
Params197B
Context256K
Smallest118.7 GB
GGUF
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
GGUF
GL
GLM 5.3 Flash Uncensored
GLM · BoldingBuilds
Params321B
Context1024K
Smallest76.8 GB
Vision
GL
GLM 5
GLM · unsloth
Params754B
Context198K
Q4_K_M455.9 GB
GGUF
QW
Qwen3.5 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest13.3 GB
Vision
DE
DeepSeek V4 Flash 0731 reap 150b
DeepSeek · puwaer
Params150B
Context—
Smallest0.3 GB
GGUF
HO
Holo4 35B A3B
Holo · Hcompany
Params34.7B
Context256K
Q4_K_M21.3 GB
Vision
DE
DeepSeek-V4.1-Flash-mixed-q2
DeepSeek · apetersson
Params552B
Context1024K
Smallest168.9 GB
GGUF
RE
Blackfrost-AI/RED-SNOW-5.3-FLASH-BF16
Red · freakyskittle
Params321B
Context1024K
Q4_K_M181.5 GB
Vision
HO
K2-Horizon-MoVA-36B-A4B
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes Final NVFP4
Qwen · jan1k
Params34.7B
Context256K
Smallest21.1 GB
Tool useVision
ST
StartLux Decision 35B A3B
Startlux · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
ST
Step-5-Preview-BF16
Step · L-Alchemyst
Params601B
Context1024K
Smallest248.8 GB
ReasoningTool useVision
QW
Qwen3-Coder-480B-A35B-Instruct
Qwen · unsloth
Params480B
Context256K
Q4_K_M290.1 GB
Coding
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
NE
Nvidia-Nemotron-3-Super-120B-A12B
Nemotron · unsloth
Params121B
Context1024K
Q4_K_M82.5 GB
GGUF
QW
Qwen3.6 35B A3B 2Bit GSQ hybrid
Qwen · chtisgit
Params34.7B
Context256K
Smallest12.2 GB
Vision
CL
Diffuspace/Clover-35B-A3B-Preview
Clover · maternion
Params34.7B
Context128K
Q4_K_M21.2 GB
Coding
QW
Qwen3.5 122B A10B Uncensored Heretic
Qwen · llmfan46
Params125B
Context256K
Q4_K_M85.3 GB
Vision
QW
JoyFox-Qwen3.6-35B-A3B-RP-Aggressive
Qwen · joyfox
Params35.5B
Context256K
Q4_K_M21.7 GB
RoleplayVision
AG
Agents A1 APEX
Agents · mudler
Params34.7B
Context256K
Smallest13.5 GB
Vision
BE
Behemoth 128B v3
Behemoth · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · darioooooo0o
Params74B
Context1024K
Q4_K_M48.3 GB
Vision
GL
GLM 4.6
GLM · unsloth
Params357B
Context198K
Q4_K_M215.6 GB
GGUF
MI
Minimax-M2
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
GGUF

Other sizes

Keep browsing