Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
GL
GLM 5.3 Flash
GLM · aj9o9
Params313B
Context1024K
Smallest87.3 GB
AI
Airoboros L2 70b 2.2
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
Minimax-M3
Minimax · unsloth
Params426B
Context1024K
Q4_K_M264.9 GB
QW
Qwen3.8 Flash Next Uncensored IQ4XS NGQ4
Qwen · cygnal
Params177B
Context256K
Smallest98.4 GB
MA
Magnum v4 72b
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
ST
Step 3.5 Flash
Step · ggml-org
Params197B
Context256K
Smallest118.7 GB
QW
Qwen3-235B-A22B-Instruct-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
GL
GLM 5.3 Flash Uncensored
GLM · BoldingBuilds
Params321B
Context1024K
Smallest76.8 GB
GL
GLM 5
GLM · unsloth
Params754B
Context198K
Q4_K_M455.9 GB
QW
Qwen3.5 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest13.3 GB
DE
DeepSeek V4 Flash 0731 reap 150b
DeepSeek · puwaer
Params150B
Context—
Smallest0.3 GB
HO
Holo4 35B A3B
Holo · Hcompany
Params34.7B
Context256K
Q4_K_M21.3 GB
DE
DeepSeek-V4.1-Flash-mixed-q2
DeepSeek · apetersson
Params552B
Context1024K
Smallest168.9 GB
RE
Blackfrost-AI/RED-SNOW-5.3-FLASH-BF16
Red · freakyskittle
Params321B
Context1024K
Q4_K_M181.5 GB
HO
K2-Horizon-MoVA-36B-A4B
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes Final NVFP4
Qwen · jan1k
Params34.7B
Context256K
Smallest21.1 GB
ST
StartLux Decision 35B A3B
Startlux · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ST
Step-5-Preview-BF16
Step · L-Alchemyst
Params601B
Context1024K
Smallest248.8 GB
QW
Qwen3-Coder-480B-A35B-Instruct
Qwen · unsloth
Params480B
Context256K
Q4_K_M290.1 GB
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Nvidia-Nemotron-3-Super-120B-A12B
Nemotron · unsloth
Params121B
Context1024K
Q4_K_M82.5 GB
QW
Qwen3.6 35B A3B 2Bit GSQ hybrid
Qwen · chtisgit
Params34.7B
Context256K
Smallest12.2 GB
CL
Diffuspace/Clover-35B-A3B-Preview
Clover · maternion
Params34.7B
Context128K
Q4_K_M21.2 GB
QW
Qwen3.5 122B A10B Uncensored Heretic
Qwen · llmfan46
Params125B
Context256K
Q4_K_M85.3 GB
QW
JoyFox-Qwen3.6-35B-A3B-RP-Aggressive
Qwen · joyfox
Params35.5B
Context256K
Q4_K_M21.7 GB
AG
Agents A1 APEX
Agents · mudler
Params34.7B
Context256K
Smallest13.5 GB
BE
Behemoth 128B v3
Behemoth · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · darioooooo0o
Params74B
Context1024K
Q4_K_M48.3 GB
GL
GLM 4.6
GLM · unsloth
Params357B
Context198K
Q4_K_M215.6 GB
MI
Minimax-M2
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB