Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash Next Uncensored i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B NVFP4 MTP
Qwen · michaelw9999
Params35.5B
Context256K
Smallest20.4 GB
GGUF
OR
Ornith 1.5 122B
Ornith · unsloth
Params125B
Context256K
Smallest40.4 GB
Vision
QW
Swift 1.5 Qwen3.8 Flash Next
Qwen · ukisai
Params177B
Context256K
Q4_K_M119.6 GB
ReasoningVision
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B 24GB
Nemotron · nvidia
Params74B
Context256K
Smallest22.0 GB
Vision
QW
Holo 3.1 35B A3B
Qwen · Hcompany
Params34.7B
Context256K
Q4_K_M21.3 GB
Vision
QW
Qwen_Qwen3.6 35B A3B
Qwen · lmstudio-community
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3-Coder-Next
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
Coding
KI
Kimi-K2.7-Code
Kimi · unsloth
Params1030B
Context256K
Smallest303.9 GB
CodingVision
DE
DeepSeek V4 Flash 0731
DeepSeek · unsloth
Params284B
Context—
Smallest10.9 GB
GGUF
GL
GLM 5.2
GLM · unsloth
Params754B
Context1024K
Q4_K_M465.8 GB
GGUF
QW
Qwen3.5-122B-A10B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params122B
Context256K
Q4_K_M74.2 GB
Vision
DE
DeepSeek V4.1 Flash 1017 Maya
DeepSeek · peasantsmith
Params748B
Context—
Smallest276.6 GB
GGUF
QW
Huihui Qwen3.8 Flash Next abliterated i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
GGUF
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
MI
MiniCPM V 4.7 35B A3B Uncensored
MiniCPM · AtomicChat
Params34.7B
Context256K
Smallest0.1 GB
GGUF
QW
Qwen3.8 Flash Next REAP 288 Bf16
Qwen · sh0wie
Params124B
Context256K
Q4_K_M83.8 GB
GGUF
QW
Qwen3.8 Flash Next IQ2_XXS imatrix trunk, padded Q2_K down, MTP
Qwen · antirez
Params188B
Context256K
Smallest147.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 ds4
DeepSeek · nazeshinjite
Params755B
Context—
Smallest1.0 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M119.6 GB
Vision
QW
Qwen3.8 35B A3B Distill
Qwen · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
ReasoningTool useVision
FL
Recursive Flint
Flint · lmstudio-community
Params39.8B
Context256K
Q4_K_M24.2 GB
GGUF
QW
Qwen3.8 Flash Next Abliterated Uncensored Turbo Brilliance 50x Reasoning Instruct GSQ RCO
Qwen · DavidAU
Params177B
Context256K
Smallest83.9 GB
CodingReasoningVision
DE
DeepSeek-V4-Pro-0813
DeepSeek · unsloth
Params1570B
Context1024K
Smallest849.7 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
BT
BTL 4 Compact
Btl · badtheorylabs
Params34.7B
Context256K
Smallest10.0 GB
Tool use
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · llmfan46
Params35.5B
Context256K
Q4_K_M21.8 GB
Vision
QW
Huihui Qwen3.8 Flash Next Abliterated
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
Vision
QW
Qwen3.8 Flash Next Uncensored Gufo Q4Mix
Qwen · vmlinux
Params177B
Context256K
Smallest109.8 GB
Vision
GP
Gpt-Oss-120B
gpt-oss · unsloth
Params117B
Context128K
Q4_K_M62.8 GB
GGUF

Other sizes

Keep browsing