Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NO
Nous Puffin 70B
Nous · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ZE
zephyr orpo 141b A35b v0.1 GGUF smashed
Zephyr · PrunaAI
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
QW
Huihui Qwen3 Coder Next Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
OR
Ornith 1.5 35B A3B Abliterated
Ornith · alztrk
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.8 Flash Next NVFP4 Q8 Mix Strata
Qwen · Maximilian228
Params51.2B
Context—
Smallest1.3 GB
GGUF
GR
grok 2
Grok · unsloth
Params270B
Context128K
Q4_K_M164.1 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · apetersson
Params284B
Context1024K
Smallest102.8 GB
Vision
QW
Qwen3.8 Flash Next Rulith EXL3
Qwen · Rulith
Params177B
Context256K
Smallest2.6 GB
ReasoningTool useVision
NE
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
Nemotron · AtomicChat
Params124B
Context1024K
Smallest45.7 GB
ReasoningTool useVision
HA
L3.1 70B Hanami X1
Hanami · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.8 35B A3B Distill
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
QW
Qwen3.8 Flash Next
Qwen · TonyMFJ
Params51.2B
Context256K
Q4_K_M2.8 GB
Vision
MI
Mistral-Large-4-1T-A52B-DSpark
Mistral · unsloth
Params1050B
Context1024K
Smallest2.2 GB
ReasoningTool useVision
DE
DeepSeek V2.5
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
GGUF
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · CCSSNE
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.5 122B A10B Heretic
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
QW
Qwopus3.6 35B A3B Coder APEX
Qwopus · mudler
Params34.7B
Context256K
Smallest13.5 GB
CodingVision
YI
01 ai Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Qwen3.5 35B A3B Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
MI
Minimax-M2.7
Minimax · unsloth
Params230B
Context192K
Q4_K_M140.2 GB
GGUF
QW
Qwen3.8 Flash Next Q8 0 Strata
Qwen · Maximilian228
Params51.2B
Context—
Smallest1.3 GB
GGUF
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · rSalone
Params177B
Context256K
Smallest83.8 GB
GGUF
OR
Ornith 1.5 122B Uncensored
Ornith · AtomicChat
Params125B
Context256K
Smallest54.3 GB
ReasoningTool useVision
QU
QuartetAnemoi 70B t0.0001
Quartetanemoi · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
DA
Darwin 35B A3B Opus
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
CL
Clover-35B-A3B-Preview
Clover · AtomicChat
Params34.7B
Context128K
Q4_K_M21.2 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731
DeepSeek · AtomicChat
Params284B
Context1024K
Smallest70.2 GB
ReasoningTool use
OR
moziAI 35B A3B MOE MTP
Ornith · chenyumo
Params35.5B
Context256K
Q4_K_M15.9 GB
Tool useVision
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · yachiyo8080
Params177B
Context256K
Smallest66.4 GB
ReasoningTool useVision
NE
Nex N2 Pro MTP
Nex · morikomorizz
Params403B
Context—
Smallest13.2 GB
GGUF

Other sizes

Keep browsing