Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
NO
Nous Puffin 70B
Nous · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
ZE
zephyr orpo 141b A35b v0.1 GGUF smashed
Zephyr · PrunaAI
Params141B
Context64K
Q4_K_M85.6 GB
QW
Huihui Qwen3 Coder Next Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
OR
Ornith 1.5 35B A3B Abliterated
Ornith · alztrk
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.8 Flash Next NVFP4 Q8 Mix Strata
Qwen · Maximilian228
Params51.2B
Context—
Smallest1.3 GB
GR
grok 2
Grok · unsloth
Params270B
Context128K
Q4_K_M164.1 GB
DE
DeepSeek V4 Flash
DeepSeek · apetersson
Params284B
Context1024K
Smallest102.8 GB
QW
Qwen3.8 Flash Next Rulith EXL3
Qwen · Rulith
Params177B
Context256K
Smallest2.6 GB
NE
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
Nemotron · AtomicChat
Params124B
Context1024K
Smallest45.7 GB
HA
L3.1 70B Hanami X1
Hanami · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 35B A3B Distill
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.8 Flash Next
Qwen · TonyMFJ
Params51.2B
Context256K
Q4_K_M2.8 GB
MI
Mistral-Large-4-1T-A52B-DSpark
Mistral · unsloth
Params1050B
Context1024K
Smallest2.2 GB
DE
DeepSeek V2.5
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · CCSSNE
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 122B A10B Heretic
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
Qwopus3.6 35B A3B Coder APEX
Qwopus · mudler
Params34.7B
Context256K
Smallest13.5 GB
YI
01 ai Yi 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen3.5 35B A3B Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
Minimax-M2.7
Minimax · unsloth
Params230B
Context192K
Q4_K_M140.2 GB
QW
Qwen3.8 Flash Next Q8 0 Strata
Qwen · Maximilian228
Params51.2B
Context—
Smallest1.3 GB
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · rSalone
Params177B
Context256K
Smallest83.8 GB
OR
Ornith 1.5 122B Uncensored
Ornith · AtomicChat
Params125B
Context256K
Smallest54.3 GB
QU
QuartetAnemoi 70B t0.0001
Quartetanemoi · backyardai
Params69B
Context32K
Q4_K_M41.4 GB
DA
Darwin 35B A3B Opus
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CL
Clover-35B-A3B-Preview
Clover · AtomicChat
Params34.7B
Context128K
Q4_K_M21.2 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · AtomicChat
Params284B
Context1024K
Smallest70.2 GB
OR
moziAI 35B A3B MOE MTP
Ornith · chenyumo
Params35.5B
Context256K
Q4_K_M15.9 GB
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · yachiyo8080
Params177B
Context256K
Smallest66.4 GB
NE
Nex N2 Pro MTP
Nex · morikomorizz
Params403B
Context—
Smallest13.2 GB