Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
MI
MiMo V2.6 Flash RL NVFP4
Mimo · ProCreations
Params310B
Context1024K
Smallest4.2 GB
OR
Ornith 1.5 35B A3B
Ornith · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
MI
MiniCPM V 4.7 35B A3B Abliterated
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
DO
Dots3 Note Prev
Dots · bartowski
Params280B
Context512K
Q4_K_M171.1 GB
FA
FastH3 V2 GGUFs
Fastvideo · realrebelai
Params35B
Context—
Q4_K_M14.6 GB
KA
KAT Coder V2.5 Dev
Kat · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
YI
brucethemoose_yi-34b-200k-dare-megamerge-v8
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwopus3.6 35B A3B v1
Qwen · Jackrong
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 122B A10B Abliterated
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
MI
MiMo-V2.6-Flash-MOPD
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
FL
Flint
Flint · AtomicChat
Params39.8B
Context256K
Smallest13.3 GB
QW
Swift Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M125.6 GB
AN
Anubis 70B v1.2
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
QW
Agnes 3.0 Qwen
Qwen · bartowski
Params180B
Context1024K
Q4_K_M127.1 GB
KA
KAT Coder V2.5 Dev 35B A3B ABLITERATED UNCENSORED PHILADELPHIA CLASS
Kat · PhillyLabs
Params34.7B
Context256K
Q4_K_M21.2 GB
HE
NousResearch_Hermes 4 70B
Hermes · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
LI
Ling 3.0 Flash
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
GL
GLM 4.5 Air Derestricted
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
QW
JiRackDeltaNet 180b
Qwen · CMSManhattan
Params177B
Context256K
Q4_K_M119.2 GB
QW
Qwen3.8-Flash-Next
Qwen · ji-farthing
Params177B
Context256K
Smallest2.4 GB
QW
Qwen3 235B A22B
Qwen · Qwen
Params235B
Context40K
Q4_K_M142.2 GB
GP
Gpt Oss 120b Abliterated
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
QW
Qwen3.5 122B A10B Abliterated v1
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
Qwen3-235B-A22B-Thinking-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
HU
Ornith 1.5 35B A3B Abliterated
Huihui · ArtomYuan
Params35.5B
Context256K
Smallest19.0 GB
QW
Qwen3.6 35B A3B MTP APEX I MiniPlus V2.1
Qwen · IsValorum
Params35.5B
Context256K
Smallest1.2 GB
NE
Nvidia-Nemotron-3-Ultra-550B-A55B
Nemotron · unsloth
Params550B
Context1024K
Q4_K_M359.2 GB
QW
dolphin-2.9.2-qwen2-72b
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB