Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiMo V2.6 Flash RL NVFP4
Mimo · ProCreations
Params310B
Context1024K
Smallest4.2 GB
Coding
OR
Ornith 1.5 35B A3B
Ornith · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
ReasoningTool useVision
MI
MiniCPM V 4.7 35B A3B Abliterated
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
Reasoning
DO
Dots3 Note Prev
Dots · bartowski
Params280B
Context512K
Q4_K_M171.1 GB
Vision
FA
FastH3 V2 GGUFs
Fastvideo · realrebelai
Params35B
Context—
Q4_K_M14.6 GB
GGUF
KA
KAT Coder V2.5 Dev
Kat · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingVision
YI
brucethemoose_yi-34b-200k-dare-megamerge-v8
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwopus3.6 35B A3B v1
Qwen · Jackrong
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3.5 122B A10B Abliterated
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
Vision
MI
MiMo-V2.6-Flash-MOPD
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
Vision
FL
Flint
Flint · AtomicChat
Params39.8B
Context256K
Smallest13.3 GB
CodingReasoningTool use
QW
Swift Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M125.6 GB
ReasoningVision
AN
Anubis 70B v1.2
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
QW
Agnes 3.0 Qwen
Qwen · bartowski
Params180B
Context1024K
Q4_K_M127.1 GB
ReasoningTool useVision
KA
KAT Coder V2.5 Dev 35B A3B ABLITERATED UNCENSORED PHILADELPHIA CLASS
Kat · PhillyLabs
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingTool useVision
HE
NousResearch_Hermes 4 70B
Hermes · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LI
Ling 3.0 Flash
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
GGUF
GL
GLM 4.5 Air Derestricted
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
GGUF
QW
JiRackDeltaNet 180b
Qwen · CMSManhattan
Params177B
Context256K
Q4_K_M119.2 GB
ReasoningTool use
QW
Qwen3.8-Flash-Next
Qwen · ji-farthing
Params177B
Context256K
Smallest2.4 GB
GGUF
QW
Qwen3 235B A22B
Qwen · Qwen
Params235B
Context40K
Q4_K_M142.2 GB
GGUF
GP
Gpt Oss 120b Abliterated
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
GGUF
QW
Qwen3.5 122B A10B Abliterated v1
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
QW
Qwen3-235B-A22B-Thinking-2507
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
Reasoning
HU
Ornith 1.5 35B A3B Abliterated
Huihui · ArtomYuan
Params35.5B
Context256K
Smallest19.0 GB
Vision
QW
Qwen3.6 35B A3B MTP APEX I MiniPlus V2.1
Qwen · IsValorum
Params35.5B
Context256K
Smallest1.2 GB
ReasoningTool useVision
NE
Nvidia-Nemotron-3-Ultra-550B-A55B
Nemotron · unsloth
Params550B
Context1024K
Q4_K_M359.2 GB
GGUF
QW
dolphin-2.9.2-qwen2-72b
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use

Other sizes

Keep browsing