Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
HU
HuatuoGPT O1 72B
Huatuogpt · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Reasoning
QW
Qwen3.8 Flash Next ROCmFP4 STRIX LEAN
Qwen · kingjones777
Params177B
Context256K
Smallest105.8 GB
ReasoningTool use
MI
Llama 3.1 Nemotron 70B Instruct HF
Mistral · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M13.3 GB
Tool use
QW
Qwen3.5 122B A10B REAP 20
Qwen · mradermacher
Params99B
Context256K
Q4_K_M60.2 GB
ReasoningTool use
HO
K2 Horizon MoVA 36B A4B DERISKED
Horizon · freakyskittle
Params37.4B
Context512K
Q4_K_M22.4 GB
GGUF
DO
DonutHole-8x7B
Donuthole · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
BI
BigWeave v26 95b
Bigweave · mradermacher
Params94.6B
Context32K
Smallest19.9 GB
GGUF
QW
Qwen3 Coder Next REAP 40B A3B
Qwen · lovedheart
Params41B
Context256K
Smallest20.0 GB
CodingTool use
OB
Obsidian 70b i1
Obsidian · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.5 35B A3B Uncensored Heretic v2 Native MTP Preserved
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
LL
larryvrh_yi-34b-200k-llamafied
Llama · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
dolphin-2.2-yi-34b-200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · second-state
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
LL
Llama 3 Groq 70B Tool Use
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
QW
Qwen3.8 Flash Next Swift 1.5 XQ Uncensored
Qwen · IndrasMirror
Params177B
Context256K
Smallest73.7 GB
CodingReasoningTool use
GL
GLM 5.3 Flash
GLM · Kilka228
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
TR
TripleTrouble V3
Tripletrouble · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
Tool use
TO
Tower Plus 72B Ultra Uncensored Heretic
Tower · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · JigSawPT
Params755B
Context—
Smallest501.8 GB
GGUF
WH
whale v3 base merged i1
Whale · mradermacher
Params37.4B
Context160K
Q4_K_M22.4 GB
Tool use
NE
Heretic 5Q3 Nexus Coder
Nexus · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingReasoningTool use
WA
Watt Tool 70B
Watt · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
NE
NekoQwen 35B A3B
Nekoqwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 512k Ctx
Qwen · mradermacher
Params42.4B
Context512K
Q4_K_M25.7 GB
CodingReasoningTool use
QW
Qwen3.8 Flash Next Mixed Quant SSD PLE
Qwen · Baekpica
Params129B
Context256K
Smallest83.3 GB
ReasoningTool useVision
QW
Qwen3.6-35B-A3B
Qwen · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
ReasoningTool useVision
MI
XiaomiMiMo.MiMo V2.6 Pro RL
Mimo · DevQuasar
Params1020B
Context1024K
Smallest373.5 GB
ReasoningTool useVision
FU
functionary medium v3.1
Functionary · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
CodingTool use
MI
cerebras/MiniMax-M2-REAP-172B-A10B
Minimax · bartowski
Params173B
Context192K
Q4_K_M104.6 GB
ReasoningTool use
DR
Dracarys2 72B Instruct
Dracarys · RichardErkhov
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use

Other sizes

Keep browsing