Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
HU
HuatuoGPT O1 72B
Huatuogpt · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.8 Flash Next ROCmFP4 STRIX LEAN
Qwen · kingjones777
Params177B
Context256K
Smallest105.8 GB
MI
Llama 3.1 Nemotron 70B Instruct HF
Mistral · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M13.3 GB
QW
Qwen3.5 122B A10B REAP 20
Qwen · mradermacher
Params99B
Context256K
Q4_K_M60.2 GB
HO
K2 Horizon MoVA 36B A4B DERISKED
Horizon · freakyskittle
Params37.4B
Context512K
Q4_K_M22.4 GB
DO
DonutHole-8x7B
Donuthole · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
BI
BigWeave v26 95b
Bigweave · mradermacher
Params94.6B
Context32K
Smallest19.9 GB
QW
Qwen3 Coder Next REAP 40B A3B
Qwen · lovedheart
Params41B
Context256K
Smallest20.0 GB
OB
Obsidian 70b i1
Obsidian · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3.5 35B A3B Uncensored Heretic v2 Native MTP Preserved
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
LL
larryvrh_yi-34b-200k-llamafied
Llama · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
dolphin-2.2-yi-34b-200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
CO
C4Ai Command R Plus 08 2024
Command R · second-state
Params104B
Context128K
Q4_K_M62.8 GB
LL
Llama 3 Groq 70B Tool Use
Llama · second-state
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next Swift 1.5 XQ Uncensored
Qwen · IndrasMirror
Params177B
Context256K
Smallest73.7 GB
GL
GLM 5.3 Flash
GLM · Kilka228
Params321B
Context1024K
Smallest93.1 GB
TR
TripleTrouble V3
Tripletrouble · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
TO
Tower Plus 72B Ultra Uncensored Heretic
Tower · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
DE
DeepSeek V4.1 Flash
DeepSeek · JigSawPT
Params755B
Context—
Smallest501.8 GB
WH
whale v3 base merged i1
Whale · mradermacher
Params37.4B
Context160K
Q4_K_M22.4 GB
NE
Heretic 5Q3 Nexus Coder
Nexus · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
WA
Watt Tool 70B
Watt · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
NekoQwen 35B A3B
Nekoqwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 512k Ctx
Qwen · mradermacher
Params42.4B
Context512K
Q4_K_M25.7 GB
QW
Qwen3.8 Flash Next Mixed Quant SSD PLE
Qwen · Baekpica
Params129B
Context256K
Smallest83.3 GB
QW
Qwen3.6-35B-A3B
Qwen · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
MI
XiaomiMiMo.MiMo V2.6 Pro RL
Mimo · DevQuasar
Params1020B
Context1024K
Smallest373.5 GB
FU
functionary medium v3.1
Functionary · second-state
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
cerebras/MiniMax-M2-REAP-172B-A10B
Minimax · bartowski
Params173B
Context192K
Q4_K_M104.6 GB
DR
Dracarys2 72B Instruct
Dracarys · RichardErkhov
Params72.7B
Context32K
Q4_K_M47.4 GB