Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
72B Qwen2.5 Kunou v1
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
CO
Yi Coder 9B Chat
Coder · mradermacher
Params54.3B
Context128K
Q4_K_M33.0 GB
Coding
LL
Llama PLLuM 70B Chat 2508
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DE
Deepseek ai.DeepSeek V3.1 F16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
CA
calme-3.1-instruct-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
GGUF
KO
Kolibri-1
Kolibri · aparusel
Params78.1B
Context256K
Smallest24.5 GB
ReasoningTool use
LL
Llama 3.3 70B Instruct DASHQ Q2
Llama · jkim96
Params70.6B
Context128K
Smallest19.4 GB
Tool use
IN
Internvl3-78B
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool useVision
QW
Qwen3.6 35B A3B Heretic v2
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
AU
AuroraRP 8x7B
Aurorarp · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
Roleplay
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · bullerwins
Params236B
Context160K
Smallest133.9 GB
Coding
QW
Qwen3.8 Flash Next REAP 288 44GB 262k
Qwen · jdominick05
Params124B
Context256K
Smallest63.3 GB
ReasoningTool use
SE
Seed OSS 36B Instruct Biprojected Norm Preserving Abliterated
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
MA
Magnum v4 72b
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
QW
Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
Tool use
QW
Occamy 1.0
Qwen · AMAImedia
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3.8 Flash Next Heretic
Qwen · groxaxo
Params170B
Context256K
Smallest56.1 GB
Vision
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes V12 Dequantized
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
GE
L3.3 GeneticLemonade Final 70B i1
Geneticlemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MU
multimaster-7b-v5
Multimaster · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
GGUF
LL
Cogito v2 Preview Llama 109B MoE
Llama · bartowski
Params108B
Context256K
Q4_K_M67.7 GB
ReasoningTool use
LL
Llama xLAM 2 70b Fc R
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.3 70B Instruct Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
MI
MiniMax M2 THRIFT
Minimax · bartowski
Params173B
Context192K
Q4_K_M104.6 GB
CodingReasoningTool use
XY
XYZ Aquila Mini
Xyz · IsValorum
Params34.7B
Context256K
Smallest14.6 GB
ReasoningTool useVision
MA
L3.3 70B Magnum v4 SE
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
RH
Rhea 72b v0.5 i1
Rhea · mradermacher
Params72.3B
Context32K
Q4_K_M47.7 GB
GGUF
CO
CohereLabs.command A Translate 08 2025
Command · DevQuasar
Params111B
Context8K
Q4_K_M67.1 GB
Tool use
WO
Fx Work
Work · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Tool use
NE
70B_neolithic_rabbit
Neolithic · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Other sizes

Keep browsing