Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
72B Qwen2.5 Kunou v1
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
CO
Yi Coder 9B Chat
Coder · mradermacher
Params54.3B
Context128K
Q4_K_M33.0 GB
LL
Llama PLLuM 70B Chat 2508
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
Deepseek ai.DeepSeek V3.1 F16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
CA
calme-3.1-instruct-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
KO
Kolibri-1
Kolibri · aparusel
Params78.1B
Context256K
Smallest24.5 GB
LL
Llama 3.3 70B Instruct DASHQ Q2
Llama · jkim96
Params70.6B
Context128K
Smallest19.4 GB
IN
Internvl3-78B
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.6 35B A3B Heretic v2
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
AU
AuroraRP 8x7B
Aurorarp · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · bullerwins
Params236B
Context160K
Smallest133.9 GB
QW
Qwen3.8 Flash Next REAP 288 44GB 262k
Qwen · jdominick05
Params124B
Context256K
Smallest63.3 GB
SE
Seed OSS 36B Instruct Biprojected Norm Preserving Abliterated
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
MA
Magnum v4 72b
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
QW
Occamy 1.0
Qwen · AMAImedia
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.8 Flash Next Heretic
Qwen · groxaxo
Params170B
Context256K
Smallest56.1 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes V12 Dequantized
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GE
L3.3 GeneticLemonade Final 70B i1
Geneticlemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MU
multimaster-7b-v5
Multimaster · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
LL
Cogito v2 Preview Llama 109B MoE
Llama · bartowski
Params108B
Context256K
Q4_K_M67.7 GB
LL
Llama xLAM 2 70b Fc R
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.3 70B Instruct Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
MiniMax M2 THRIFT
Minimax · bartowski
Params173B
Context192K
Q4_K_M104.6 GB
XY
XYZ Aquila Mini
Xyz · IsValorum
Params34.7B
Context256K
Smallest14.6 GB
MA
L3.3 70B Magnum v4 SE
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RH
Rhea 72b v0.5 i1
Rhea · mradermacher
Params72.3B
Context32K
Q4_K_M47.7 GB
CO
CohereLabs.command A Translate 08 2025
Command · DevQuasar
Params111B
Context8K
Q4_K_M67.1 GB
WO
Fx Work
Work · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
NE
70B_neolithic_rabbit
Neolithic · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB