Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
AT
Athene 70B
Athene · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
AR
Arcee Nova
Arcee · arcee-ai
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.5 35B A3B Jackripper v1.0 Uncensored BF16
Qwen · kataguru
Params35.5B
Context256K
Smallest13.0 GB
QW
cyberneurova Qwen3.8 Flash Next
Qwen · Merlinoz11
Params177B
Context256K
Q4_K_M119.9 GB
PR
ProgressGym-HistLlama3-70B-C013-instruct-v0.1
Progressgym · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama-3-70b-Uncensored-Lumi-Tess-gradient
Llama · mradermacher
Params70.6B
Context256K
Q4_K_M42.5 GB
QW
Qwen3.5 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 72B Embiggened
Qwen · bartowski
Params72.7B
Context40K
Q4_K_M47.4 GB
QW
Qwen3 Yoyo V3 42B A3B Thinking Total Recall
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
QW
Carnice Qwen3.6 MoE 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
AL
AliceAI Foundation 80B A3B Base
Aliceai · robolamp
Params79.6B
Context256K
Q4_K_M49.5 GB
QW
Qwen3.8 Flash Next Abliterated GSQ-RCO IQ3_XXS Calibrated Mixed Hybrid
Qwen · arytekSI
Params177B
Context256K
Smallest83.1 GB
GL
zai org GLM 4.5
GLM · bartowski
Params358B
Context128K
Q4_K_M218.5 GB
SU
sustech_sus-chat-34b
Sus · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
DO
DonutHole-8x7B
Donuthole · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
Hermes 2 Theta Llama 3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
qwen3 coder next 80b redteam
Qwen · rafw007
Params79.7B
Context256K
Q4_K_M48.6 GB
QW
Qwen3.5 40B RoughHouse Claude 4.6 Opus Polar Deckard Uncensored Heretic Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
GL
zai org GLM 5.1
GLM · bartowski
Params754B
Context198K
Q4_K_M459.7 GB
QW
calme-2.2-qwen2-72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
ME
MegaDolphin 120b i1
Megadolphin · mradermacher
Params120B
Context4K
Smallest25.6 GB
LL
llama 65b instruct
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
DE
triadparty_deepmoney-34b-200k-base
Deepmoney · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
NE
Nemotron 3.5 Super 120B A12B NVFP4 Strata Blackwell
Nemotron · Cudecnik
Params124B
Context1024K
Smallest71.6 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
GL
cerebras/GLM-4.5-Air-REAP-82B-A12B
GLM · bartowski
Params85B
Context128K
Q4_K_M56.6 GB
LL
Llama 3.1 70B Japanese Instruct 2407
Llama · mmnga
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Huihui Qwen3 Coder Next Opus 4.6 Reasoning Distilled Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
LL
Upstage Llama 2 70B instruct v2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen35B Agent R2 Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB