Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LL
Llama 3 Taiwan 70B Instruct
Llama · chienweichang
Params70.6B
Context8K
Q4_K_M42.5 GB
VI
Virtuoso Large
Virtuoso · arcee-ai
Params72.7B
Context128K
Q4_K_M47.4 GB
KO
Kolibri 1 Heretic
Kolibri · mradermacher
Params78.1B
Context256K
Q4_K_M47.5 GB
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · OwenArli
Params70.6B
Context128K
Q4_K_M42.5 GB
GO
GodziLLa2 70B
Godzilla · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
MiniMax M3
Minimax · AesSedai
Params426B
Context1024K
Q4_K_M264.3 GB
GL
GLM 4 T1 54B
GLM · mradermacher
Params54.2B
Context32K
Q4_K_M32.7 GB
QW
Qwen3.6 35B A3B Uncensored Genesis NVFP4
Qwen · jan1k
Params34.7B
Context256K
Smallest21.5 GB
PL
Platypus2 70B
Platypus · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
YI
Yislerp2 34B i1
Yislerp · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
HU
Hunyuan A13B Instruct
Hunyuan · gabriellarson
Params80.4B
Context256K
Q4_K_M48.8 GB
DE
DeepSeek V3.1 Base
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.2 GB
DE
SafeWork R1 DeepSeek 70B
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
Ornith 1.5 397B uncensored
Ornith · Lethevimlet
Params403B
Context256K
Smallest235.2 GB
PL
Plesio 70B
Plesio · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
L3.1 nemotron sunfall v0.7.0 i1
Nemotron · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
mixtral
Mistral · hfl
Params46.7B
Context32K
Smallest9.8 GB
AU
Austral 70B Winton
Austral · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
AB
A.X 4.0 Abliterated
Abliterated · mradermacher
Params71.9B
Context128K
Q4_K_M46.9 GB
CA
Camel Platypus2 70B i1
Camel · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen 72B
Qwen · mradermacher
Params72.3B
Context32K
Q4_K_M45.1 GB
CA
calme-2.3-rys-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
LL
Hermes 3 Llama 3.1 70B
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
XW
Xwen 72B Chat
Xwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
QC
QCOPM-40B-A5B
Qcopm · thehekimoghlu
Params34.7B
Context—
Q4_K_M21.2 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · AshwinX
Params748B
Context1024K
Smallest8.0 GB
XL
xLAM 8x7b R
Xlam · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
YI
YiSM blossom5.1 40B i1
Yism · mradermacher
Params40B
Context4K
Q4_K_M24.0 GB
LL
Meta-Llama-3-70B-Instruct
Llama · qwp4w3hyb
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Infinity-Instruct-3M-0613-Llama3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB