Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes
Qwen · yuhanb
Params34.7B
Context256K
Smallest12.9 GB
LI
Liberated Miqu 70B i1
Liberated · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
LL
nvidia.Llama 3 1 Nemotron Ultra 253B v1
Llama · DevQuasar-13
Params253B
Context128K
Q4_K_M150.9 GB
VA
Valkyrie 49B v1
Valkyrie · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
QW
Qwen3.6 Fallen Fabulist 35B A3B Heretic
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
HY
Hy3
bartowski
Params300B
Context256K
Q4_K_M182.2 GB
YI
Yi 1.5 34B 32K
Yi · RichardErkhov
Params34.4B
Context32K
Q4_K_M20.7 GB
QW
Qwopus3.6 35B A3B v1 APEX MTP
Qwopus · mudler
Params35.5B
Context256K
Smallest11.7 GB
MI
cloudyu_mixtral_34bx2_moe_60b
Mistral · TheBloke
Params60.8B
Context195K
Q4_K_M34.4 GB
LL
llama-3-70B-Instruct-abliterated
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen2.5 VL 72B Instruct Heretic
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
YI
Yi-34B-Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
TE
migtissera_tess-m-v1.3
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
DE
triadparty_deepmoney-34b-200k-chat-evaluator
Deepmoney · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
YI
Yi 34B 200K DARE Merge v7
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen2.5 72B Instruct Malaysian
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS MXFP8 Engram
DeepSeek · Starw1
Params197B
Context1024K
Smallest138.6 GB
LL
ShiningValiant 1.3
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
KA
KAT Coder V2.5 Dev 16GB MixedQuant
Kat · fooooooooooooooooooooooooooooooooooooooooo
Params34.7B
Context256K
Smallest15.0 GB
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · shefowl
Params139B
Context256K
Smallest56.5 GB
QW
FishAudio Drama3 TTS 83Lang Qwen3.5 35B A3B FP8 BF16
Qwen · AMAImedia
Params35B
Context—
Smallest23.4 GB
OP
Openbuddy Yi1.5 34b v21.3 32k
Openbuddy · RichardErkhov
Params34.4B
Context128K
Q4_K_M20.7 GB
GR
Grug 35b v2
Grug · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.8 Flash Next Heretic 2
Qwen · spiritfather
Params177B
Context256K
Q4_K_M2.8 GB
KN
KnowLine 35B A3B Gen1
Knowline · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
AE
Aetheria L2 70B
Aetheria · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · unsloth
Params218B
Context198K
Q4_K_M132.0 GB
QW
Qwen3 53B A3B TOTAL RECALL v1.4
Qwen · mradermacher
Params53B
Context40K
Q4_K_M32.1 GB
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · crusoeai
Params34.4B
Context32K
Q4_K_M20.7 GB