Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes
Qwen · yuhanb
Params34.7B
Context256K
Smallest12.9 GB
Tool useVision
LI
Liberated Miqu 70B i1
Liberated · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
LL
nvidia.Llama 3 1 Nemotron Ultra 253B v1
Llama · DevQuasar-13
Params253B
Context128K
Q4_K_M150.9 GB
GGUF
VA
Valkyrie 49B v1
Valkyrie · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
QW
Qwen3.6 Fallen Fabulist 35B A3B Heretic
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Roleplay
HY
Hy3
bartowski
Params300B
Context256K
Q4_K_M182.2 GB
GGUF
YI
Yi 1.5 34B 32K
Yi · RichardErkhov
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
QW
Qwopus3.6 35B A3B v1 APEX MTP
Qwopus · mudler
Params35.5B
Context256K
Smallest11.7 GB
GGUF
MI
cloudyu_mixtral_34bx2_moe_60b
Mistral · TheBloke
Params60.8B
Context195K
Q4_K_M34.4 GB
GGUF
LL
llama-3-70B-Instruct-abliterated
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen2.5 VL 72B Instruct Heretic
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
CodingVision
YI
Yi-34B-Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
TE
migtissera_tess-m-v1.3
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
DE
triadparty_deepmoney-34b-200k-chat-evaluator
Deepmoney · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
YI
Yi 34B 200K DARE Merge v7
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen2.5 72B Instruct Malaysian
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS MXFP8 Engram
DeepSeek · Starw1
Params197B
Context1024K
Smallest138.6 GB
GGUF
LL
ShiningValiant 1.3
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
KA
KAT Coder V2.5 Dev 16GB MixedQuant
Kat · fooooooooooooooooooooooooooooooooooooooooo
Params34.7B
Context256K
Smallest15.0 GB
Coding
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · shefowl
Params139B
Context256K
Smallest56.5 GB
GGUF
QW
FishAudio Drama3 TTS 83Lang Qwen3.5 35B A3B FP8 BF16
Qwen · AMAImedia
Params35B
Context—
Smallest23.4 GB
GGUF
OP
Openbuddy Yi1.5 34b v21.3 32k
Openbuddy · RichardErkhov
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
GR
Grug 35b v2
Grug · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen3.8 Flash Next Heretic 2
Qwen · spiritfather
Params177B
Context256K
Q4_K_M2.8 GB
Vision
KN
KnowLine 35B A3B Gen1
Knowline · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
AE
Aetheria L2 70B
Aetheria · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · unsloth
Params218B
Context198K
Q4_K_M132.0 GB
GGUF
QW
Qwen3 53B A3B TOTAL RECALL v1.4
Qwen · mradermacher
Params53B
Context40K
Q4_K_M32.1 GB
CodingReasoningTool use
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · crusoeai
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF

Other sizes

Keep browsing