Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 72B Instruct
Qwen · second-state
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
DE
DeepSeek-R1-Distill-Llama-70B
DeepSeek · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
ReasoningTool use
DA
daVinci Dev 72B MT
Davinci · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
QW
Qwen3.6 35B A3B Uncensored Aggressive
Qwen · prithivMLmods
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningVision
MI
Nous Hermes 2 Mixtral 8x7B SFT Alpaca
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
NE
Next 70b
Next · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
NE
Anubis 70B v1
Negative · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
AN
AnubisLemonade 70B v1.1
Anubislemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
KA
KAT Coder V2.5 Dev APEX I NanoPlus V2.1
Kat · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
CodingReasoningTool use
LL
Llama 3.3 70B Instruct Heretic v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
ReAligned Qwen3.5 35B A3B
Qwen · Lazarus-Ai
Params34.7B
Context256K
Smallest12.8 GB
ReasoningTool use
GP
Gpt4O Distil Paperwitch Abliteration L33 70b
Gpt · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
huihui ai Qwen3 Coder Next ablisdterated
Qwen · Slaxxis
Params79.7B
Context256K
Q4_K_M48.6 GB
CodingTool use
GO
GoldDiamondGold Abliterated L33 70b
Golddiamondgold · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
QW
Qwen3 54B A3B 2507 YOYO2 TOTAL RECALL Instruct
Qwen · mradermacher
Params53B
Context986K
Q4_K_M32.1 GB
CodingReasoningTool use
GP
Big Gpt Oss
gpt-oss · mradermacher
Params197B
Context128K
Q4_K_M147.9 GB
GGUF
QW
Qwen3.5 35B A3B Abliterated
Qwen · jiaojjjjje
Params34.7B
Context256K
Smallest36.9 GB
ReasoningTool use
QW
Qwen3.8 Flash Next
Qwen · Delgon
Params51.2B
Context—
Smallest28.8 GB
GGUF
YI
Yillama 40B
Yillama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
LL
Llama PLLuM 70B Chat 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
70B_llama313_rp
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
QW
Qwen3.8 Flash Next
Qwen · AMAImedia
Params177B
Context256K
Smallest111.3 GB
ReasoningTool useVision
LL
Pathos Theta LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
openbuddy_openbuddy-mixtral-8x7b-v15.2
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
GGUF
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
MI
Mistral Large Instruct 2407
Mistral · mmnga
Params123B
Context32K
Smallest26.0 GB
GGUF
LL
Llama PLLuM 70B Instruct 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3 Yoyo V3 42B A3B Thinking TOTAL RECALL ST TNG III
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
CodingReasoningTool use

Other sizes

Keep browsing