Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 72B Instruct
Qwen · second-state
Params72.7B
Context32K
Q4_K_M47.4 GB
DE
DeepSeek-R1-Distill-Llama-70B
DeepSeek · Mungert
Params70.6B
Context128K
Q4_K_M42.8 GB
DA
daVinci Dev 72B MT
Davinci · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.6 35B A3B Uncensored Aggressive
Qwen · prithivMLmods
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT Alpaca
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
NE
Next 70b
Next · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
NE
Anubis 70B v1
Negative · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
AN
AnubisLemonade 70B v1.1
Anubislemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
KA
KAT Coder V2.5 Dev APEX I NanoPlus V2.1
Kat · IsValorum
Params34.7B
Context256K
Smallest1.2 GB
LL
Llama 3.3 70B Instruct Heretic v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
ReAligned Qwen3.5 35B A3B
Qwen · Lazarus-Ai
Params34.7B
Context256K
Smallest12.8 GB
GP
Gpt4O Distil Paperwitch Abliteration L33 70b
Gpt · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
huihui ai Qwen3 Coder Next ablisdterated
Qwen · Slaxxis
Params79.7B
Context256K
Q4_K_M48.6 GB
GO
GoldDiamondGold Abliterated L33 70b
Golddiamondgold · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 54B A3B 2507 YOYO2 TOTAL RECALL Instruct
Qwen · mradermacher
Params53B
Context986K
Q4_K_M32.1 GB
GP
Big Gpt Oss
gpt-oss · mradermacher
Params197B
Context128K
Q4_K_M147.9 GB
QW
Qwen3.5 35B A3B Abliterated
Qwen · jiaojjjjje
Params34.7B
Context256K
Smallest36.9 GB
QW
Qwen3.8 Flash Next
Qwen · Delgon
Params51.2B
Context—
Smallest28.8 GB
YI
Yillama 40B
Yillama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
Llama PLLuM 70B Chat 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
70B_llama313_rp
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next
Qwen · AMAImedia
Params177B
Context256K
Smallest111.3 GB
LL
Pathos Theta LLaMa 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
openbuddy_openbuddy-mixtral-8x7b-v15.2
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
MI
Mistral Large Instruct 2407
Mistral · mmnga
Params123B
Context32K
Smallest26.0 GB
LL
Llama PLLuM 70B Instruct 250801
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 Yoyo V3 42B A3B Thinking TOTAL RECALL ST TNG III
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB