Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Huihui Qwen3.6 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Xiangxin 2XL Chat 1048k Chinese Llama3 70B i1
Llama · mradermacher
Params70.6B
Context1024K
Q4_K_M42.5 GB
MI
MiMo V2.6 Flash RL
Mimo · TrevorJS
Params310B
Context1024K
Smallest2.2 GB
LL
calme-2.3-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
Hermes-2-Theta-L3-Euryale-Ties-0.8-70B
Hermes · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3.6 35B Uncensored HauhauCS 1M MTP Ollama
Qwen · braydenh563
Params35.5B
Context1024K
Q4_K_M21.7 GB
YI
RpBird Yi 34B 200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
PA
Palmyra Med 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
QW
Qwen3.6 35B A3B Uncensored HauhauCS FP16
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · sensitivecontent
Params284B
Context1024K
Smallest10.9 GB
UN
una xaberius 34b v1beta
Una · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GI
giant macaroni 120b i1
Giant · mradermacher
Params120B
Context4K
Smallest26.1 GB
FO
ReadyArt Forgotten Safeword 70B 3.6
Forgotten · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 4 Scout 17B 16E Instruct Abliterated
Llama · mradermacher
Params108B
Context10240K
Smallest39.6 GB
CA
Cassiopeia 70B
Cassiopeia · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · bartowski
Params284B
Context—
Smallest10.9 GB
QW
Qwen3.8 Flash Next mixC
Qwen · boxrunner
Params177B
Context256K
Smallest2.4 GB
QW
Qwen3.5 122B A10B abliterated
Qwen · Thaurock
Params122B
Context256K
Q4_K_M74.2 GB
MI
Midnight Miqu 70b v1.5
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
BE
Behemoth 128B v3
Behemoth · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
DE
DeepSeek V4 Pro
DeepSeek · teamblobfish
Params1570B
Context1024K
Q4_K_M954.6 GB
QW
OpenYourMind Qwen3.6 35B A3B Kuato DPO Abliterated Uncensored
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
llama 3 70B instruct uncensored
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen1.5 8x7b v0.1
Qwen · MaziyarPanahi
Params38B
Context32K
Q4_K_M23.6 GB
DE
DeepSeek V4.1 Flash 1017 REAP192
DeepSeek · patrickbdevaney
Params280B
Context1024K
Smallest8.0 GB
SA
Steelskull L3.3 San Mai R1 70b
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GR
xai org grok 2
Grok · bartowski
Params270B
Context128K
Q4_K_M164.1 GB
LL
Llama 3.1 Tulu 3 70B DPO
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
nvidia Llama 3 1 Nemotron Ultra 253B v1
Llama · bartowski
Params253B
Context128K
Q4_K_M150.9 GB
QW
Qwen3.6 35B A3B Abliterated MAX
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB