Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Huihui Qwen3.6 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LL
Xiangxin 2XL Chat 1048k Chinese Llama3 70B i1
Llama · mradermacher
Params70.6B
Context1024K
Q4_K_M42.5 GB
GGUF
MI
MiMo V2.6 Flash RL
Mimo · TrevorJS
Params310B
Context1024K
Smallest2.2 GB
ReasoningTool use
LL
calme-2.3-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
HE
Hermes-2-Theta-L3-Euryale-Ties-0.8-70B
Hermes · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
QW
Qwen3.6 35B Uncensored HauhauCS 1M MTP Ollama
Qwen · braydenh563
Params35.5B
Context1024K
Q4_K_M21.7 GB
Vision
YI
RpBird Yi 34B 200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
PA
Palmyra Med 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored HauhauCS FP16
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · sensitivecontent
Params284B
Context1024K
Smallest10.9 GB
GGUF
UN
una xaberius 34b v1beta
Una · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
GI
giant macaroni 120b i1
Giant · mradermacher
Params120B
Context4K
Smallest26.1 GB
GGUF
FO
ReadyArt Forgotten Safeword 70B 3.6
Forgotten · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama 4 Scout 17B 16E Instruct Abliterated
Llama · mradermacher
Params108B
Context10240K
Smallest39.6 GB
Vision
CA
Cassiopeia 70B
Cassiopeia · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
DE
DeepSeek V4 Flash 0731
DeepSeek · bartowski
Params284B
Context—
Smallest10.9 GB
GGUF
QW
Qwen3.8 Flash Next mixC
Qwen · boxrunner
Params177B
Context256K
Smallest2.4 GB
Vision
QW
Qwen3.5 122B A10B abliterated
Qwen · Thaurock
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
MI
Midnight Miqu 70b v1.5
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
BE
Behemoth 128B v3
Behemoth · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
ReasoningTool use
DE
DeepSeek V4 Pro
DeepSeek · teamblobfish
Params1570B
Context1024K
Q4_K_M954.6 GB
GGUF
QW
OpenYourMind Qwen3.6 35B A3B Kuato DPO Abliterated Uncensored
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LL
llama 3 70B instruct uncensored
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen1.5 8x7b v0.1
Qwen · MaziyarPanahi
Params38B
Context32K
Q4_K_M23.6 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 REAP192
DeepSeek · patrickbdevaney
Params280B
Context1024K
Smallest8.0 GB
GGUF
SA
Steelskull L3.3 San Mai R1 70b
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
GR
xai org grok 2
Grok · bartowski
Params270B
Context128K
Q4_K_M164.1 GB
GGUF
LL
Llama 3.1 Tulu 3 70B DPO
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
nvidia Llama 3 1 Nemotron Ultra 253B v1
Llama · bartowski
Params253B
Context128K
Q4_K_M150.9 GB
GGUF
QW
Qwen3.6 35B A3B Abliterated MAX
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning

Other sizes

Keep browsing