Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Godzilla Coder 51B 128k
Qwen · mradermacher
Params51B
Context128K
Q4_K_M30.7 GB
Coding
XW
Xwin LM 70B V0.1
Xwin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MO
L3.1 MOE 6X8B Dark Reasoning Dantes Peak HORROR R1 Uncensored 36B
Moe · DavidAU
Params36.2B
Context128K
Q4_K_M22.0 GB
ReasoningRoleplay
ZE
Zen4 Coder
Zen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
SW
Swallow MX 8x7b NVE v0.1
Swallow · mradermacher
Params46.7B
Context4K
Q4_K_M28.4 GB
GGUF
MI
Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
BE
Behemoth X 123B v2.1
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
DE
Deepseek-Prover-V2-671B-Bf16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.5 GB
Coding
LL
Infinity-Instruct-3M-0613-Llama3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
KA
Karnak
Karnak · mradermacher
Params40.7B
Context256K
Q4_K_M24.7 GB
Tool use
HO
Holo2 235B A22B
Holo · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
GGUF
QW
MLXFW Qwen3.8 Flash Next Heretic Q8 0
Qwen · the-shop
Params177B
Context256K
Smallest4.1 GB
Vision
OR
Ornith-1.5-35B
Ornith · julianmb
Params35.5B
Context256K
Smallest19.1 GB
Vision
QW
Qwen3 235B A22B Thinking 2507
Qwen · bartowski
Params235B
Context256K
Q4_K_M142.6 GB
Reasoning
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NE
Source Hf Nex N2.5 Mini
Nex · ngquocvinh
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool useVision
MI
MixtralOrochi8x7B Alt
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
SA
Salience 1.5 Pro
Salience · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
CodingReasoningTool use
SO
SOLAR 0 70b 16bit
Solar · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
YI
blossom v3 1 yi 34b i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
Llama 3.1 70B Instruct lorablated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Swift 1.5 Qwen 3.8 Flash Next Heretic UD IQ4 XS
Qwen · trubisky
Params177B
Context256K
Smallest93.6 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Pollard
Nemotron · PollardWeights
Params74B
Context256K
Smallest17.9 GB
ReasoningTool useVision
UM
Umbra v2.1 MoE 4x10.7 i1
Umbra · mradermacher
Params36B
Context32K
Q4_K_M22.0 GB
GGUF
MA
Mag Picaro 72B
Mag · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Roleplay
MY
mythxl 70b i1
Mythxl · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen2 72B Instruct
Qwen · Qwen
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LL
ShiningValiant 1.2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
UN
una xaberius 34b v1beta i1
Una · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
sheep duck llama 2 70b v1.1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Other sizes

Keep browsing