Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Abliterated 24GB
Nemotron · BoldingBuilds
Params74B
Context256K
Smallest22.0 GB
Vision
QW
Qwen3.5 397B A17B
Qwen · bartowski
Params403B
Context256K
Q4_K_M248.3 GB
Vision
OR
Ornith 1.0 35B
Ornith · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
QW
Qwen3.6 35B A3B APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
GGUF
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · zerofata
Params107B
Context128K
Smallest65.9 GB
GGUF
GP
Gpt Oss 120b Abliterated
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
GGUF
DE
DeepSeek V3.1
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
GGUF
QW
Qwen3 Coder Next
Qwen · ggml-org
Params80B
Context256K
Smallest84.8 GB
Coding
HU
Huihui Ornith 1.5 35B A3B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
LL
Llama 2 70B Chat
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
calme 2.4 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
HE
Hermes-4-70B
Hermes · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningRoleplayTool use
NE
Nex N2.5 Mini
Nex · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
Vision
QW
Qwen3.6 35B A3B
Qwen · IsValorum
Params35.5B
Context256K
Smallest13.0 GB
ReasoningTool useVision
HO
K2-Horizon-32B
Horizon · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
AP
Apex-35B-V1.0
Apex · Apexintelligence-AI
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
OR
Ornith 1.5 35B A3B
Ornith · ArtomYuan
Params35.5B
Context256K
Smallest19.0 GB
Vision
QW
Qwen3.8 Flash Next
Qwen · ArtomYuan
Params177B
Context256K
Smallest94.3 GB
Vision
OR
Ornith 1.5 35B A3B Uncensored
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
Qwen3-Vl-235B-A22B-Instruct
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
Vision
QW
Qwen3 235B A22B Abliterated
Qwen · mradermacher
Params235B
Context40K
Q4_K_M142.2 GB
GGUF
LA
Laguna S 2.1 Uncensored APEX
Laguna · SC117
Params118B
Context1024K
Smallest2.2 GB
GGUF
QW
Qwen3.6 35B A3B abliterated v2
Qwen · LMLiutenant
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.6 35B A3B APEX MTP Strata Q5EXPS
Qwen · misthemAI
Params35.5B
Context256K
Smallest22.5 GB
GGUF
MI
nousresearch_nous-hermes-2-mixtral-8x7b-dpo
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
QW
Qwen3.8 Flash Next REAM 60Pct
Qwen · RemySkye
Params129B
Context256K
Smallest35.6 GB
GGUF
OC
Occamy 1.0 APEX I MiniPlus V2.1 Abliterated
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
GP
Gpt Oss 120b Derestricted
gpt-oss · gghfez
Params117B
Context128K
Smallest63.4 GB
GGUF
DE
DeepSeek V4 Flash 0731 IK
DeepSeek · KeinNiemand
Params284B
Context—
Smallest65.4 GB
GGUF

Other sizes

Keep browsing