Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Abliterated 24GB
Nemotron · BoldingBuilds
Params74B
Context256K
Smallest22.0 GB
QW
Qwen3.5 397B A17B
Qwen · bartowski
Params403B
Context256K
Q4_K_M248.3 GB
OR
Ornith 1.0 35B
Ornith · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
QW
Qwen3.6 35B A3B APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · zerofata
Params107B
Context128K
Smallest65.9 GB
GP
Gpt Oss 120b Abliterated
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
DE
DeepSeek V3.1
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
QW
Qwen3 Coder Next
Qwen · ggml-org
Params80B
Context256K
Smallest84.8 GB
HU
Huihui Ornith 1.5 35B A3B Abliterated
Huihui · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
LL
Llama 2 70B Chat
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
calme 2.4 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
HE
Hermes-4-70B
Hermes · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Nex N2.5 Mini
Nex · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
QW
Qwen3.6 35B A3B
Qwen · IsValorum
Params35.5B
Context256K
Smallest13.0 GB
HO
K2-Horizon-32B
Horizon · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
QW
Qwen3.6-35B-A3B
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
AP
Apex-35B-V1.0
Apex · Apexintelligence-AI
Params35.5B
Context256K
Q4_K_M21.7 GB
OR
Ornith 1.5 35B A3B
Ornith · ArtomYuan
Params35.5B
Context256K
Smallest19.0 GB
QW
Qwen3.8 Flash Next
Qwen · ArtomYuan
Params177B
Context256K
Smallest94.3 GB
OR
Ornith 1.5 35B A3B Uncensored
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3-Vl-235B-A22B-Instruct
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
QW
Qwen3 235B A22B Abliterated
Qwen · mradermacher
Params235B
Context40K
Q4_K_M142.2 GB
LA
Laguna S 2.1 Uncensored APEX
Laguna · SC117
Params118B
Context1024K
Smallest2.2 GB
QW
Qwen3.6 35B A3B abliterated v2
Qwen · LMLiutenant
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.6 35B A3B APEX MTP Strata Q5EXPS
Qwen · misthemAI
Params35.5B
Context256K
Smallest22.5 GB
MI
nousresearch_nous-hermes-2-mixtral-8x7b-dpo
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen3.8 Flash Next REAM 60Pct
Qwen · RemySkye
Params129B
Context256K
Smallest35.6 GB
OC
Occamy 1.0 APEX I MiniPlus V2.1 Abliterated
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
GP
Gpt Oss 120b Derestricted
gpt-oss · gghfez
Params117B
Context128K
Smallest63.4 GB
DE
DeepSeek V4 Flash 0731 IK
DeepSeek · KeinNiemand
Params284B
Context—
Smallest65.4 GB