Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
Gpt Oss 120b
gpt-oss · bartowski
Params117B
Context128K
Q4_K_M62.8 GB
GGUF
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
HO
K2 Horizon MoVA 36B A4B ROCmFP4
Horizon · kingjones777
Params37.4B
Context512K
Smallest19.9 GB
Reasoning
GL
GLM 5.1
GLM · unsloth
Params754B
Context198K
Q4_K_M464.5 GB
GGUF
AN
Anubis 70B v1.1
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
MiMo V2.6 Flash RL Mixed Quant
Mimo · Baekpica
Params310B
Context—
Smallest0.5 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp Uncensored
DeepSeek · ddh0
Params284B
Context—
Smallest140.7 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Aggressive
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
QU
QuartetAnemoi-70B-t0.0001
Quartetanemoi · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
JA
AI21 Jamba2 Mini Ultra Uncensored Heretic
Jamba · llmfan46
Params51.6B
Context256K
Q4_K_M31.2 GB
GGUF
YI
Nous Hermes 2 Yi 34B
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
QW
Qwen2.5 VL 72B Instruct
Qwen · ggml-org
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
AI
airoboros-65b-gpt4-m2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
SW
Swallow-70b-NVE-instruct-hf
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
HE
Hermes 4.3 36B Heretic
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningRoleplayTool use
SE
Seed OSS 36B Instruct Abliterated
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
KI
Kimi-Dev-72B
Kimi · unsloth
Params72.7B
Context128K
Smallest23.0 GB
Coding
GP
GPT OSS Swallow 120B RL v0.1
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
CodingTool use
LL
Hermes 3 Llama 3.1 405B
Llama · bartowski
Params405B
Context128K
Q4_K_M243.1 GB
RoleplayTool use
QW
Huihui Qwen3.5 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
NE
Nemotron 3.5 Bolt 74B A9B CRACK 24GB
Nemotron · dealignai
Params74B
Context256K
Smallest1.0 GB
Vision
MI
Mistral Medium 3.5 128B
Mistral · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
Vision
EU
Eurus 70b nca fixed i1
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Reasoning
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
FL
flint 40B A2.5B Q4 K M
Flint · Abiray
Params39.8B
Context256K
Q4_K_M24.1 GB
ReasoningTool use
OC
Occamy 1.0 APEX I NanoPlus
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
YI
Yi 1.5 34B Chat 16K
Yi · RichardErkhov
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
KI
Kimi K3 Uncensored
Kimi · Ryanchen911
Params2780B
Context1024K
Smallest579.5 GB
GGUF
YI
Faro Yi 34B i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF

Other sizes

Keep browsing