Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
GP
Gpt Oss 120b
gpt-oss · bartowski
Params117B
Context128K
Q4_K_M62.8 GB
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
HO
K2 Horizon MoVA 36B A4B ROCmFP4
Horizon · kingjones777
Params37.4B
Context512K
Smallest19.9 GB
GL
GLM 5.1
GLM · unsloth
Params754B
Context198K
Q4_K_M464.5 GB
AN
Anubis 70B v1.1
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
MiMo V2.6 Flash RL Mixed Quant
Mimo · Baekpica
Params310B
Context—
Smallest0.5 GB
DE
DeepSeek V4 Flash Vision Exp Uncensored
DeepSeek · ddh0
Params284B
Context—
Smallest140.7 GB
QW
Qwen3.6 35B A3B Uncensored Aggressive
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QU
QuartetAnemoi-70B-t0.0001
Quartetanemoi · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
JA
AI21 Jamba2 Mini Ultra Uncensored Heretic
Jamba · llmfan46
Params51.6B
Context256K
Q4_K_M31.2 GB
YI
Nous Hermes 2 Yi 34B
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen2.5 VL 72B Instruct
Qwen · ggml-org
Params72.7B
Context125K
Q4_K_M47.4 GB
AI
airoboros-65b-gpt4-m2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
SW
Swallow-70b-NVE-instruct-hf
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
HE
Hermes 4.3 36B Heretic
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
SE
Seed OSS 36B Instruct Abliterated
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
KI
Kimi-Dev-72B
Kimi · unsloth
Params72.7B
Context128K
Smallest23.0 GB
GP
GPT OSS Swallow 120B RL v0.1
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
LL
Hermes 3 Llama 3.1 405B
Llama · bartowski
Params405B
Context128K
Q4_K_M243.1 GB
QW
Huihui Qwen3.5 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
NE
Nemotron 3.5 Bolt 74B A9B CRACK 24GB
Nemotron · dealignai
Params74B
Context256K
Smallest1.0 GB
MI
Mistral Medium 3.5 128B
Mistral · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
EU
Eurus 70b nca fixed i1
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
FL
flint 40B A2.5B Q4 K M
Flint · Abiray
Params39.8B
Context256K
Q4_K_M24.1 GB
OC
Occamy 1.0 APEX I NanoPlus
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
YI
Yi 1.5 34B Chat 16K
Yi · RichardErkhov
Params34.4B
Context16K
Q4_K_M20.7 GB
KI
Kimi K3 Uncensored
Kimi · Ryanchen911
Params2780B
Context1024K
Smallest579.5 GB
YI
Faro Yi 34B i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB