Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Qwen2 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
YI
Yislerp 34B i1
Yislerp · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
CA
calme-2.4-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
BI
BigAurelian v0.5 120b 32k i1
Bigaurelian · mradermacher
Params118B
Context4K
Smallest25.0 GB
GL
GLM 4.7 Flash 49B
GLM · mradermacher
Params47.7B
Context198K
Q4_K_M28.9 GB
DR
drama-3
Drama · Harsha001
Params35.8B
Context—
Smallest20.1 GB
SP
Spicyboros 70B 2.2
Spicyboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 3.1 Tulu 3 405B
Llama · bartowski
Params406B
Context128K
Q4_K_M243.1 GB
QW
Qwen3 Coder Next
Qwen · Omega-Factory
Params79.7B
Context256K
Q4_K_M48.5 GB
FA
WizardLM Uncensored Falcon 40b
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M25.5 GB
HO
Holo2 235B A22B
Holo · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
QW
Gemini 3 Pro Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
K2-Horizon-MoVA-36B-A4B
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
DE
DeepSeek V4 Flash 0731 Pruned 155B A13B
DeepSeek · takanori-ishikawa
Params155B
Context1024K
Smallest1.2 GB
LL
Llama 3 Meerkat 70b v1.0
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next Q8 UDQ4K DS4
Qwen · nazeshinjite
Params180B
Context256K
Smallest202.5 GB
KA
Karakuri Lm 70b Chat v0.1
Karakuri · mradermacher
Params69.2B
Context4K
Q4_K_M41.6 GB
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · FenomAI
Params177B
Context256K
Smallest66.4 GB
LL
models--MaziyarPanahi--Llama-3-70B-Instruct-32k-v0.1
Llama · MaziyarPanahi
Params70.6B
Context31K
Q4_K_M42.5 GB
AE
aegolius acadicus 34b v3
Aegolius · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
DO
Donnager 70B V1A
Donnager · bartowski
Params69B
Context32K
Q4_K_M41.4 GB
DR
Drama 3 ConfigI
Drama · thetom-ai
Params34.7B
Context256K
Smallest24.3 GB
DB
dbrx instruct iMat
Dbrx · dranger003
Params132B
Context32K
Smallest26.9 GB
LL
Tess R1 Limerick Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
BE
Behemoth 123B v2.2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
CO
Command A Reasoning 08 2025
Command · bartowski
Params111B
Context488K
Q4_K_M67.1 GB
QW
cerebras/Qwen3-Coder-REAP-363B-A35B
Qwen · unsloth
Params363B
Context256K
Q4_K_M219.3 GB
CH
chronos 70b v2 i1
Chronos · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
LL
OpenBuddy Llama2 70b v10.1
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
0G
0GM 1.0 35B A3B 0427
mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB