Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
PH
Phind 70B
Phind · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
KA
KAT Coder V2.5 Dev 35B A3B MTP ABLITERATED
Kat · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.8 Flash Next GSQ RCO abliterated GGUF IQ3 XXS
Qwen · KENIC-1
Params177B
Context256K
Smallest0.9 GB
FI
FIPO IPL IPO Tulu2 70B i1
Fipo · mradermacher
Params69B
Context8K
Q4_K_M41.4 GB
LL
Llama 3_3 Nemotron Super 49B GenRM
Llama · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
CO
CohereLabs.command A Plus 05 2026 Bf16
Command · DevQuasar
Params218B
Context4883K
Smallest79.7 GB
QW
Qwerky QwQ 32B
Qwen · mradermacher
Params34.9B
Context1024K
Q4_K_M22.8 GB
EU
L3 70B Euryale v2.1
Euryale · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama3-ChatQA-1.5-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
NU
NuminaMath 72B TIR i1
Numinamath · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
OR
Ornith 1.5 35B MaxQuality MTP
Ornith · offmonreal
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Sakura Qwen3.8 Flash Next Swift 3bit 352E
Qwen · webmp3
Params139B
Context256K
Smallest62.5 GB
TI
Tia 70B RP
Tia · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MY
mythxl 70b
Mythxl · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama-3-70B-Instruct-norefusal
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · second-state
Params51.5B
Context128K
Q4_K_M31.0 GB
MI
Nous Hermes 2 Mixtral 8x7B DPO iMat
Mistral · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Swift 1.5 Qwen3.8 Flash Next Q4 K XL
Qwen · ethanwtodd
Params177B
Context256K
Smallest111.3 GB
GL
GLM 5.3 Flash
GLM · stealth-model
Params321B
Context1024K
Smallest101.8 GB
SA
Samantha 1.1 70b i1
Samantha · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
JA
AI21 Jamba Mini 1.5
Jamba · mradermacher
Params51.6B
Context256K
Q4_K_M31.2 GB
CA
Capek0.5 35B A3B
Capek · prithivMLmods
Params34.7B
Context256K
Smallest19.8 GB
BE
Behemoth 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GE
L3.3 GeneticLemonade Unleashed v3 70B
Geneticlemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen.Qwen3 235B A22B
Qwen · DevQuasar
Params235B
Context40K
Q4_K_M142.2 GB
BL
blossom 40B
Blossom · mradermacher
Params40B
Context4K
Q4_K_M24.0 GB
QW
Qwen2-72B-Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
KA
Umba 5.6.600_bf16
Kat · Tomkiel
Params34.7B
Context256K
Smallest16.4 GB
KA
KAT Coder V2.5 Dev 35B A3B MTP ABLITERATED
Kat · jakeroxs
Params35.5B
Context256K
Q4_K_M21.7 GB
AQ
Aquif 3.5 Max 1205
Aquif · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB