Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phind 70B
Phind · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
CodingTool use
KA
KAT Coder V2.5 Dev 35B A3B MTP ABLITERATED
Kat · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use
QW
Qwen3.8 Flash Next GSQ RCO abliterated GGUF IQ3 XXS
Qwen · KENIC-1
Params177B
Context256K
Smallest0.9 GB
GGUF
FI
FIPO IPL IPO Tulu2 70B i1
Fipo · mradermacher
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
LL
Llama 3_3 Nemotron Super 49B GenRM
Llama · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
CO
CohereLabs.command A Plus 05 2026 Bf16
Command · DevQuasar
Params218B
Context4883K
Smallest79.7 GB
Tool use
QW
Qwerky QwQ 32B
Qwen · mradermacher
Params34.9B
Context1024K
Q4_K_M22.8 GB
ReasoningTool use
EU
L3 70B Euryale v2.1
Euryale · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama3-ChatQA-1.5-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NU
NuminaMath 72B TIR i1
Numinamath · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
OR
Ornith 1.5 35B MaxQuality MTP
Ornith · offmonreal
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
QW
Sakura Qwen3.8 Flash Next Swift 3bit 352E
Qwen · webmp3
Params139B
Context256K
Smallest62.5 GB
GGUF
TI
Tia 70B RP
Tia · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Roleplay
MY
mythxl 70b
Mythxl · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama-3-70B-Instruct-norefusal
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Llama 3_1 Nemotron 51B Instruct
Llama · second-state
Params51.5B
Context128K
Q4_K_M31.0 GB
CodingTool use
MI
Nous Hermes 2 Mixtral 8x7B DPO iMat
Mistral · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
QW
Swift 1.5 Qwen3.8 Flash Next Q4 K XL
Qwen · ethanwtodd
Params177B
Context256K
Smallest111.3 GB
ReasoningTool useVision
GL
GLM 5.3 Flash
GLM · stealth-model
Params321B
Context1024K
Smallest101.8 GB
ReasoningTool useVision
SA
Samantha 1.1 70b i1
Samantha · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
JA
AI21 Jamba Mini 1.5
Jamba · mradermacher
Params51.6B
Context256K
Q4_K_M31.2 GB
Tool use
CA
Capek0.5 35B A3B
Capek · prithivMLmods
Params34.7B
Context256K
Smallest19.8 GB
ReasoningTool useVision
BE
Behemoth 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
GE
L3.3 GeneticLemonade Unleashed v3 70B
Geneticlemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
QW
Qwen.Qwen3 235B A22B
Qwen · DevQuasar
Params235B
Context40K
Q4_K_M142.2 GB
ReasoningTool use
BL
blossom 40B
Blossom · mradermacher
Params40B
Context4K
Q4_K_M24.0 GB
GGUF
QW
Qwen2-72B-Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
KA
Umba 5.6.600_bf16
Kat · Tomkiel
Params34.7B
Context256K
Smallest16.4 GB
CodingReasoningTool use
KA
KAT Coder V2.5 Dev 35B A3B MTP ABLITERATED
Kat · jakeroxs
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use
AQ
Aquif 3.5 Max 1205
Aquif · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
ReasoningTool use

Other sizes

Keep browsing