Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Huihui Qwen3.8 Flash Next abliterated
Qwen · SUNNYROAM
Params177B
Context256K
Smallest68.2 GB
ReasoningTool useVision
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · Gustav0-Freind
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
PH
Fx Phys
Phys · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
PI
PiVoT SUS RP
Pivot · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
Roleplay
QW
Qwen3.6 35B A3B SILVER APEX
Qwen · White-Wolf13
Params34.7B
Context256K
Smallest12.1 GB
GGUF
BE
Behemoth R1 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
Reasoning
BI
allura org Bigger Body 70b
Bigger · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
KI
Kimi Linear 48B A3B Base
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
Tool use
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Mrt45
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
AT
Atom 80b
Atom · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
ReasoningTool use
SP
XORTRON 123B
Speedy · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
QW
QwQ 35B Eureka Cubed i1
Qwen · mradermacher
Params34.7B
Context128K
Q4_K_M21.0 GB
ReasoningTool use
IN
Inkling-Small
Inkling · lyssquant
Params264B
Context1024K
Q4_K_M162.5 GB
ReasoningVision
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.3 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen2 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
GL
GLM 5.3 Flash
GLM · Yyyssd
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
PI
PiVoT MoE
Pivot · mradermacher
Params36B
Context32K
Q4_K_M21.8 GB
GGUF
QW
Qwen3 Yoyo V3 42B A3B Thinking TOTAL RECALL ST TNG II
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
CodingReasoningTool use
AU
Aurora Nights 70B v1.0
Aurora · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
MiniMax M2.1 REAP 50
Minimax · mradermacher
Params116B
Context192K
Q4_K_M70.4 GB
CodingTool use
LL
scb10x llama 3 typhoon v1.5x 70b instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
OR
Ornith-1.5-35B
Ornith · LuffyTheFox
Params35.5B
Context256K
Smallest26.5 GB
Tool useVision
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · NousResearch
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MA
Magnum v2 72b
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
HU
Huihui3.5 67B A3B Abliterated
Huihui · mradermacher
Params67B
Context256K
Q4_K_M40.8 GB
Vision
SY
Synthia 70B
Synthia · TheBloke
Params69B
Context—
Q4_K_M41.4 GB
GGUF
GL
GLM 4.7 Flash Grande Heretic UNCENSORED 42B A3B
GLM · DavidAU
Params42B
Context198K
Q4_K_M25.8 GB
ReasoningRoleplay
PO
Poro 34B
Poro · mradermacher
Params35.1B
Context7K
Q4_K_M22.4 GB
Coding
GL
GLM 5.3 Flash
GLM · Petyx123
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision

Other sizes

Keep browsing