Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Huihui Qwen3.8 Flash Next abliterated
Qwen · SUNNYROAM
Params177B
Context256K
Smallest68.2 GB
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · Gustav0-Freind
Params35.5B
Context256K
Q4_K_M21.7 GB
PH
Fx Phys
Phys · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
PI
PiVoT SUS RP
Pivot · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
QW
Qwen3.6 35B A3B SILVER APEX
Qwen · White-Wolf13
Params34.7B
Context256K
Smallest12.1 GB
BE
Behemoth R1 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
BI
allura org Bigger Body 70b
Bigger · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
KI
Kimi Linear 48B A3B Base
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Mrt45
Params34.7B
Context256K
Q4_K_M21.2 GB
AT
Atom 80b
Atom · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
SP
XORTRON 123B
Speedy · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
QW
QwQ 35B Eureka Cubed i1
Qwen · mradermacher
Params34.7B
Context128K
Q4_K_M21.0 GB
IN
Inkling-Small
Inkling · lyssquant
Params264B
Context1024K
Q4_K_M162.5 GB
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.3 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GL
GLM 5.3 Flash
GLM · Yyyssd
Params321B
Context1024K
Smallest93.1 GB
PI
PiVoT MoE
Pivot · mradermacher
Params36B
Context32K
Q4_K_M21.8 GB
QW
Qwen3 Yoyo V3 42B A3B Thinking TOTAL RECALL ST TNG II
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
AU
Aurora Nights 70B v1.0
Aurora · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
MiniMax M2.1 REAP 50
Minimax · mradermacher
Params116B
Context192K
Q4_K_M70.4 GB
LL
scb10x llama 3 typhoon v1.5x 70b instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
OR
Ornith-1.5-35B
Ornith · LuffyTheFox
Params35.5B
Context256K
Smallest26.5 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · NousResearch
Params46.7B
Context32K
Q4_K_M28.4 GB
MA
Magnum v2 72b
Magnum · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
HU
Huihui3.5 67B A3B Abliterated
Huihui · mradermacher
Params67B
Context256K
Q4_K_M40.8 GB
SY
Synthia 70B
Synthia · TheBloke
Params69B
Context—
Q4_K_M41.4 GB
GL
GLM 4.7 Flash Grande Heretic UNCENSORED 42B A3B
GLM · DavidAU
Params42B
Context198K
Q4_K_M25.8 GB
PO
Poro 34B
Poro · mradermacher
Params35.1B
Context7K
Q4_K_M22.4 GB
GL
GLM 5.3 Flash
GLM · Petyx123
Params321B
Context1024K
Smallest93.1 GB