Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
PA
MS3.2 PaintedFantasy Visage v4 34B
Paintedfantasy · mradermacher
Params34.1B
Context128K
Q4_K_M20.7 GB
LL
Llama SEA LION v3 70B IT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta Llama 3 70B Instruct
Llama · hermes42
Params70.6B
Context8K
Q4_K_M42.5 GB
LI
Ling 3.1 flash Uncensored
Ling · AtomicChat
Params564B
Context256K
Q4_K_M354.4 GB
ST
StartLux Decision v1 35B A3B
Startlux · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GL
GLM-4.5V
GLM · ggml-org
Params107B
Context64K
Q4_K_M63.6 GB
GL
GLM 5.3 Flash
GLM · Ashwinxs
Params321B
Context1024K
Smallest93.1 GB
TE
Tema_Q X5 Thinking
Tema · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Llama 3.1 70B Instruct Lorablated Creative Writer
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
Meta Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
BA
Baichuan M3 235B
Baichuan · mradermacher
Params235B
Context40K
Q4_K_M142.2 GB
BE
Behemoth X R1 123B
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
DA
L3.3 Dark Ages 70b v0.1
Dark · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
CA
Camelidae 8x34B
Camelidae · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
AP
Apex 35B V1.0
Apex · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
AG
AgentWorld 35B A3B Heretic
Agentworld · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
OP
OPRM 72B
Oprm · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
MI
MiniMax M2.7
Minimax · dennny123
Params229B
Context192K
Q4_K_M138.3 GB
QW
RavenX CyberAgent Qwen3.6 35B A3B Opus 4.7 OpenMythos Pentester BugHunter RATH
Qwen · Kiliver
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3 Next 80B A3B Instruct REAP
Qwen · mradermacher
Params60.3B
Context256K
Q4_K_M36.7 GB
SA
Sapphira L3.3 70b 0.1
Sapphira · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
HeatSeeker 284B A13B
DeepSeek · UltimateIntent
Params284B
Context1024K
Q4_K_M171.8 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · Krhuz
Params284B
Context1024K
Smallest10.9 GB
NE
Ea_Final_Nvidia_Nemotron_3_Super_120B_A12B_Bf16_030326_Vv0.1
Nemotron · ggml-org
Params121B
Context1024K
Smallest69.9 GB
QW
Qwen3.6 35B A3B Uncensored Aggressive
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · BlueBackup
Params34.7B
Context256K
Smallest11.7 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GL
GLM 5.3 Flash
GLM · AshwinX
Params321B
Context1024K
Smallest93.1 GB
LI
Linkbricks Horizon AI Japanese Pro V3 70B
Linkbricks · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB