Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PA
MS3.2 PaintedFantasy Visage v4 34B
Paintedfantasy · mradermacher
Params34.1B
Context128K
Q4_K_M20.7 GB
Roleplay
LL
Llama SEA LION v3 70B IT
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Meta Llama 3 70B Instruct
Llama · hermes42
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LI
Ling 3.1 flash Uncensored
Ling · AtomicChat
Params564B
Context256K
Q4_K_M354.4 GB
ReasoningTool use
ST
StartLux Decision v1 35B A3B
Startlux · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
GL
GLM-4.5V
GLM · ggml-org
Params107B
Context64K
Q4_K_M63.6 GB
ReasoningTool useVision
GL
GLM 5.3 Flash
GLM · Ashwinxs
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
TE
Tema_Q X5 Thinking
Tema · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
LL
Llama 3.1 70B Instruct Lorablated Creative Writer
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
BA
Baichuan M3 235B
Baichuan · mradermacher
Params235B
Context40K
Q4_K_M142.2 GB
ReasoningTool use
BE
Behemoth X R1 123B
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
ReasoningRoleplay
DA
L3.3 Dark Ages 70b v0.1
Dark · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
CA
Camelidae 8x34B
Camelidae · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
Coding
AP
Apex 35B V1.0
Apex · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
AG
AgentWorld 35B A3B Heretic
Agentworld · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
OP
OPRM 72B
Oprm · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
MI
MiniMax M2.7
Minimax · dennny123
Params229B
Context192K
Q4_K_M138.3 GB
ReasoningTool use
QW
RavenX CyberAgent Qwen3.6 35B A3B Opus 4.7 OpenMythos Pentester BugHunter RATH
Qwen · Kiliver
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
QW
Qwen3 Next 80B A3B Instruct REAP
Qwen · mradermacher
Params60.3B
Context256K
Q4_K_M36.7 GB
Tool use
SA
Sapphira L3.3 70b 0.1
Sapphira · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DE
HeatSeeker 284B A13B
DeepSeek · UltimateIntent
Params284B
Context1024K
Q4_K_M171.8 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · Krhuz
Params284B
Context1024K
Smallest10.9 GB
GGUF
NE
Ea_Final_Nvidia_Nemotron_3_Super_120B_A12B_Bf16_030326_Vv0.1
Nemotron · ggml-org
Params121B
Context1024K
Smallest69.9 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Aggressive
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · BlueBackup
Params34.7B
Context256K
Smallest11.7 GB
ReasoningTool useVision
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
GL
GLM 5.3 Flash
GLM · AshwinX
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
LI
Linkbricks Horizon AI Japanese Pro V3 70B
Linkbricks · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use

Other sizes

Keep browsing