Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
RI
Rio 3.5 Open 397B
Rio · bartowski
Params403B
Context256K
Q4_K_M245.0 GB
Vision
RE
ReluLLaMA 70B PowerInfer
Relullama · Tiiny
Params70B
Context—
Smallest42.2 GB
GGUF
MI
MiniMaxAI_MiniMax M2.5
Minimax · lmstudio-community
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
QW
Qwen3Vl 235b A22B Thinking
Qwen · Qwen
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningVision
QW
halogen qwen3.8 flash next uncensored
Qwen · davenetdev
Params177B
Context256K
Smallest97.5 GB
GGUF
MI
Mistral Large 3 675B Instruct 2512
Mistral · bartowski
Params673B
Context288K
Q4_K_M411.4 GB
Tool useVision
QW
Qwen3.6 35B A3B
Qwen · cafkafk
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
LL
llama3 42b v0 GGUF smashed
Llama · PrunaAI
Params43.2B
Context8K
Smallest16.3 GB
GGUF
YI
ehartford_dolphin-2.2-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
llama 3 70B instruct uncensored i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
Mirai 70B 2.1
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
MA
Marcoroni 70B
Marcoroni · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MA
Steelskull L3.3 Cu Mai R1 70b
Mai · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
Qwopus3.6 35B A3B Coder
Qwopus · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use
UM
Umbra-v3-MoE-4x11b-2ex
Umbra · RichardErkhov
Params36.1B
Context32K
Q4_K_M21.8 GB
GGUF
GP
Gpt Oss 46b
gpt-oss · mradermacher
Params45.7B
Context128K
Q4_K_M34.5 GB
GGUF
DI
dillfrescott_trinity-v1.2-x8-moe
Dillfrescott · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
DE
Deepseek ai.DeepSeek V3.1 Terminus BF16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
ReasoningTool use
ZE
ED Zephyria 48b i1
Zephyria · mradermacher
Params48.4B
Context128K
Q4_K_M29.0 GB
GGUF
CH
Chronos Platinum 72B
Chronos · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Roleplay
SW
Swallow 70B
Swallow · TheBloke
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
QC
qCammel 70 x
Qcammel · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Reflection Llama 3.1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
Mirai 70B 1.0
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
MI
Mixtral 8x22B v0.1 iMat
Mistral · InferenceIllusionist
Params141B
Context32K
Q4_K_M85.6 GB
GGUF
QW
GRAFT 50B A3B
Qwen · SmallAICreator
Params50.7B
Context256K
Q4_K_M30.9 GB
Tool use
LL
Llama3-Preferred-MedSwallow-70B
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MA
magnum v4 72b
Magnum · anthracite-org
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017
DeepSeek · prometheusAIR
Params748B
Context1024K
Smallest0.8 GB
GGUF
PR
L3.3 Prikol 70B v0.2
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Other sizes

Keep browsing