Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
RI
Rio 3.5 Open 397B
Rio · bartowski
Params403B
Context256K
Q4_K_M245.0 GB
RE
ReluLLaMA 70B PowerInfer
Relullama · Tiiny
Params70B
Context—
Smallest42.2 GB
MI
MiniMaxAI_MiniMax M2.5
Minimax · lmstudio-community
Params230B
Context192K
Q4_K_M138.3 GB
QW
Qwen3Vl 235b A22B Thinking
Qwen · Qwen
Params235B
Context256K
Q4_K_M142.2 GB
QW
halogen qwen3.8 flash next uncensored
Qwen · davenetdev
Params177B
Context256K
Smallest97.5 GB
MI
Mistral Large 3 675B Instruct 2512
Mistral · bartowski
Params673B
Context288K
Q4_K_M411.4 GB
QW
Qwen3.6 35B A3B
Qwen · cafkafk
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
llama3 42b v0 GGUF smashed
Llama · PrunaAI
Params43.2B
Context8K
Smallest16.3 GB
YI
ehartford_dolphin-2.2-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
llama 3 70B instruct uncensored i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
Mirai 70B 2.1
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MA
Marcoroni 70B
Marcoroni · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MA
Steelskull L3.3 Cu Mai R1 70b
Mai · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwopus3.6 35B A3B Coder
Qwopus · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
UM
Umbra-v3-MoE-4x11b-2ex
Umbra · RichardErkhov
Params36.1B
Context32K
Q4_K_M21.8 GB
GP
Gpt Oss 46b
gpt-oss · mradermacher
Params45.7B
Context128K
Q4_K_M34.5 GB
DI
dillfrescott_trinity-v1.2-x8-moe
Dillfrescott · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
DE
Deepseek ai.DeepSeek V3.1 Terminus BF16
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
ZE
ED Zephyria 48b i1
Zephyria · mradermacher
Params48.4B
Context128K
Q4_K_M29.0 GB
CH
Chronos Platinum 72B
Chronos · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
SW
Swallow 70B
Swallow · TheBloke
Params69.2B
Context4K
Q4_K_M41.5 GB
QC
qCammel 70 x
Qcammel · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Reflection Llama 3.1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
Mirai 70B 1.0
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Mixtral 8x22B v0.1 iMat
Mistral · InferenceIllusionist
Params141B
Context32K
Q4_K_M85.6 GB
QW
GRAFT 50B A3B
Qwen · SmallAICreator
Params50.7B
Context256K
Q4_K_M30.9 GB
LL
Llama3-Preferred-MedSwallow-70B
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
MA
magnum v4 72b
Magnum · anthracite-org
Params72.7B
Context32K
Q4_K_M47.4 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · prometheusAIR
Params748B
Context1024K
Smallest0.8 GB
PR
L3.3 Prikol 70B v0.2
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB