Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
GL
GLM 4.7
GLM · unsloth
Params358B
Context198K
Q4_K_M216.5 GB
DR
Drama 3 Windows
Drama · Eng-Ahmd
Params35.9B
Context—
Smallest1.6 GB
DE
Decider 35b A3B
Decider · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
RavenX CyberAgent Qwen3.6 35B A3B Opus 4.7 OpenMythos Pentester BugHunter RATH
Qwen · deadbydawn101
Params35.5B
Context256K
Q4_K_M21.7 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Uncensored
Nemotron · AtomicChat
Params74B
Context256K
Q4_K_M51.7 GB
DE
DeepSeek V4.1 Flash
DeepSeek · smalinin
Params748B
Context—
Smallest0.8 GB
GL
GLM 4.6V
GLM · ggml-org
Params107B
Context128K
Q4_K_M70.4 GB
NE
Nex N2.5 mini OrcaRouter Sangreal ICE
Nex · gbuzhf
Params34.7B
Context256K
Smallest11.9 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · lmstudio-community
Params284B
Context—
Smallest156.4 GB
QW
Qwen3.6 35B A3B Uncensored LocalAI
Qwen · weareapexcreators
Params34.7B
Context256K
Smallest11.7 GB
IN
Index Translate 35B A3B preview
Index · IndexTeam
Params35.5B
Context256K
Q4_K_M21.7 GB
KI
Kimi-K2-Instruct
Kimi · unsloth
Params1030B
Context128K
Q4_K_M620.8 GB
QW
OpenYourMind Qwen3.6 35B A3B Kuato DPO Abliterated Uncensored
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
OR
Ornith 1.0 35B
Ornith · weareapexcreators
Params34.7B
Context1024K
Smallest12.9 GB
CY
Cyber Tiel Coder 35B A3B APEX I MiniPlus V2.1
Cyber · IsValorum
Params34.7B
Context256K
Smallest1.5 GB
QW
Qwen3.5-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.6 GB
LI
Ling-3.0-flash-Sante
Ling · AtomicChat
Params127B
Context256K
Smallest35.7 GB
LL
Meta-Llama-3-120B-Instruct
Llama · lmstudio-community
Params122B
Context8K
Q4_K_M73.2 GB
HO
K2 Horizon MoVA 36B A4B
Horizon · NANI-Nithin
Params37.4B
Context512K
Q4_K_M22.4 GB
QW
Qwen3.8 Flash Next IQ3 S
Qwen · boxrunner
Params177B
Context256K
Smallest2.4 GB
LL
Meta Llama 3.1 70B Instruct
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
Deepseek-R1-0528
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
KO
Huihui Kolibri 1 BF16 Abliterated
Kolibri · huihui-ai
Params78B
Context256K
Q4_K_M47.5 GB
LA
Laguna-S-2.1
Laguna · unsloth
Params118B
Context256K
Q4_K_M73.1 GB
QW
Qwen3.8 Flash Next IQ4 XS
Qwen · julianmb
Params177B
Context256K
Smallest4.1 GB
GL
GLM-5.3-Flash
GLM · pfeifferj
Params313B
Context1024K
Smallest117.5 GB
MI
MiniMax M3.1 Flash Maya
Minimax · peasantsmith
Params426B
Context1024K
Smallest93.0 GB
AP
35B A3B
Apus · apus-ailab
Params34.7B
Context256K
Q4_K_M21.2 GB
AL
Source Hf Aliceai T5 35b A0.6B
Aliceai · ngquocvinh
Params34.6B
Context128K
Q4_K_M21.0 GB
MI
MiniMax-M3.1-Flash
Minimax · LyJonathan
Params426B
Context1024K
Smallest94.8 GB