Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM 4.7
GLM · unsloth
Params358B
Context198K
Q4_K_M216.5 GB
GGUF
DR
Drama 3 Windows
Drama · Eng-Ahmd
Params35.9B
Context—
Smallest1.6 GB
GGUF
DE
Decider 35b A3B
Decider · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
RavenX CyberAgent Qwen3.6 35B A3B Opus 4.7 OpenMythos Pentester BugHunter RATH
Qwen · deadbydawn101
Params35.5B
Context256K
Q4_K_M21.7 GB
Tool use
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Uncensored
Nemotron · AtomicChat
Params74B
Context256K
Q4_K_M51.7 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · smalinin
Params748B
Context—
Smallest0.8 GB
GGUF
GL
GLM 4.6V
GLM · ggml-org
Params107B
Context128K
Q4_K_M70.4 GB
Vision
NE
Nex N2.5 mini OrcaRouter Sangreal ICE
Nex · gbuzhf
Params34.7B
Context256K
Smallest11.9 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · lmstudio-community
Params284B
Context—
Smallest156.4 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored LocalAI
Qwen · weareapexcreators
Params34.7B
Context256K
Smallest11.7 GB
Vision
IN
Index Translate 35B A3B preview
Index · IndexTeam
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
KI
Kimi-K2-Instruct
Kimi · unsloth
Params1030B
Context128K
Q4_K_M620.8 GB
Coding
QW
OpenYourMind Qwen3.6 35B A3B Kuato DPO Abliterated Uncensored
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
OR
Ornith 1.0 35B
Ornith · weareapexcreators
Params34.7B
Context1024K
Smallest12.9 GB
GGUF
CY
Cyber Tiel Coder 35B A3B APEX I MiniPlus V2.1
Cyber · IsValorum
Params34.7B
Context256K
Smallest1.5 GB
GGUF
QW
Qwen3.5-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.6 GB
Vision
LI
Ling-3.0-flash-Sante
Ling · AtomicChat
Params127B
Context256K
Smallest35.7 GB
ReasoningTool use
LL
Meta-Llama-3-120B-Instruct
Llama · lmstudio-community
Params122B
Context8K
Q4_K_M73.2 GB
GGUF
HO
K2 Horizon MoVA 36B A4B
Horizon · NANI-Nithin
Params37.4B
Context512K
Q4_K_M22.4 GB
Reasoning
QW
Qwen3.8 Flash Next IQ3 S
Qwen · boxrunner
Params177B
Context256K
Smallest2.4 GB
Vision
LL
Meta Llama 3.1 70B Instruct
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DE
Deepseek-R1-0528
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
CodingReasoning
KO
Huihui Kolibri 1 BF16 Abliterated
Kolibri · huihui-ai
Params78B
Context256K
Q4_K_M47.5 GB
Reasoning
LA
Laguna-S-2.1
Laguna · unsloth
Params118B
Context256K
Q4_K_M73.1 GB
GGUF
QW
Qwen3.8 Flash Next IQ4 XS
Qwen · julianmb
Params177B
Context256K
Smallest4.1 GB
GGUF
GL
GLM-5.3-Flash
GLM · pfeifferj
Params313B
Context1024K
Smallest117.5 GB
Vision
MI
MiniMax M3.1 Flash Maya
Minimax · peasantsmith
Params426B
Context1024K
Smallest93.0 GB
ReasoningTool use
AP
35B A3B
Apus · apus-ailab
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
AL
Source Hf Aliceai T5 35b A0.6B
Aliceai · ngquocvinh
Params34.6B
Context128K
Q4_K_M21.0 GB
Coding
MI
MiniMax-M3.1-Flash
Minimax · LyJonathan
Params426B
Context1024K
Smallest94.8 GB
ReasoningTool useVision

Other sizes

Keep browsing