Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LE
Lemur 70B Chat v1
Lemur · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
GL
GLM 4.6V
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
GGUF
QW
Qwen3.8 Flash Next Uncensored Q4 K M MTP
Qwen · him0413
Params180B
Context256K
Q4_K_M121.0 GB
Vision
NY
Nyakura CausalLM RP 34B i1
Nyakura · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
Roleplay
LL
CodeLlama 70b Instruct Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Coding
HO
Holo4 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
MI
MiMo V2.6 Flash RL GSQ RCO
Mimo · pfeifferj
Params309B
Context1024K
Smallest115.7 GB
GGUF
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
GGUF
QW
Qwen3.5 122B A10B Heretic v2
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
JA
japanese stablelm instruct beta 70B
Japanese · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LI
Ling 3.1 Flash
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
GGUF
YI
01 ai Yi 34B Chat
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
SA
Sage A1.5 Q6 K
Sage · InternScience
Params35.5B
Context256K
Smallest29.2 GB
CodingReasoningTool use
QW
Qwen3.8-Flash-Next DS4 Q4 ple
Qwen · ivanfioravanti
Params51.2B
Context—
Smallest32.0 GB
GGUF
LO
LongCat Flash Lite
Longcat · InquiringMinds-AI
Params68.6B
Context320K
Q4_K_M40.2 GB
GGUF
SA
Sage A1.5 Heretic Abliterated Uncensored
Sage · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingReasoningTool use
OR
Ornith 1.5 35B A3B Abliterated
Ornith · PocketAiHub
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
MI
Mimo-V2.5
Mimo · unsloth
Params310B
Context1024K
Q4_K_M190.9 GB
Vision
DE
DeepSeek V4 Flash 0731
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
GGUF
AI
airoboros l2 70b 2.2 i1
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
GP
kldzj gpt oss 120b heretic v2
gpt-oss · bartowski
Params117B
Context—
Smallest0.2 GB
GGUF
LI
Ling-3.1-flash
Ling · AtomicChat
Params564B
Context256K
Q4_K_M354.4 GB
ReasoningTool use
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
CO
commandr
Command R · DavidAU
Params35B
Context128K
Smallest11.1 GB
Roleplay
QW
Qwen3.6 Fallen Fabulist 35B A3B Heretic
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
RoleplayVision
QW
Qwen2.5 VL 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningVision
LL
CodeLlama 70b Python Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Coding
AI
Airoboros L2 70B 3.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Other sizes

Keep browsing