Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LE
Lemur 70B Chat v1
Lemur · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GL
GLM 4.6V
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
QW
Qwen3.8 Flash Next Uncensored Q4 K M MTP
Qwen · him0413
Params180B
Context256K
Q4_K_M121.0 GB
NY
Nyakura CausalLM RP 34B i1
Nyakura · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
CodeLlama 70b Instruct Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
HO
Holo4 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
MiMo V2.6 Flash RL GSQ RCO
Mimo · pfeifferj
Params309B
Context1024K
Smallest115.7 GB
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
QW
Qwen3.5 122B A10B Heretic v2
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
JA
japanese stablelm instruct beta 70B
Japanese · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LI
Ling 3.1 Flash
Ling · bartowski
Params572B
Context256K
Q4_K_M358.0 GB
YI
01 ai Yi 34B Chat
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
SA
Sage A1.5 Q6 K
Sage · InternScience
Params35.5B
Context256K
Smallest29.2 GB
QW
Qwen3.8-Flash-Next DS4 Q4 ple
Qwen · ivanfioravanti
Params51.2B
Context—
Smallest32.0 GB
LO
LongCat Flash Lite
Longcat · InquiringMinds-AI
Params68.6B
Context320K
Q4_K_M40.2 GB
SA
Sage A1.5 Heretic Abliterated Uncensored
Sage · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
OR
Ornith 1.5 35B A3B Abliterated
Ornith · PocketAiHub
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
Mimo-V2.5
Mimo · unsloth
Params310B
Context1024K
Q4_K_M190.9 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
AI
airoboros l2 70b 2.2 i1
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GP
kldzj gpt oss 120b heretic v2
gpt-oss · bartowski
Params117B
Context—
Smallest0.2 GB
LI
Ling-3.1-flash
Ling · AtomicChat
Params564B
Context256K
Q4_K_M354.4 GB
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CO
commandr
Command R · DavidAU
Params35B
Context128K
Smallest11.1 GB
QW
Qwen3.6 Fallen Fabulist 35B A3B Heretic
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen2.5 VL 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context125K
Q4_K_M47.4 GB
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
CodeLlama 70b Python Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
AI
Airoboros L2 70B 3.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB