Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LI
Ling 3.0 Flash Dspark
Ling · bloomer010
Params127B
Context256K
Q4_K_M0.7 GB
QW
Qwen3.8 Flash Next
Qwen · pentacoxian-dev
Params180B
Context256K
Smallest85.9 GB
DE
DeepSeek V4.1 Flash GSQ RCO
DeepSeek · pfeifferj
Params748B
Context—
Smallest9.3 GB
QW
Qwen3.6 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking NEO CODE Di IMatrix MAX
Qwen · DavidAU
Params39.1B
Context256K
Q4_K_M24.3 GB
QW
Qwen3-Next-80B-A3B-Instruct
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
DE
DeepSeek V4.1 Flash
DeepSeek · audreyt
Params755B
Context—
Smallest365.7 GB
GL
GLM-5.3-Flash Vision Encoder
GLM · antirez
Params321B
Context—
Smallest1.1 GB
QW
Qwen3.5-122B-A10B
Qwen · unsloth
Params125B
Context256K
Q4_K_M78.3 GB
LI
LING 3.0 FLASH ABLITERATED
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · bartowski
Params108B
Context10240K
Q4_K_M67.5 GB
CY
Huihui CyberStrike OffSec 35B Abliterated
Cyberstrike · huihui-ai
Params35.5B
Context256K
Smallest21.7 GB
QW
Qwen_Qwen3.5 35B A3B
Qwen · lmstudio-community
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.8-Flash-Next
Qwen · ggml-org
Params177B
Context256K
Smallest0.4 GB
DE
DeepSeek V4.1 Flash 1017 Vision Encoder
DeepSeek · kyuz0
Params755B
Context—
Smallest1.0 GB
LL
Llama 3.3 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next Uncensored
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · unsloth
Params74B
Context256K
Smallest1.0 GB
HU
Cyber Tiel Coder 35B A3B
Huihui · peculiar-ragdoll
Params34.7B
Context256K
Q4_K_M22.1 GB
LL
Llama 3.3 70B Instruct Abliterated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
KO
Kolibri 1
Kolibri · Hob-forge
Params78B
Context256K
Q4_K_M47.5 GB
GL
GLM-5.3-Flash
GLM · GCSA-AiLab
Params313B
Context1024K
Smallest137.1 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B
Nemotron · lmstudio-community
Params124B
Context1024K
Q4_K_M70.1 GB
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
QW
Qwen3.5-122B-A10B
Qwen · unsloth
Params122B
Context256K
Q4_K_M76.5 GB
MI
models--v2ray--Mixtral-8x22B-v0.1
Mistral · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
GL
GLM 5.3 Flash
GLM · huihui-ai
Params321B
Context1024K
Smallest93.1 GB
QW
Huihui Qwen3 Coder Next Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
QW
Qwen2.5 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3 Coder Next 0129
Qwen · Qwen
Params80B
Context256K
Q4_K_M48.4 GB