Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
Ling 3.0 Flash Dspark
Ling · bloomer010
Params127B
Context256K
Q4_K_M0.7 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · pentacoxian-dev
Params180B
Context256K
Smallest85.9 GB
GGUF
DE
DeepSeek V4.1 Flash GSQ RCO
DeepSeek · pfeifferj
Params748B
Context—
Smallest9.3 GB
GGUF
QW
Qwen3.6 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking NEO CODE Di IMatrix MAX
Qwen · DavidAU
Params39.1B
Context256K
Q4_K_M24.3 GB
CodingReasoningRoleplay
QW
Qwen3-Next-80B-A3B-Instruct
Qwen · unsloth
Params80B
Context256K
Q4_K_M48.5 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · audreyt
Params755B
Context—
Smallest365.7 GB
GGUF
GL
GLM-5.3-Flash Vision Encoder
GLM · antirez
Params321B
Context—
Smallest1.1 GB
GGUF
QW
Qwen3.5-122B-A10B
Qwen · unsloth
Params125B
Context256K
Q4_K_M78.3 GB
Vision
LI
LING 3.0 FLASH ABLITERATED
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
Reasoning
LL
Llama 4 Scout 17B 16E Instruct
Llama · bartowski
Params108B
Context10240K
Q4_K_M67.5 GB
GGUF
CY
Huihui CyberStrike OffSec 35B Abliterated
Cyberstrike · huihui-ai
Params35.5B
Context256K
Smallest21.7 GB
Tool useVision
QW
Qwen_Qwen3.5 35B A3B
Qwen · lmstudio-community
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.8-Flash-Next
Qwen · ggml-org
Params177B
Context256K
Smallest0.4 GB
Vision
DE
DeepSeek V4.1 Flash 1017 Vision Encoder
DeepSeek · kyuz0
Params755B
Context—
Smallest1.0 GB
GGUF
LL
Llama 3.3 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.8 Flash Next Uncensored
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
ReasoningTool useVision
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · unsloth
Params74B
Context256K
Smallest1.0 GB
Vision
HU
Cyber Tiel Coder 35B A3B
Huihui · peculiar-ragdoll
Params34.7B
Context256K
Q4_K_M22.1 GB
CodingReasoningTool use
LL
Llama 3.3 70B Instruct Abliterated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
KO
Kolibri 1
Kolibri · Hob-forge
Params78B
Context256K
Q4_K_M47.5 GB
ReasoningTool use
GL
GLM-5.3-Flash
GLM · GCSA-AiLab
Params313B
Context1024K
Smallest137.1 GB
Vision
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B
Nemotron · lmstudio-community
Params124B
Context1024K
Q4_K_M70.1 GB
Vision
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
QW
Qwen3.5-122B-A10B
Qwen · unsloth
Params122B
Context256K
Q4_K_M76.5 GB
Vision
MI
models--v2ray--Mixtral-8x22B-v0.1
Mistral · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · huihui-ai
Params35.5B
Context256K
Smallest13.2 GB
ReasoningVision
GL
GLM 5.3 Flash
GLM · huihui-ai
Params321B
Context1024K
Smallest93.1 GB
Vision
QW
Huihui Qwen3 Coder Next Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
QW
Qwen2.5 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen3 Coder Next 0129
Qwen · Qwen
Params80B
Context256K
Q4_K_M48.4 GB
Coding

Other sizes

Keep browsing