Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiMo V2.6 Flash MOPD
Mimo · spiritfather
Params310B
Context1024K
Q4_K_M189.5 GB
GGUF
QW
Qwen3.5 122B A10B
Qwen · bartowski
Params125B
Context256K
Q4_K_M77.6 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Vision
MI
MiniCPM-V-4.7-35B-A3B-Uncensored
MiniCPM · gbuzhf
Params34.7B
Context256K
Smallest11.9 GB
Vision
QW
Qwen3.5-397B-A17B
Qwen · unsloth
Params397B
Context256K
Q4_K_M244.1 GB
Vision
SA
Sage A1.5 APEX I MiniPlus V2.1
Sage · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
ReasoningTool useVision
GL
GLM-5.3-Flash
GLM · DogContext
Params321B
Context1024K
Smallest96.5 GB
GGUF
GL
GLM 5.3 Flash Uncensored
GLM · orcarouter
Params321B
Context1024K
Q4_K_M193.0 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B Uncensored
Qwen · xCloudinfo
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Bahushruth Qwen3.6 35B A3B Abliterated v4
Qwen · Bahushruth
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
DE
DeepSeek V4.1 Flash UNCENSORED Protium
DeepSeek · Solstice-AI
Params748B
Context1024K
Q4_K_M426.1 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · AtomicChat
Params755B
Context—
Smallest365.7 GB
GGUF
QW
Qwen3 Next 80B A3B Instruct
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Bolt-74B-A9B
Nemotron · AtomicChat
Params74B
Context256K
Q4_K_M51.7 GB
GGUF
KI
Kimi Linear 48B A3B Instruct
Kimi · bartowski
Params49.1B
Context1024K
Q4_K_M30.1 GB
GGUF
JA
Jais-3-32B
Jais · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
ReasoningTool use
XY
XYZ Aquila Mini
Xyz · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
LL
Llama 3.3 70B Instruct
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Cyberneurova Qwen3.8 Flash Next
Qwen · spiritfather
Params177B
Context256K
Q4_K_M119.2 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
OR
Ornith-1.5-122B
Ornith · AtomicChat
Params125B
Context256K
Smallest35.0 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · hesamation
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest11.6 GB
ReasoningVision
FL
Flint-40B-A2.5B-abliterated
Flint · dima6312
Params39.8B
Context256K
Q4_K_M24.2 GB
CodingReasoningTool use
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
LI
Ling 3.0 Flash VL
Ling · bartowski
Params124B
Context128K
Q4_K_M78.7 GB
Vision
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated IQ3 S
Qwen · slider-meister-pub
Params177B
Context256K
Smallest83.7 GB
Vision
AL
AliceAI Foundation 80B A3B Base
Aliceai · Yamada114514
Params79.6B
Context256K
Q4_K_M48.4 GB
Coding
FL
RecursiveSI flint
Flint · bartowski
Params39.8B
Context256K
Q4_K_M25.3 GB
GGUF
MI
Mistral Small 4 119B 2603
Mistral · bartowski
Params119B
Context1024K
Q4_K_M72.6 GB
Vision

Other sizes

Keep browsing