Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
MI
MiMo V2.6 Flash MOPD
Mimo · spiritfather
Params310B
Context1024K
Q4_K_M189.5 GB
QW
Qwen3.5 122B A10B
Qwen · bartowski
Params125B
Context256K
Q4_K_M77.6 GB
QW
Qwen3.6-35B-A3B
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
MI
MiniCPM-V-4.7-35B-A3B-Uncensored
MiniCPM · gbuzhf
Params34.7B
Context256K
Smallest11.9 GB
QW
Qwen3.5-397B-A17B
Qwen · unsloth
Params397B
Context256K
Q4_K_M244.1 GB
SA
Sage A1.5 APEX I MiniPlus V2.1
Sage · IsValorum
Params35.5B
Context256K
Smallest15.2 GB
GL
GLM-5.3-Flash
GLM · DogContext
Params321B
Context1024K
Smallest96.5 GB
GL
GLM 5.3 Flash Uncensored
GLM · orcarouter
Params321B
Context1024K
Q4_K_M193.0 GB
QW
Qwen3.6 35B A3B Uncensored
Qwen · xCloudinfo
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Bahushruth Qwen3.6 35B A3B Abliterated v4
Qwen · Bahushruth
Params34.7B
Context256K
Q4_K_M21.2 GB
DE
DeepSeek V4.1 Flash UNCENSORED Protium
DeepSeek · Solstice-AI
Params748B
Context1024K
Q4_K_M426.1 GB
DE
DeepSeek V4.1 Flash
DeepSeek · AtomicChat
Params755B
Context—
Smallest365.7 GB
QW
Qwen3 Next 80B A3B Instruct
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
NE
NVIDIA-Nemotron-3.5-Bolt-74B-A9B
Nemotron · AtomicChat
Params74B
Context256K
Q4_K_M51.7 GB
KI
Kimi Linear 48B A3B Instruct
Kimi · bartowski
Params49.1B
Context1024K
Q4_K_M30.1 GB
JA
Jais-3-32B
Jais · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
XY
XYZ Aquila Mini
Xyz · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
LL
Llama 3.3 70B Instruct
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Cyberneurova Qwen3.8 Flash Next
Qwen · spiritfather
Params177B
Context256K
Q4_K_M119.2 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
OR
Ornith-1.5-122B
Ornith · AtomicChat
Params125B
Context256K
Smallest35.0 GB
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · hesamation
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest11.6 GB
FL
Flint-40B-A2.5B-abliterated
Flint · dima6312
Params39.8B
Context256K
Q4_K_M24.2 GB
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LI
Ling 3.0 Flash VL
Ling · bartowski
Params124B
Context128K
Q4_K_M78.7 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated IQ3 S
Qwen · slider-meister-pub
Params177B
Context256K
Smallest83.7 GB
AL
AliceAI Foundation 80B A3B Base
Aliceai · Yamada114514
Params79.6B
Context256K
Q4_K_M48.4 GB
FL
RecursiveSI flint
Flint · bartowski
Params39.8B
Context256K
Q4_K_M25.3 GB
MI
Mistral Small 4 119B 2603
Mistral · bartowski
Params119B
Context1024K
Q4_K_M72.6 GB