Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · 10exdev
Params748B
Context1024K
Smallest1.6 GB
SP
Spoomplesmaxx Mockingbird 36B
Spoomplesmaxx · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
CO
c4ai-command-r-v01
Command R · lmstudio-community
Params35B
Context128K
Q4_K_M21.5 GB
MI
MiniMaxAI.MiniMax M2.7
Minimax · DevQuasar
Params229B
Context192K
Q4_K_M138.3 GB
MI
Mirai 70B 2
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
mixtral
Mistral · hfl
Params46.7B
Context32K
Smallest9.5 GB
SA
SaulLM 141 Base i1
Saullm · mradermacher
Params141B
Context64K
Smallest29.6 GB
MO
Monstral 123B v2
Monstral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
DE
Deepcogito.Cogito v2 Preview Deepseek 671B MoE
DeepSeek · DevQuasar
Params671B
Context160K
Q4_K_M404.5 GB
FA
FastH3 GGUFs
Fastvideo · realrebelai
Params35B
Context—
Q4_K_M19.8 GB
QW
Qwen3.5 122B A10B Uncensored APEX Compact
Qwen · SC117
Params122B
Context256K
Smallest59.2 GB
MI
Tess 3 Mistral Large 2 123B
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
QW
Qwen1.5 110B
Qwen · mradermacher
Params111B
Context32K
Smallest23.6 GB
XW
Xwin Math 70B V1.1
Xwin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen2.5 6x7B Six Pack Coder Instruct 42B 128k Ctx
Qwen · mradermacher
Params41.8B
Context128K
Q4_K_M25.4 GB
SO
Solstice 70b i1
Solstice · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes V11 Dequantized
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen2 Math 72B Instruct
Qwen · bartowski
Params72.7B
Context4K
Q4_K_M47.4 GB
QW
Qwen3.5 35B A3B
Qwen · Smoffyy
Params34.7B
Context256K
Q4_K_M21.2 GB
SE
Seed OSS 36B Instruct
Seed · second-state
Params36.2B
Context512K
Q4_K_M21.8 GB
QW
calme-2.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
HU
Huihui MiroThinker v1.0 72B Abliterated
Huihui · mradermacher
Params72.7B
Context256K
Q4_K_M47.4 GB
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · qmnvp
Params132B
Context256K
Smallest90.3 GB
QW
Savant Qwen2.5 72B i1
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
AG
Agents A1
Agents · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MO
L3.1 MOE 8X8B Dark Planet 8D Mirrored Chaos Uncensored 47B i1
Moe · mradermacher
Params47.5B
Context128K
Q4_K_M29.0 GB
MI
Karasu-Mixtral-8x22B-v0.1
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
CO
c4ai-command-r-v01
Command R · dranger003
Params35B
Context128K
Q4_K_M21.5 GB
RI
inclusionAI.Ring Flash 2.0
Ring · DevQuasar-11
Params103B
Context32K
Q4_K_M62.4 GB