Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · andyjack
Params34.7B
Context256K
Smallest19.8 GB
PE
Pearl 34B ties
Pearl · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL PDK V
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · Justbackup
Params284B
Context—
Smallest10.9 GB
DE
DeepSeek R1 Zero BF16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.4 GB
ST
Step 3.5 Flash REAP 121B A11B i1
Step · mradermacher
Params121B
Context256K
Q4_K_M72.8 GB
QW
LuffyTheFox Qwen3.6 35B A3B Uncensored Wasserstein
Qwen · CCSSNE
Params34.7B
Context256K
Smallest11.7 GB
JA
Jais Adapted 70b
Jais · mradermacher
Params69.5B
Context4K
Q4_K_M41.8 GB
DA
Steelskull L3.3 Damascus R1
Damascus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
BE
34b beta i1
Beta · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
BI
BigQwen2.5 Echo 47B Instruct
Bigqwen · bartowski
Params47.4B
Context32K
Q4_K_M28.6 GB
IN
Yi-Ko-34B-Instruct
Instruct · mradermacher
Params34.6B
Context4K
Q4_K_M20.8 GB
AI
airoboros-65b-gpt4-2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
MI
SauerkrautLM Mixtral 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
VE
VerA Etheria 55b
Vera · mradermacher
Params55.6B
Context195K
Q4_K_M33.9 GB
DE
CyberNeurova DeepSeek V4 Flash abliterated
DeepSeek · audreyt
Params284B
Context1024K
Smallest86.7 GB
OP
OpenBuddy R10528DistillQwen 72B Preview1
Openbuddy · Cran-May
Params72.7B
Context195K
Smallest54.4 GB
LL
Esper-70b
Llama · backyardai
Params69B
Context4K
Q4_K_M41.4 GB
GL
cerebras/GLM-4.6-REAP-268B-A32B
GLM · unsloth
Params269B
Context198K
Q4_K_M162.5 GB
MI
Mistral 2x24B MOE Power Devstral Magistral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
CA
CalmeRys 78B Orpo v0.1
Calmerys · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
GL
GLM 4.5 Air REAP 82B A12B heretic
GLM · jtl11
Params82B
Context128K
Q4_K_M53.9 GB
TU
turbcat instruct 72b i1
Turbcat · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
OR
Ornith 1.5 35B A3B
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
TE
TeTO MS 8x7b iMat
Teto · Quant-Cartel
Params46.7B
Context32K
Q4_K_M28.4 GB
SY
Synthia 70B v1.1 i1
Synthia · mradermacher
Params69B
Context2K
Q4_K_M41.7 GB
QW
Huihui Qwen3.6 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
TE
TerminalHorizon 35B A3B
Terminalhorizon · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
DE
DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
HO
Holo4 35B A3B GSQ RCO
Holo · lavendercomputing
Params34.7B
Context256K
Smallest13.1 GB