Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · andyjack
Params34.7B
Context256K
Smallest19.8 GB
Vision
PE
Pearl 34B ties
Pearl · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL PDK V
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoningTool use
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · Justbackup
Params284B
Context—
Smallest10.9 GB
GGUF
DE
DeepSeek R1 Zero BF16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.4 GB
Reasoning
ST
Step 3.5 Flash REAP 121B A11B i1
Step · mradermacher
Params121B
Context256K
Q4_K_M72.8 GB
ReasoningTool use
QW
LuffyTheFox Qwen3.6 35B A3B Uncensored Wasserstein
Qwen · CCSSNE
Params34.7B
Context256K
Smallest11.7 GB
ReasoningTool useVision
JA
Jais Adapted 70b
Jais · mradermacher
Params69.5B
Context4K
Q4_K_M41.8 GB
Coding
DA
Steelskull L3.3 Damascus R1
Damascus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
BE
34b beta i1
Beta · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
BI
BigQwen2.5 Echo 47B Instruct
Bigqwen · bartowski
Params47.4B
Context32K
Q4_K_M28.6 GB
GGUF
IN
Yi-Ko-34B-Instruct
Instruct · mradermacher
Params34.6B
Context4K
Q4_K_M20.8 GB
GGUF
AI
airoboros-65b-gpt4-2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
MI
SauerkrautLM Mixtral 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
VE
VerA Etheria 55b
Vera · mradermacher
Params55.6B
Context195K
Q4_K_M33.9 GB
GGUF
DE
CyberNeurova DeepSeek V4 Flash abliterated
DeepSeek · audreyt
Params284B
Context1024K
Smallest86.7 GB
GGUF
OP
OpenBuddy R10528DistillQwen 72B Preview1
Openbuddy · Cran-May
Params72.7B
Context195K
Smallest54.4 GB
ReasoningTool use
LL
Esper-70b
Llama · backyardai
Params69B
Context4K
Q4_K_M41.4 GB
Coding
GL
cerebras/GLM-4.6-REAP-268B-A32B
GLM · unsloth
Params269B
Context198K
Q4_K_M162.5 GB
ReasoningTool use
MI
Mistral 2x24B MOE Power Devstral Magistral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
CodingReasoningTool use
CA
CalmeRys 78B Orpo v0.1
Calmerys · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
GGUF
GL
GLM 4.5 Air REAP 82B A12B heretic
GLM · jtl11
Params82B
Context128K
Q4_K_M53.9 GB
GGUF
TU
turbcat instruct 72b i1
Turbcat · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
OR
Ornith 1.5 35B A3B
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
TE
TeTO MS 8x7b iMat
Teto · Quant-Cartel
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
SY
Synthia 70B v1.1 i1
Synthia · mradermacher
Params69B
Context2K
Q4_K_M41.7 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
TE
TerminalHorizon 35B A3B
Terminalhorizon · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
HO
Holo4 35B A3B GSQ RCO
Holo · lavendercomputing
Params34.7B
Context256K
Smallest13.1 GB
ReasoningTool useVision

Other sizes

Keep browsing