Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-Coder-Next
Qwen · Mungert
Params79.7B
Context256K
Q4_K_M49.2 GB
CodingTool use
XL
xLAM 8x7b R
Xlam · legraphista
Params46.7B
Context32K
Smallest9.8 GB
Tool use
LL
Llama 3.3 70B Instruct Abliterated v2
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MA
L3.3 70B Magnum v4 SE
Magnum · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
OR
Tiel Coder 35B A3B APEX I NanoPlus
Ornith · IsValorum
Params34.7B
Context256K
Smallest12.6 GB
CodingReasoningTool use
HE
Hermes 4 70B
Hermes · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Qwen2.5 VL 72B Instruct
Qwen · bartowski
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
MI
Miqu 70B Alpaca DPO i1
Miqu · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
NE
Nex N2.5 Mini
Nex · gbuzhf
Params34.7B
Context256K
Smallest14.5 GB
Vision
LI
Ling Flash 2.0
Ling · bartowski
Params103B
Context32K
Q4_K_M62.6 GB
GGUF
WR
Wren
Wren · ohmysimo
Params117B
Context256K
Q4_K_M77.6 GB
GGUF
MI
Mimo-V2.5-Pro
Mimo · unsloth
Params1020B
Context1024K
Q4_K_M629.6 GB
Coding
QW
Qwen3.5 35B A3B Base
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.5 122B A10B Heretic
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
Vision
KA
Kat Coder v2.5 Dev
Kat · Myric
Params34.7B
Context256K
Smallest12.7 GB
Coding
KO
Kolibri 1 Heretic
Kolibri · mradermacher
Params78B
Context256K
Q4_K_M47.5 GB
Reasoning
CL
Clover 35B A3B Preview
Clover · na0x2c6
Params34.7B
Context128K
Q4_K_M21.8 GB
ReasoningTool use
CA
brucethemoose_capytessborosyi-34b-200k-dare-ties
Capytessborosyi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
EU
L3.1 70B Euryale v2.2
Euryale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OR
Ornith 1.5 35B A3B Uncensored
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
Carnice Qwen3.6 MoE 35B A3B APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
GGUF
DE
DeepSeek V4 Flash 0731 REAP 150b TQ3 4S
DeepSeek · Tinker-Stack
Params150B
Context—
Smallest0.2 GB
GGUF
MI
Minimax-M2.1
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
QW
Qwen3.8 Flash Next Orca Abliterated GSQ RCO Coder
Qwen · Abiray
Params117B
Context256K
Smallest58.7 GB
CodingReasoningTool use
KI
Kimi-K2.6
Kimi · unsloth
Params1030B
Context256K
Smallest340.5 GB
Vision
OC
occamy 1.0 APEX
Occamy · Accio-Lab
Params34.7B
Context256K
Smallest13.5 GB
Tool useVision
QW
Qwen3.8 Flash Next
Qwen · Cyronius
Params132B
Context256K
Smallest64.8 GB
Embedding
LL
CodeLlama 70B Python
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
OC
Occamy 1.0
Occamy · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
Tool useVision
QW
Qwen3 Next 80B A3B Thinking GRPO Uncensored
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.5 GB
Reasoning

Other sizes

Keep browsing