Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
Gpt Oss 120b
gpt-oss · DavidAU
Params117B
Context128K
Smallest62.8 GB
CodingReasoning
FR
Frontis MA1 35B
Frontis · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
EV
L3.3 MS Evalebis 70b
Evalebis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
Coding
YI
dolphin-2_2-yi-34b
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
LL
Llama 3.1 SauerkrautLM 70b Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QU
QuartetAnemoi-70B-t0.0001
Quartetanemoi · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.5 35B A3B
Qwen · titan0115
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
LA
Laguna S 2.1
Laguna · AtomicChat
Params118B
Context1024K
Q4_K_M71.2 GB
ReasoningTool use
QW
Qwen2.5 72B Instruct Abliterated
Qwen · Thaurock
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen3.6 35B A3B StyleTune
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
RoleplayVision
ST
Step 3.5 Flash
Step · bartowski
Params197B
Context256K
Q4_K_M119.9 GB
GGUF
SK
Skyfall 36B V2A
Skyfall · TheDrummer
Params36.9B
Context32K
Q4_K_M22.4 GB
GGUF
TA
UI TARS 72B SFT
Tars · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Vision
ST
Step-3.7
Step · mudler
Params197B
Context256K
Smallest72.9 GB
Vision
TR
Trinity Large Preview
Trinity · bartowski
Params399B
Context256K
Q4_K_M241.6 GB
GGUF
IN
Index Translate 35B A3B Preview
Index · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
LL
Llama 2 70b Chat Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
dolphin-2.9.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.5 122B A10B Heretic v2
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningTool useVision
HU
Huozi3.5
Huozi · mradermacher
Params46.9B
Context32K
Q4_K_M28.6 GB
GGUF
DA
Darwin 36B Opus
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
BE
Lite Beam 1.0 501B A23B IQS XXS
Beam · tablinum
Params501B
Context1024K
Smallest144.4 GB
ReasoningTool use
TH
Thomson 1.0 Small
Thomson · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
MI
MiMo V2.5
Mimo · bartowski
Params310B
Context1024K
Q4_K_M188.8 GB
Vision
QW
Qwen3 Coder 53B A3B Instruct TOTAL RECALL v2 MASTER CODER L
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
CodingReasoningTool use
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · longsesh
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningVision
LL
hf 100 Llama 3.1 Spellbound StoryWriter 0.1 vllm 16bit
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Other sizes

Keep browsing