Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
YI
Yi 34B GiftedConvo merged
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
ER
baidu.ERNIE 4.5 300B A47B PT
Ernie · DevQuasar
Params300B
Context128K
Q4_K_M180.2 GB
GGUF
QW
Qwen3.6 35B A3B Abliterated MAX
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningVision
QW
Rombo LLM V3.0 Qwen 72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
ReasoningTool use
SA
TheSkullery L3.3 exp unnamed model 70b v0.5
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
GR
GritLM 8x7B KTO
Gritlm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
OR
Ornith 1.5 35B A3B Heretic Ja
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LL
MultiPL-T-CodeLlama_70b
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Coding
QW
Qwen3 53B A3B 2507 TOTAL RECALL v2 MASTER CODER
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
CodingReasoningTool use
IN
InternVL2_5 78B
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool use
GE
Gemma 3 It Vl 40B Gemini Heretic Uncensored Thinking
Gemma · mradermacher
Params40B
Context128K
Q4_K_M24.5 GB
CodingReasoningRoleplay
DE
DeepSeek V4 Flash Vision Exp Abliterated
DeepSeek · audreyt
Params284B
Context1024K
Smallest86.7 GB
ReasoningTool useVision
BA
Babel 83B Chat
Babel · bartowski
Params83.2B
Context128K
Q4_K_M54.2 GB
Tool use
GL
GLM 5.3 Flash
GLM · Dgvdhb
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
OC
Occamy 1.0
Occamy · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool useVision
QW
Qwen3 VL 235B A22B Thinking Heretic
Qwen · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningTool useVision
PE
perlthoughts_chupacabra-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
QW
Qwen3 Next 80B A3B Instruct
Qwen · John1604
Params79.7B
Context256K
Q4_K_M48.4 GB
Tool use
TA
UI TARS 72B DPO
Tars · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
Vision
SE
SEMIKONG-70B-v2
Semikong · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · sleepyeldrazi
Params177B
Context256K
Smallest1.2 GB
ReasoningTool use
QW
Qwen3.6 35B v2 MoE Ablit Heretic Uncensor Hermes MTP Vision Llama
Qwen · oktayd
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningRoleplayTool use
GL
GLM-5.3-Flash
GLM · vultr
Params313B
Context1024K
Q4_K_M208.2 GB
ReasoningTool useVision
YI
Yi-1.5-34B-Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
PatronusAI Llama 3 Patronus Lynx 70B Instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
DE
DeepSeek V4 Flash 0731 REAP
DeepSeek · heath0xFF
Params180B
Context1024K
Q4_K_M109.0 GB
GGUF
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · taurusduan
Params284B
Context—
Smallest135.3 GB
GGUF
QW
AgentMercury Qwen3.5 35B A3B SAO
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool use
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · cc1244578151
Params177B
Context256K
Smallest0.9 GB
GGUF
AP
Apodex 1.1 Mini
Apodex · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF

Other sizes

Keep browsing