Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
YI
Yi 34B GiftedConvo merged
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
ER
baidu.ERNIE 4.5 300B A47B PT
Ernie · DevQuasar
Params300B
Context128K
Q4_K_M180.2 GB
QW
Qwen3.6 35B A3B Abliterated MAX
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Rombo LLM V3.0 Qwen 72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
SA
TheSkullery L3.3 exp unnamed model 70b v0.5
San · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GR
GritLM 8x7B KTO
Gritlm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
OR
Ornith 1.5 35B A3B Heretic Ja
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
MultiPL-T-CodeLlama_70b
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
QW
Qwen3 53B A3B 2507 TOTAL RECALL v2 MASTER CODER
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
IN
InternVL2_5 78B
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GE
Gemma 3 It Vl 40B Gemini Heretic Uncensored Thinking
Gemma · mradermacher
Params40B
Context128K
Q4_K_M24.5 GB
DE
DeepSeek V4 Flash Vision Exp Abliterated
DeepSeek · audreyt
Params284B
Context1024K
Smallest86.7 GB
BA
Babel 83B Chat
Babel · bartowski
Params83.2B
Context128K
Q4_K_M54.2 GB
GL
GLM 5.3 Flash
GLM · Dgvdhb
Params321B
Context1024K
Smallest93.1 GB
OC
Occamy 1.0
Occamy · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 VL 235B A22B Thinking Heretic
Qwen · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
PE
perlthoughts_chupacabra-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
QW
Qwen3 Next 80B A3B Instruct
Qwen · John1604
Params79.7B
Context256K
Q4_K_M48.4 GB
TA
UI TARS 72B DPO
Tars · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
SE
SEMIKONG-70B-v2
Semikong · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next
Qwen · sleepyeldrazi
Params177B
Context256K
Smallest1.2 GB
QW
Qwen3.6 35B v2 MoE Ablit Heretic Uncensor Hermes MTP Vision Llama
Qwen · oktayd
Params35.5B
Context256K
Q4_K_M21.7 GB
GL
GLM-5.3-Flash
GLM · vultr
Params313B
Context1024K
Q4_K_M208.2 GB
YI
Yi-1.5-34B-Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
PatronusAI Llama 3 Patronus Lynx 70B Instruct
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
DE
DeepSeek V4 Flash 0731 REAP
DeepSeek · heath0xFF
Params180B
Context1024K
Q4_K_M109.0 GB
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · taurusduan
Params284B
Context—
Smallest135.3 GB
QW
AgentMercury Qwen3.5 35B A3B SAO
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · cc1244578151
Params177B
Context256K
Smallest0.9 GB
AP
Apodex 1.1 Mini
Apodex · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB