Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LL
Llama3.1 70b Cpt Sea Lionv3 Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Apodex 1.1 mini
Qwen · vcruz305
Params34.7B
Context256K
Q4_K_M23.4 GB
VE
UI Venus Ground 72B
Venus · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
ME
Melusine 103b i1
Melusine · mradermacher
Params103B
Context32K
Smallest22.0 GB
SH
shuttle 3
Shuttle · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
YI
ChatAllInOne Yi 34B 200K V1
Yi · second-state
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
SignOfFour
Qwen · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GP
Gpt Oss 120b Uncensored xCloud
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
MI
brillibits_instruct_mixtral-8x7b-v0.1_dolly15k
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
QW
Qwen3.6 35B A3B NVFP4 Src
Qwen · LibertAIDAI
Params34.7B
Context256K
Q4_K_M19.8 GB
WA
Watt Tool 70B
Watt · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
JA
AI21 Jamba2 Mini
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
ST
Strawberrylemonade L3 70B v1.2
Strawberrylemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GR
GRM 3.2 Sky
Grm · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
perplexity ai r1 1776 distill llama 70b
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Cyberneurova Qwen3.8 Flash Next
Qwen · spiritfather
Params177B
Context256K
Q4_K_M119.2 GB
MI
tosilos 128b
Mistral · nesilabs
Params125B
Context256K
Q4_K_M74.9 GB
GR
Groot 65B A6B 261023
Groot · GrootTeam
Params117B
Context256K
Q4_K_M78.7 GB
YI
mlinmg_sg-raccoon-yi-55b-200k
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
LI
LING 3.0 FLASH ABLITERATED
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
GL
Zai org.GLM 5.3 Flash
GLM · DevQuasar
Params313B
Context1024K
Q4_K_M189.0 GB
BE
34b beta2
Beta · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
KA
KAT Coder V2.5 Dev MTP
Kat · gbuzhf
Params35.5B
Context256K
Smallest14.4 GB
FL
flint uncensored
Flint · Octopusman388
Params39.8B
Context256K
Q4_K_M24.2 GB
UM
Umbra-v3-MoE-4x11b-2ex
Umbra · mradermacher
Params36.1B
Context32K
Q4_K_M21.8 GB
NO
Nous Puffin 70B
Nous · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GP
gpt oss 120b ultra heretic
gpt-oss · llmfan46
Params117B
Context128K
Smallest65.4 GB
MI
DonutHole 8x7B
Mistral · ycros
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen3.6 35B A3B heretic
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB