Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.5 35B RpRMax v1
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.8 Flash Coder APEX I NanoPlus
Qwen · IsValorum
Params42.6B
Context256K
Smallest18.3 GB
QW
Sakura Qwen3.8 Flash Next Swift 2.5bit 352E 32GB
Qwen · webmp3
Params139B
Context256K
Smallest57.0 GB
SW
Swallow-70b-instruct-v0.1
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
MI
MiniMax M2.1
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
HU
Huihui Agents A1 Abliterated
Huihui · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
Devstral 2 123B Instruct 2512
Mistral · bartowski
Params125B
Context256K
Q4_K_M74.9 GB
QW
Qwen3 235B A22B Abliterated
Qwen · mradermacher
Params235B
Context40K
Q4_K_M142.2 GB
SA
Sage A1.5 APEX I NanoPlus V2.1
Sage · IsValorum
Params35.5B
Context256K
Smallest13.0 GB
QW
Qwen3.8 Flash Next Heretic 2
Qwen · Deritak
Params128B
Context256K
Smallest91.5 GB
EL
ElementalRP i1
Elementalrp · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
TO
tokyotech llm Swallow 70b instruct v0.1
Tokyotech · mmnga
Params69.2B
Context4K
Q4_K_M41.5 GB
KA
KAT Ornith HERO 35B A3B Fusion
Kat · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
MI
MiniMax-M3.1-Flash
Minimax · AtomicChat
Params426B
Context1024K
Smallest112.2 GB
EU
Euryale 1.3 L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
HO
K2 Horizon 32B
Horizon · IFM
Params34.8B
Context512K
Q4_K_M21.1 GB
MU
Muse Spark Open 816B A42B
Muse · ggml-org
Params816B
Context—
Smallest0.8 GB
OR
Ornith 1.5 397B
Ornith · bartowski
Params397B
Context256K
Q4_K_M241.8 GB
LL
Meta Llama 3.1 405B Instruct
Llama · ThomasBaruzier
Params406B
Context128K
Q4_K_M243.1 GB
DO
Donnager 70B v1 i1
Donnager · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
YI
Faro Yi 34B DPO i1
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
LL
Llama 2 70b Chat Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen2.5 Math 72B Instruct
Qwen · bartowski
Params72.7B
Context4K
Q4_K_M47.4 GB
AI
Airoboros L2 70B 3.1.2
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
Mistral Medium 3.5 128B
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
CR
Crunchy onion i1
Crunchy · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Millie 1.1 35B A3B Ternary
Qwen · llmsforall
Params34.7B
Context—
Smallest0.3 GB
DA
Darwin 36B Opus ABLITERATED HERETIC
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB