Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 Flash Next Heretic Hybrid q4lean5
Qwen · the-shop
Params177B
Context256K
Smallest4.1 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored v2
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek V4 Pro 0813
DeepSeek · qtum
Params1570B
Context—
Smallest1.7 GB
LL
Higgs-Llama-3-70B
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
OP
allenai_open-instruct-human-mix-65b
Open · TheBloke
Params65B
Context2K
Q4_K_M39.3 GB
MI
nousresearch_nous-hermes-2-mixtral-8x7b-sft
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen3.6 35B A3B Heretic v2
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.8 Flash Next Avalon
Qwen · freriadoc
Params107B
Context256K
Smallest1.5 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · 6block
Params284B
Context—
Smallest10.9 GB
GR
Grok Oss Revenant 70B
Grok · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
Deacon 34B
Deacon · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen3.5-35B-A3B
Qwen · mudler
Params34.7B
Context256K
Smallest17.0 GB
LL
Meta Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Meta-Llama-3-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
NE
NVIDIA-Nemotron-3.5-Bolt-74B-DERISKED
Nemotron · freakyskittle
Params74B
Context1024K
Q4_K_M46.4 GB
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Infinity Instruct 7M 0729 Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
OR
Ornith 1.5 35B A3B 3MPER0RR Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
BA
Bagel Dpo 8x7b v0.2
Bagel · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
HU
Hunyuan A13B Instruct
Hunyuan · bartowski
Params80.4B
Context256K
Q4_K_M49.3 GB
QW
Huihui Qwen3 Coder Next Opus 4.6 Reasoning Distilled abliterated
Qwen · Momix-44
Params80B
Context256K
Q4_K_M48.5 GB
PO
Poro 34B chat i1
Poro · mradermacher
Params35.1B
Context7K
Q4_K_M22.4 GB
QW
Qwen3 Coder Next Opus 4.6 Reasoning Distilled
Qwen · samuelcardillo
Params80B
Context256K
Q4_K_M48.5 GB
NE
Nex N2.5 Mini Un
Nex · vikrant1123
Params34.7B
Context256K
Smallest13.5 GB
KA
Karnak
Karnak · mradermacher
Params40.7B
Context256K
Q4_K_M24.7 GB
YI
Yi-34B-200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
AL
alfred 40B 1023
Alfred · TheBloke
Params41.8B
Context2K
Q4_K_M25.5 GB
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
VE
UI Venus Navi 72B
Venus · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · therickcain
Params49.1B
Context1024K
Q4_K_M29.7 GB