Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash Next Heretic Hybrid q4lean5
Qwen · the-shop
Params177B
Context256K
Smallest4.1 GB
Vision
DE
DeepSeek R1 Distill Llama 70B Uncensored v2
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
DE
DeepSeek V4 Pro 0813
DeepSeek · qtum
Params1570B
Context—
Smallest1.7 GB
GGUF
LL
Higgs-Llama-3-70B
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
OP
allenai_open-instruct-human-mix-65b
Open · TheBloke
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
MI
nousresearch_nous-hermes-2-mixtral-8x7b-sft
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
QW
Qwen3.6 35B A3B Heretic v2
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
QW
Qwen3.8 Flash Next Avalon
Qwen · freriadoc
Params107B
Context256K
Smallest1.5 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731
DeepSeek · 6block
Params284B
Context—
Smallest10.9 GB
GGUF
GR
Grok Oss Revenant 70B
Grok · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
DE
Deacon 34B
Deacon · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Qwen3.5-35B-A3B
Qwen · mudler
Params34.7B
Context256K
Smallest17.0 GB
GGUF
LL
Meta Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Meta-Llama-3-70B-Instruct
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NE
NVIDIA-Nemotron-3.5-Bolt-74B-DERISKED
Nemotron · freakyskittle
Params74B
Context1024K
Q4_K_M46.4 GB
Vision
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Infinity Instruct 7M 0729 Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
OR
Ornith 1.5 35B A3B 3MPER0RR Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
BA
Bagel Dpo 8x7b v0.2
Bagel · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingRoleplay
HU
Hunyuan A13B Instruct
Hunyuan · bartowski
Params80.4B
Context256K
Q4_K_M49.3 GB
GGUF
QW
Huihui Qwen3 Coder Next Opus 4.6 Reasoning Distilled abliterated
Qwen · Momix-44
Params80B
Context256K
Q4_K_M48.5 GB
CodingReasoning
PO
Poro 34B chat i1
Poro · mradermacher
Params35.1B
Context7K
Q4_K_M22.4 GB
GGUF
QW
Qwen3 Coder Next Opus 4.6 Reasoning Distilled
Qwen · samuelcardillo
Params80B
Context256K
Q4_K_M48.5 GB
CodingReasoning
NE
Nex N2.5 Mini Un
Nex · vikrant1123
Params34.7B
Context256K
Smallest13.5 GB
Vision
KA
Karnak
Karnak · mradermacher
Params40.7B
Context256K
Q4_K_M24.7 GB
GGUF
YI
Yi-34B-200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
AL
alfred 40B 1023
Alfred · TheBloke
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
VE
UI Venus Navi 72B
Venus · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
GGUF
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · therickcain
Params49.1B
Context1024K
Q4_K_M29.7 GB
Tool use

Other sizes

Keep browsing