Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
BE
Beam 1.0 501B A23B
Beam · bartowski
Params501B
Context1024K
Q4_K_M314.5 GB
LL
Dobby Unhinged Llama 3.3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
NO
jondurbin_nontoxic-bagel-34b-v0.2
Nontoxic · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
IQ
IQuest Coder V1 40B Thinking Heretic
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
QW
qwen36 35b a3b distill
Qwen · freakyskittle
Params35.5B
Context256K
Q4_K_M21.7 GB
NE
Nex N2.5 Mini
Nex · IsValorum
Params34.7B
Context256K
Smallest14.6 GB
LL
Llama 3 Youko 70b Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
DE
deepseek llm 67b base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
QW
Qwen3.6 35B A3B heretic MTP IQ4 XS
Qwen · hermeticvm
Params35.5B
Context256K
Smallest19.2 GB
QW
Qwen3.5 40B Holodeck Claude Deckard Picard Heretic
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
GE
Gemma 3 It Vl 40B Gemini Heretic Uncensored Thinking
Gemma · mradermacher
Params40B
Context128K
Q4_K_M24.5 GB
HE
Hermes 4 405B
Hermes · bartowski
Params405B
Context128K
Q4_K_M243.1 GB
LL
Meta Llama 3.1 70B Instruct
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
KI
Kimi Dev 72B
Kimi · bartowski
Params72.7B
Context128K
Smallest23.7 GB
DO
Dolphin 2.1 70B
Dolphin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
DE
DeepSeek V4 Flash 0731 reap 200b
DeepSeek · puwaer
Params200B
Context—
Smallest0.3 GB
QW
Qwen2.5 8x7B Vee Eight Coder Instruct 53B
Qwen · mradermacher
Params53.2B
Context32K
Q4_K_M32.4 GB
XL
xLAM 8x7b R
Xlam · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen3.8 Flash Next
Qwen · batiai
Params177B
Context256K
Q4_K_M119.2 GB
QW
Qwen2.5 Godzilla Coder V2 51B
Qwen · mradermacher
Params51B
Context32K
Q4_K_M30.7 GB
QW
Qwen3 Coder Next REAP 40B A3B
Qwen · mradermacher
Params41B
Context256K
Q4_K_M25.0 GB
ST
Strawberrylemonade 70B v1.1
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Citrus1.0 Llama 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
UD 2.0 Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · mfielding92
Params34.7B
Context256K
Q4_K_M22.1 GB
EU
Eurus 70b sft fixed
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
MI
yeungnlp_firefly-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
AN
Anubis 70B v1
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
openbuddy_openbuddy-mixtral-8x7b-v15.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
MI
MiniMax M3 Uncensored
Minimax · spiritfather
Params426B
Context1024K
Q4_K_M264.3 GB
QW
Qwen3.6 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB