Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
BE
Beam 1.0 501B A23B
Beam · bartowski
Params501B
Context1024K
Q4_K_M314.5 GB
CodingReasoningTool use
LL
Dobby Unhinged Llama 3.3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
NO
jondurbin_nontoxic-bagel-34b-v0.2
Nontoxic · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
CodingRoleplay
IQ
IQuest Coder V1 40B Thinking Heretic
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
CodingReasoning
QW
qwen36 35b a3b distill
Qwen · freakyskittle
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
NE
Nex N2.5 Mini
Nex · IsValorum
Params34.7B
Context256K
Smallest14.6 GB
Vision
LL
Llama 3 Youko 70b Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
DE
deepseek llm 67b base
DeepSeek · TheBloke
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
QW
Qwen3.6 35B A3B heretic MTP IQ4 XS
Qwen · hermeticvm
Params35.5B
Context256K
Smallest19.2 GB
ReasoningTool use
QW
Qwen3.5 40B Holodeck Claude Deckard Picard Heretic
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
GE
Gemma 3 It Vl 40B Gemini Heretic Uncensored Thinking
Gemma · mradermacher
Params40B
Context128K
Q4_K_M24.5 GB
CodingReasoningRoleplay
HE
Hermes 4 405B
Hermes · bartowski
Params405B
Context128K
Q4_K_M243.1 GB
Tool use
LL
Meta Llama 3.1 70B Instruct
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
GGUF
KI
Kimi Dev 72B
Kimi · bartowski
Params72.7B
Context128K
Smallest23.7 GB
GGUF
DO
Dolphin 2.1 70B
Dolphin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DE
DeepSeek V4 Flash 0731 reap 200b
DeepSeek · puwaer
Params200B
Context—
Smallest0.3 GB
GGUF
QW
Qwen2.5 8x7B Vee Eight Coder Instruct 53B
Qwen · mradermacher
Params53.2B
Context32K
Q4_K_M32.4 GB
CodingTool use
XL
xLAM 8x7b R
Xlam · bartowski
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
QW
Qwen3.8 Flash Next
Qwen · batiai
Params177B
Context256K
Q4_K_M119.2 GB
GGUF
QW
Qwen2.5 Godzilla Coder V2 51B
Qwen · mradermacher
Params51B
Context32K
Q4_K_M30.7 GB
Coding
QW
Qwen3 Coder Next REAP 40B A3B
Qwen · mradermacher
Params41B
Context256K
Q4_K_M25.0 GB
Coding
ST
Strawberrylemonade 70B v1.1
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Citrus1.0 Llama 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
UD 2.0 Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · mfielding92
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningVision
EU
Eurus 70b sft fixed
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Reasoning
MI
yeungnlp_firefly-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
AN
Anubis 70B v1
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
openbuddy_openbuddy-mixtral-8x7b-v15.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.5 GB
GGUF
MI
MiniMax M3 Uncensored
Minimax · spiritfather
Params426B
Context1024K
Q4_K_M264.3 GB
GGUF
QW
Qwen3.6 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay

Other sizes

Keep browsing