Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
hf 100 Llama 3.1 Spellbound StoryWriter 70b instruct 0.3 16bit
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
SP
Spoomplesmaxx Flash 35B A3
Spoomplesmaxx · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningRoleplayTool use
AS
AstroSage 70B
Astrosage · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
IN
L3.1 70b Inori
Inori · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ST
Cerebras Step 3.5 Flash REAP 149B A11B
Step · wimmmm
Params149B
Context256K
Smallest0.4 GB
GGUF
MI
MiniMax M2.5 REAP 139B A10B i1
Minimax · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
ReasoningTool use
EL
ElementalRP
Elementalrp · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Roleplay
VE
70B Vegatron Plastic
Vegatron · mradermacher
Params70.6B
Context64K
Q4_K_M43.7 GB
ReasoningTool use
CA
calme-2.4-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest31.8 GB
GGUF
BE
beomi Yi Ko 34B Chat Preview
Beomi · RichardErkhov
Params34.6B
Context2K
Q4_K_M20.8 GB
GGUF
QW
calme-2.2-qwen2.5-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
BI
BigBang v1 Heretic
Bigbang · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
QW
Qwen3.8 Flash Next Prune11264 124B
Qwen · Atomic-Germ
Params124B
Context256K
Q4_K_M83.8 GB
ReasoningTool useVision
GE
Gervasio 70b Portuguese Ptpt Decoder
Gervasio · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
CodingTool use
HY
Hypernova 60B 2605
Hypernova · mradermacher
Params58.7B
Context128K
Q4_K_M40.7 GB
GGUF
SE
Seed OSS 36B Instruct Abliterated
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 UD IQ2XS
DeepSeek · cliecy
Params748B
Context1024K
Smallest0.8 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · andreaborio
Params35B
Context256K
Smallest12.3 GB
GGUF
LL
Openbuddy Llama3.3 70b v24.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
CH
Chronos Platinum 72B
Chronos · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Roleplay
SO
Solar Open 69B REAP
Solar · mradermacher
Params69.4B
Context128K
Q4_K_M42.1 GB
Tool use
MI
mistralai.Mistral Small 4 119B 2603 BF16
Mistral · DevQuasar
Params119B
Context1024K
Q4_K_M72.2 GB
Tool use
SA
Salience 1.5 Pro
Salience · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use
ER
ERNIE 4.5 37B A3B Thinking Brainstorm20x
Ernie · mradermacher
Params37.2B
Context128K
Q4_K_M22.5 GB
CodingReasoningTool use
GL
GLM-4.5-Air
GLM · ggml-org
Params107B
Context128K
Q4_K_M63.6 GB
ReasoningTool use
KI
moonshotai.Kimi K2 Instruct BF16
Kimi · DevQuasar
Params1030B
Context128K
Q4_K_M620.6 GB
Tool use
QW
Heretic Qwen3 VL 235B A22B Instruct
Qwen · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
Tool useVision
HE
Hermes 4 70B Heretic
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningRoleplayTool use
OY
OYM Qimi 122B A10B K2.6
Oym · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
ReasoningTool useVision
TR
Trinity Large TrueBase i1
Trinity · mradermacher
Params399B
Context8K
Smallest0.5 GB
GGUF

Other sizes

Keep browsing