Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
PR
Nohobby L3.3 Prikol 70B EXTRA
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
CH
Chronos Platinum 72B i1
Chronos · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Roleplay
IQ
IQuest Coder V1 40B Base Stage1
Iquest · mradermacher
Params39.8B
Context16K
Q4_K_M24.0 GB
CodingTool use
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Tetra04
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
FL
Flint APEX I NanoPlus V2.1
Flint · IsValorum
Params39.8B
Context256K
Smallest13.2 GB
CodingReasoningTool use
LL
Hermes-2-Theta-Llama-3-70B-32k
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
Tool use
QW
Qwen3.8 Flash Next
Qwen · pugant
Params177B
Context256K
Smallest81.5 GB
GGUF
GL
zai org GLM 4.7
GLM · bartowski
Params358B
Context198K
Q4_K_M218.5 GB
GGUF
LL
Llama-3-70b-Arimas-story-RP-V1.5
Llama · mradermacher
Params70.6B
Context256K
Q4_K_M42.5 GB
Roleplay
SA
Samantha 1.11 70B
Samantha · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
KA
Karakuri Lm 8x7b Instruct v0.1
Karakuri · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
LL
Llama Primus Nemotron 70B Instruct i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
OR
Ornith 1.5 35B Uncensored YMQ MTP
Ornith · dopaemon
Params35.5B
Context256K
Smallest12.0 GB
Vision
QW
Qwen3.6 35B A3B Abliterated v2
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
FA
FashionGPT 70B V1.2
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoningTool use
MI
MiniMax M2.1 REAP 172B A10B i1
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
ReasoningTool use
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Huihui Qwen3.5 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwopus3.6 35B A3B Coder
Qwopus · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use
QW
Qwen2.5 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen3.8 Flash Next APEX
Qwen · Atomic-Germ
Params177B
Context—
Smallest0.6 GB
GGUF
DO
dolphin 2.2 70B
Dolphin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GL
GLM 5.3 Flash
GLM · marcorez8
Params321B
Context1024K
Smallest0.0 GB
Vision
LL
Meta Llama 3.1 405B Instruct
Llama · bullerwins
Params410B
Context128K
Q4_K_M245.7 GB
GGUF
SE
T Search
Search · IsValorum
Params35.5B
Context256K
Smallest13.0 GB
ReasoningTool useVision
QW
SIQ 1 35B
Qwen · AlexWortega
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
GL
Huihui GLM 4.5V Abliterated
GLM · mradermacher
Params107B
Context64K
Q4_K_M70.4 GB
Vision
LL
Llama2 70B SharpBalance
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 3.3 70B o1 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Other sizes

Keep browsing