Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama 3 70B Instruct GGUF v2
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
PO
Poro 34B i1
Poro · mradermacher
Params35.1B
Context7K
Q4_K_M22.4 GB
Coding
BE
4BeastsOfApocalypse
Beastsofapocalypse · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CodingReasoningTool use
HU
Huihui IQuest Coder V1 40B Instruct Abliterated
Huihui · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
CodingTool use
SA
Sage A1.5
Sage · el4
Params35.5B
Context256K
Smallest12.5 GB
ReasoningTool use
QW
Qwen3.6 35B A3B Heretic MOE v3
Qwen · DmitryDB
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
UN
fblgit_unaversal-8x7b-v1beta
Unaversal · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
QW
Whittle Qwen 3.8 35B A3B
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.3 GB
CodingReasoning
HO
Holo3 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3 53B A3B 2507 TOTAL RECALL v2 MASTER CODER
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
CodingReasoningTool use
XL
xLAM 8x22b R
Xlam · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
Tool use
OP
openbuddy-zen-56b-v21.2-32k
Openbuddy · mradermacher
Params56.7B
Context128K
Q4_K_M34.0 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · noctrex
Params34.7B
Context256K
Smallest20.3 GB
Vision
GI
Gilgamesh 72B
Gilgamesh · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
ST
strix rufipes 70b
Strix · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Logics SWE Qwen3.6 35B A3B
Qwen · prithivMLmods
Params34.7B
Context256K
Smallest18.1 GB
CodingReasoningTool use
PX
PXA Fusion4 35B
Pxa · poisonxa
Params35.5B
Context256K
Smallest11.2 GB
ReasoningTool use
QW
Swift1.5-Qwen3.8-Flash-Next
Qwen · poisonxa
Params180B
Context256K
Smallest83.2 GB
ReasoningTool use
PA
Yi pass 40B i1
Pass · mradermacher
Params40B
Context4K
Q4_K_M24.0 GB
GGUF
LZ
lzlv 70B
Lzlv · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LA
Laguna S 2.1 Uncensored Heretic
Laguna · llmfan46
Params118B
Context1024K
Q4_K_M73.0 GB
Vision
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
YI
Yi-34B-Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
MA
MAmmoTH2-8x7B-Plus
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
DE
Deacon-34B
Deacon · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
DE
DeepSeek V3.1 Terminus
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.2 GB
ReasoningTool use
OR
Ornith 1.5 122B
Ornith · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
ReasoningTool useVision
OR
Rys Saber
Ornstein · GestaltLabs
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
LO
Lotus 1
Lotus · yashsutorichat
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningRoleplayTool use
G9
G9v3 39A5B
linuxid10t
Params39B
Context128K
Q4_K_M23.6 GB
ReasoningTool use

Other sizes

Keep browsing