Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LL
Meta Llama 3 70B Instruct GGUF v2
Llama · QuantFactory
Params70.6B
Context8K
Q4_K_M42.5 GB
PO
Poro 34B i1
Poro · mradermacher
Params35.1B
Context7K
Q4_K_M22.4 GB
BE
4BeastsOfApocalypse
Beastsofapocalypse · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
HU
Huihui IQuest Coder V1 40B Instruct Abliterated
Huihui · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
SA
Sage A1.5
Sage · el4
Params35.5B
Context256K
Smallest12.5 GB
QW
Qwen3.6 35B A3B Heretic MOE v3
Qwen · DmitryDB
Params35.5B
Context256K
Q4_K_M21.7 GB
UN
fblgit_unaversal-8x7b-v1beta
Unaversal · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
QW
Whittle Qwen 3.8 35B A3B
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.3 GB
HO
Holo3 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 53B A3B 2507 TOTAL RECALL v2 MASTER CODER
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
XL
xLAM 8x22b R
Xlam · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
OP
openbuddy-zen-56b-v21.2-32k
Openbuddy · mradermacher
Params56.7B
Context128K
Q4_K_M34.0 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · noctrex
Params34.7B
Context256K
Smallest20.3 GB
GI
Gilgamesh 72B
Gilgamesh · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
ST
strix rufipes 70b
Strix · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Logics SWE Qwen3.6 35B A3B
Qwen · prithivMLmods
Params34.7B
Context256K
Smallest18.1 GB
PX
PXA Fusion4 35B
Pxa · poisonxa
Params35.5B
Context256K
Smallest11.2 GB
QW
Swift1.5-Qwen3.8-Flash-Next
Qwen · poisonxa
Params180B
Context256K
Smallest83.2 GB
PA
Yi pass 40B i1
Pass · mradermacher
Params40B
Context4K
Q4_K_M24.0 GB
LZ
lzlv 70B
Lzlv · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LA
Laguna S 2.1 Uncensored Heretic
Laguna · llmfan46
Params118B
Context1024K
Q4_K_M73.0 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
YI
Yi-34B-Chat
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
MA
MAmmoTH2-8x7B-Plus
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
DE
Deacon-34B
Deacon · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
DE
DeepSeek V3.1 Terminus
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M409.2 GB
OR
Ornith 1.5 122B
Ornith · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
OR
Rys Saber
Ornstein · GestaltLabs
Params35.5B
Context256K
Q4_K_M21.7 GB
LO
Lotus 1
Lotus · yashsutorichat
Params34.7B
Context256K
Q4_K_M21.2 GB
G9
G9v3 39A5B
linuxid10t
Params39B
Context128K
Q4_K_M23.6 GB