Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LL
NousResearch Hermes 2 Pro Llama 3 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Bioinspired Llama 3 1 70B 128k Alpha
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3-70B-Fireplace
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
INFRL Qwen2.5 VL 72B Preview ggufs fully quantized
Qwen · GeorgyGUF
Params72.7B
Context125K
Q4_K_M47.4 GB
ZE
Zen4 Coder Pro
Zen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
KI
moonshotai.Kimi K2.7 Code
Kimi · DevQuasar
Params1030B
Context256K
Q4_K_M620.6 GB
QW
Qwen3.8 Flash Next
Qwen · gguf
Params177B
Context256K
Q4_K_M119.6 GB
MI
Mistral Large Instruct 2407
Mistral · RichardErkhov
Params123B
Context128K
Q4_K_M73.2 GB
KA
KAT Ornith Coder 35B A3B
Kat · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
LL
Reflection Llama 3.1 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
Ornith 1.0 35B A3B MXFP4 MOE Hybrid Imatrix
Ornith · jashepp
Params34.7B
Context256K
Smallest0.2 GB
QW
Huihui Qwen3 Coder 480B A35B Instruct Abliterated
Qwen · tachyphylaxis
Params480B
Context256K
Q4_K_M290.1 GB
CH
L3.3 Chimera Prime 70B
Chimera · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
qwen36 35b chs medical research
Qwen · SyrupOfMaple
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
SC117 Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · jaromer
Params177B
Context256K
Smallest0.9 GB
AG
AGW 35B
Agw · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
meta-llama-65b
Llama · TheBloke
Params65.3B
Context2K
Q4_K_M39.3 GB
MA
Magnum v2 123b
Magnum · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
QW
coachwhip models
Qwen · vinnj
Params79.7B
Context256K
Smallest14.2 GB
OR
Ornith 1.5 35B A3B NVFP4
Ornith · TizzyT566
Params35.5B
Context256K
Smallest23.9 GB
DP
DPE 70b Ckpts
Dpe · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
SunsetBoulevard
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
CE
Cerebrum 1.0 8x7b iMat
Cerebrum · Quant-Cartel
Params46.7B
Context32K
Q4_K_M28.4 GB
HU
Huihui3.5 67B A3B
Huihui · mradermacher
Params66.9B
Context256K
Q4_K_M40.8 GB
AN
TheDrummer Anubis Pro 105B v1
Anubis · bartowski
Params105B
Context128K
Q4_K_M63.0 GB
QW
Qwen3.6 35B A3B AntiLoop
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.6 35B A3B Aether
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
LZ
lzlv 70b fp16 hf i1
Lzlv · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
YI
Platypus Yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes V6 Dequantized
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB