Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
NousResearch Hermes 2 Pro Llama 3 70B
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Bioinspired Llama 3 1 70B 128k Alpha
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama3-70B-Fireplace
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
INFRL Qwen2.5 VL 72B Preview ggufs fully quantized
Qwen · GeorgyGUF
Params72.7B
Context125K
Q4_K_M47.4 GB
Tool useVision
ZE
Zen4 Coder Pro
Zen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
CodingTool use
KI
moonshotai.Kimi K2.7 Code
Kimi · DevQuasar
Params1030B
Context256K
Q4_K_M620.6 GB
CodingReasoningTool use
QW
Qwen3.8 Flash Next
Qwen · gguf
Params177B
Context256K
Q4_K_M119.6 GB
ReasoningTool useVision
MI
Mistral Large Instruct 2407
Mistral · RichardErkhov
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
KA
KAT Ornith Coder 35B A3B
Kat · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
CodingReasoningTool use
LL
Reflection Llama 3.1 70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OR
Ornith 1.0 35B A3B MXFP4 MOE Hybrid Imatrix
Ornith · jashepp
Params34.7B
Context256K
Smallest0.2 GB
GGUF
QW
Huihui Qwen3 Coder 480B A35B Instruct Abliterated
Qwen · tachyphylaxis
Params480B
Context256K
Q4_K_M290.1 GB
CodingTool use
CH
L3.3 Chimera Prime 70B
Chimera · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
QW
qwen36 35b chs medical research
Qwen · SyrupOfMaple
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
QW
SC117 Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · jaromer
Params177B
Context256K
Smallest0.9 GB
GGUF
AG
AGW 35B
Agw · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool use
LL
meta-llama-65b
Llama · TheBloke
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
MA
Magnum v2 123b
Magnum · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
QW
coachwhip models
Qwen · vinnj
Params79.7B
Context256K
Smallest14.2 GB
CodingTool use
OR
Ornith 1.5 35B A3B NVFP4
Ornith · TizzyT566
Params35.5B
Context256K
Smallest23.9 GB
ReasoningTool useVision
DP
DPE 70b Ckpts
Dpe · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningRoleplay
LL
SunsetBoulevard
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
CE
Cerebrum 1.0 8x7b iMat
Cerebrum · Quant-Cartel
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
HU
Huihui3.5 67B A3B
Huihui · mradermacher
Params66.9B
Context256K
Q4_K_M40.8 GB
ReasoningTool useVision
AN
TheDrummer Anubis Pro 105B v1
Anubis · bartowski
Params105B
Context128K
Q4_K_M63.0 GB
Tool use
QW
Qwen3.6 35B A3B AntiLoop
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
QW
Qwen3.6 35B A3B Aether
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
LZ
lzlv 70b fp16 hf i1
Lzlv · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
YI
Platypus Yi 34b
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes V6 Dequantized
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision

Other sizes

Keep browsing