Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Valkyrie 49B v2.1
Llama · TheDrummer
Params50B
Context128K
Q4_K_M30.2 GB
GGUF
MI
MiMo V2 Flash
Mimo · bartowski
Params309B
Context256K
Q4_K_M187.1 GB
ReasoningTool use
LL
Llama3 TenyxChat 70B i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GE
L3.3 GeneticLemonade Unleashed 70B i1
Geneticlemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
MiniMax M2.1
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
GGUF
LO
LongCat Flash Lite Sparse Uncensored Heretic Native MTP And LSA Preserved
Longcat · llmfan46
Params69B
Context960K
Q4_K_M41.2 GB
GGUF
DE
deepseek llm 67b chat
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
MA
magnum-72b-v1
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen3.8 Flash Next GGUF UD Q4 K XL
Qwen · KENIC-1
Params177B
Context256K
Smallest4.1 GB
Vision
GP
Gpt Oss 120b Heretic v1
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
Tool use
QW
Qwen2.5-VL-72B-Instruct
Qwen · Mungert
Params73B
Context125K
Q4_K_M47.7 GB
Vision
QW
Qwen3.8-Flash-Next-102B-A5B-Niwaki-v2.4-3bit
Qwen · neopolita
Params108B
Context256K
Smallest43.8 GB
GGUF
LL
PlatYi 34B Llama Q v3
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
MI
Miqu MS 70B i1
Miqu · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
QW
G Man 35B A3B abliterated mixed q2k MTP
Qwopus · xero0000
Params35.5B
Context256K
Smallest18.7 GB
Coding
QW
Qwen2.5 72B Instruct Heretic
Qwen · brindusa
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen2.5 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
AN
AntAngelMed
Antangelmed · mradermacher
Params103B
Context32K
Q4_K_M62.4 GB
GGUF
IM
0x01 8x7b iMat
Imat · Quant-Cartel
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
QW
Qwen 72B Chat
Qwen · mradermacher
Params72.3B
Context32K
Q4_K_M45.1 GB
GGUF
SC
Scal-lite-60b-code-math
Scal · mradermacher
Params73.8B
Context128K
Q4_K_M55.5 GB
CodingTool use
DA
Dark Scarlett v1.0 35B A3B
Dark · ReadyArt
Params35.5B
Context256K
Q4_K_M22.9 GB
ReasoningRoleplayTool use
NE
Nex-N2.5-mini
Nex · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
ReasoningTool useVision
HO
K2-Horizon-MoVA-36B-A4B
Horizon · InfinimindCreations
Params37.4B
Context512K
Q4_K_M22.4 GB
GGUF
FO
FoxEngineAi Mega Destroyer 8x7B
Foxengineai · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LO
LongCat Flash Lite Uncensored Heretic Native MTP Preserved
Longcat · llmfan46
Params69.1B
Context320K
Q4_K_M40.3 GB
GGUF
CA
calme-2.1-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
LL
sheep duck llama 2 70B v1.1
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
ME
Melinoe Next 80B A3B Thinking Diluted v0
Melinoe · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
ReasoningTool use
MI
Mistral Small 119B 2603 ik
Mistral · AlexanderKyng
Params119B
Context1024K
Smallest67.2 GB
Tool useVision

Other sizes

Keep browsing