Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LL
Valkyrie 49B v2.1
Llama · TheDrummer
Params50B
Context128K
Q4_K_M30.2 GB
MI
MiMo V2 Flash
Mimo · bartowski
Params309B
Context256K
Q4_K_M187.1 GB
LL
Llama3 TenyxChat 70B i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GE
L3.3 GeneticLemonade Unleashed 70B i1
Geneticlemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
MiniMax M2.1
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
LO
LongCat Flash Lite Sparse Uncensored Heretic Native MTP And LSA Preserved
Longcat · llmfan46
Params69B
Context960K
Q4_K_M41.2 GB
DE
deepseek llm 67b chat
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
MA
magnum-72b-v1
Magnum · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.8 Flash Next GGUF UD Q4 K XL
Qwen · KENIC-1
Params177B
Context256K
Smallest4.1 GB
GP
Gpt Oss 120b Heretic v1
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
QW
Qwen2.5-VL-72B-Instruct
Qwen · Mungert
Params73B
Context125K
Q4_K_M47.7 GB
QW
Qwen3.8-Flash-Next-102B-A5B-Niwaki-v2.4-3bit
Qwen · neopolita
Params108B
Context256K
Smallest43.8 GB
LL
PlatYi 34B Llama Q v3
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
MI
Miqu MS 70B i1
Miqu · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
QW
G Man 35B A3B abliterated mixed q2k MTP
Qwopus · xero0000
Params35.5B
Context256K
Smallest18.7 GB
QW
Qwen2.5 72B Instruct Heretic
Qwen · brindusa
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen2.5 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
AN
AntAngelMed
Antangelmed · mradermacher
Params103B
Context32K
Q4_K_M62.4 GB
IM
0x01 8x7b iMat
Imat · Quant-Cartel
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen 72B Chat
Qwen · mradermacher
Params72.3B
Context32K
Q4_K_M45.1 GB
SC
Scal-lite-60b-code-math
Scal · mradermacher
Params73.8B
Context128K
Q4_K_M55.5 GB
DA
Dark Scarlett v1.0 35B A3B
Dark · ReadyArt
Params35.5B
Context256K
Q4_K_M22.9 GB
NE
Nex-N2.5-mini
Nex · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
HO
K2-Horizon-MoVA-36B-A4B
Horizon · InfinimindCreations
Params37.4B
Context512K
Q4_K_M22.4 GB
FO
FoxEngineAi Mega Destroyer 8x7B
Foxengineai · RichardErkhov
Params46.7B
Context32K
Q4_K_M28.4 GB
LO
LongCat Flash Lite Uncensored Heretic Native MTP Preserved
Longcat · llmfan46
Params69.1B
Context320K
Q4_K_M40.3 GB
CA
calme-2.1-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
LL
sheep duck llama 2 70B v1.1
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
ME
Melinoe Next 80B A3B Thinking Diluted v0
Melinoe · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
MI
Mistral Small 119B 2603 ik
Mistral · AlexanderKyng
Params119B
Context1024K
Smallest67.2 GB