Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
OM
Omega_Sapphira_Joyous L3.3 70B v1.1
Omega · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params102B
Context1024K
Smallest99.1 GB
LL
llama3 42b v0 i1
Llama · mradermacher
Params43.2B
Context8K
Q4_K_M26.1 GB
QW
Qwen2.5 8x7B Vee Eight Coder Instruct 53B 128k Ctx
Qwen · mradermacher
Params53.2B
Context128K
Q4_K_M32.4 GB
LL
Reflection Llama 3.1 70B
Llama · leafspark
Params70.6B
Context128K
Smallest15.3 GB
QW
Qwen2.5 QwQ 37B Eureka Triple Cubed i1
Qwen · mradermacher
Params36.7B
Context128K
Q4_K_M22.2 GB
LL
grok oss Revenant 70B
Llama · c4tdr0ut
Params70.6B
Context128K
Q4_K_M42.5 GB
AR
ArcaneEntanglement model64 70b
Arcaneentanglement · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · loscrossos
Params177B
Context256K
Smallest1.2 GB
LL
Llama 3 3 Nemotron Super 49B v1 5 i1
Llama · mradermacher
Params49.9B
Context128K
Q4_K_M30.2 GB
GL
GLM 5.3 Flash
GLM · rax4901
Params321B
Context1024K
Smallest93.1 GB
QW
Qwen3.6 35B A3B Brainwaves Nex
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GL
GLM 4.5 Iceblink 106B A12B
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
DE
DeepSeek V4.1 Flash DS4 IQ2
DeepSeek · ivanfioravanti
Params755B
Context—
Smallest1.0 GB
QW
Huihui Qwen3.8 Flash Next abliterated
Qwen · robertbschuette
Params177B
Context256K
Smallest68.2 GB
AS
Assistant_Pepe_70B
Assistant · bartowski
Params70.6B
Context128K
Q4_K_M44.0 GB
JA
My Jarvis 72b
Jarvis · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
MI
lightblue Karasu Mixtral 8x22B v0.1
Mistral · mmnga
Params141B
Context64K
Smallest29.6 GB
AL
ALIA 40b
Alia · mradermacher
Params40.4B
Context4K
Q4_K_M24.6 GB
GL
GLM-4.5-Air-Derestricted
GLM · ddh0
Params110B
Context128K
Smallest68.6 GB
QW
Qwen3.6-35B-A3B-BUDGET-13.5GiB-QAT
Qwen · lmcoleman
Params35.5B
Context256K
Smallest14.5 GB
MI
MiniMax M2.1 REAP 30
Minimax · mradermacher
Params162B
Context192K
Q4_K_M98.0 GB
QW
Qwen2 Math 72B Instruct
Qwen · mradermacher
Params72.7B
Context4K
Q4_K_M47.4 GB
QW
Heretic Qwen3 VL 235B A22B Instruct i1
Qwen · mradermacher
Params235B
Context—
Smallest0.5 GB
OR
Ornith 1.5 35B A3B Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
AI
Airoboros 65b Gpt4 1.4
Airoboros · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
QW
Qwen 72B
Qwen · mradermacher
Params72.3B
Context32K
Q4_K_M45.1 GB
HO
Holo4 35B A3B Heretic GSQ RCO
Holo · lavendercomputing
Params34.7B
Context256K
Smallest0.9 GB
QW
XORTRON XPRT3 FAST
Qwen · darkc0de
Params34.7B
Context256K
Smallest24.7 GB
GP
Gpt Oss 120b Guardpoint
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB