Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LL
hf 100 Llama 3.1 Spellbound StoryWriter 70b instruct 0.3 16bit
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
SP
Spoomplesmaxx Flash 35B A3
Spoomplesmaxx · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
AS
AstroSage 70B
Astrosage · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
IN
L3.1 70b Inori
Inori · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ST
Cerebras Step 3.5 Flash REAP 149B A11B
Step · wimmmm
Params149B
Context256K
Smallest0.4 GB
MI
MiniMax M2.5 REAP 139B A10B i1
Minimax · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
EL
ElementalRP
Elementalrp · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
VE
70B Vegatron Plastic
Vegatron · mradermacher
Params70.6B
Context64K
Q4_K_M43.7 GB
CA
calme-2.4-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest31.8 GB
BE
beomi Yi Ko 34B Chat Preview
Beomi · RichardErkhov
Params34.6B
Context2K
Q4_K_M20.8 GB
QW
calme-2.2-qwen2.5-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
BI
BigBang v1 Heretic
Bigbang · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.8 Flash Next Prune11264 124B
Qwen · Atomic-Germ
Params124B
Context256K
Q4_K_M83.8 GB
GE
Gervasio 70b Portuguese Ptpt Decoder
Gervasio · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
HY
Hypernova 60B 2605
Hypernova · mradermacher
Params58.7B
Context128K
Q4_K_M40.7 GB
SE
Seed OSS 36B Instruct Abliterated
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
DE
DeepSeek V4.1 Flash 1017 UD IQ2XS
DeepSeek · cliecy
Params748B
Context1024K
Smallest0.8 GB
QW
Qwen3.6-35B-A3B
Qwen · andreaborio
Params35B
Context256K
Smallest12.3 GB
LL
Openbuddy Llama3.3 70b v24.1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
CH
Chronos Platinum 72B
Chronos · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
SO
Solar Open 69B REAP
Solar · mradermacher
Params69.4B
Context128K
Q4_K_M42.1 GB
MI
mistralai.Mistral Small 4 119B 2603 BF16
Mistral · DevQuasar
Params119B
Context1024K
Q4_K_M72.2 GB
SA
Salience 1.5 Pro
Salience · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ER
ERNIE 4.5 37B A3B Thinking Brainstorm20x
Ernie · mradermacher
Params37.2B
Context128K
Q4_K_M22.5 GB
GL
GLM-4.5-Air
GLM · ggml-org
Params107B
Context128K
Q4_K_M63.6 GB
KI
moonshotai.Kimi K2 Instruct BF16
Kimi · DevQuasar
Params1030B
Context128K
Q4_K_M620.6 GB
QW
Heretic Qwen3 VL 235B A22B Instruct
Qwen · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
HE
Hermes 4 70B Heretic
Hermes · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OY
OYM Qimi 122B A10B K2.6
Oym · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
TR
Trinity Large TrueBase i1
Trinity · mradermacher
Params399B
Context8K
Smallest0.5 GB