Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
GP
Gpt Oss 120b
gpt-oss · DavidAU
Params117B
Context128K
Smallest62.8 GB
FR
Frontis MA1 35B
Frontis · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
EV
L3.3 MS Evalebis 70b
Evalebis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
YI
dolphin-2_2-yi-34b
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
LL
Llama 3.1 SauerkrautLM 70b Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QU
QuartetAnemoi-70B-t0.0001
Quartetanemoi · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
QW
Qwen3.5 35B A3B
Qwen · titan0115
Params34.7B
Context256K
Q4_K_M21.2 GB
LA
Laguna S 2.1
Laguna · AtomicChat
Params118B
Context1024K
Q4_K_M71.2 GB
QW
Qwen2.5 72B Instruct Abliterated
Qwen · Thaurock
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.6 35B A3B StyleTune
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ST
Step 3.5 Flash
Step · bartowski
Params197B
Context256K
Q4_K_M119.9 GB
SK
Skyfall 36B V2A
Skyfall · TheDrummer
Params36.9B
Context32K
Q4_K_M22.4 GB
TA
UI TARS 72B SFT
Tars · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
ST
Step-3.7
Step · mudler
Params197B
Context256K
Smallest72.9 GB
TR
Trinity Large Preview
Trinity · bartowski
Params399B
Context256K
Q4_K_M241.6 GB
IN
Index Translate 35B A3B Preview
Index · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
LL
Llama 2 70b Chat Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
dolphin-2.9.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
Llama 3.1 WhiteRabbitNeo 2 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.5 122B A10B Heretic v2
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
HU
Huozi3.5
Huozi · mradermacher
Params46.9B
Context32K
Q4_K_M28.6 GB
DA
Darwin 36B Opus
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
BE
Lite Beam 1.0 501B A23B IQS XXS
Beam · tablinum
Params501B
Context1024K
Smallest144.4 GB
TH
Thomson 1.0 Small
Thomson · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
MiMo V2.5
Mimo · bartowski
Params310B
Context1024K
Q4_K_M188.8 GB
QW
Qwen3 Coder 53B A3B Instruct TOTAL RECALL v2 MASTER CODER L
Qwen · mradermacher
Params53B
Context256K
Q4_K_M32.1 GB
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · longsesh
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
hf 100 Llama 3.1 Spellbound StoryWriter 0.1 vllm 16bit
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB