Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
AR
Arcee SuperNova v1
Arcee · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama-3-70B-Synthia-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Apodex 1.1 mini
Qwen · apodex
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen2-72B-Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest22.7 GB
BL
Blossom V6.3 36B
Blossom · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
QW
Potato-CODER-12GB-Fast
Qwen · Slomin
Params34.7B
Context256K
Smallest8.3 GB
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
AS
Assistant_Pepe_70B
Assistant · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next ROCmFP4 FAST
Qwen · kingjones777
Params177B
Context256K
Smallest94.4 GB
TU
tulu-2-dpo-70b
Tulu · RichardErkhov
Params69B
Context8K
Q4_K_M41.4 GB
IN
InternVL2_5 78B MPO
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
QVQ 72B Preview
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
QW
Qwen3.8 Flash Next
Qwen · baa-ai
Params177B
Context256K
Smallest4.1 GB
QW
Qwen3.6 35B A3B
Qwen · Infatoshi
Params34.7B
Context256K
Q4_K_M21.2 GB
YI
Nous Hermes 2 Yi 34B
Yi · NousResearch
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Bostonouble
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3.5 35B A3B Derestricted
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Nous Hermes Llama2 70b
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
PR
Precog 123B v1
Precog · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
CY
Blackfrost-AI/CYBER-FROST-3.8-BF16
Cyber · Shaeh
Params177B
Context256K
Q4_K_M2.6 GB
LL
Hazy Llama 70b i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
MiroThinker v1.0 72B
Mirothinker · mradermacher
Params72.7B
Context256K
Q4_K_M47.4 GB
LI
Ling 3.0 Flash
Ling · WhiskyAKM
Params127B
Context256K
Q4_K_M77.0 GB
LL
Qwen3.8 Flash Next Uncensored ik llama v4 lite iq3 kt
Llama · Amarillys
Params177B
Context256K
Smallest80.0 GB
CH
chronos007 70B
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
CA
calme-3.1-instruct-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
LL
Llama EveningMirai Moonwalker MS 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DU
Dusk-Miqu-70B
Dusk · Quant-Cartel
Params69B
Context32K
Smallest14.5 GB
TR
Trinity Large Base
Trinity · bartowski
Params399B
Context256K
Q4_K_M241.6 GB