Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
AR
Arcee SuperNova v1
Arcee · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LL
Llama-3-70B-Synthia-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Apodex 1.1 mini
Qwen · apodex
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
QW
Qwen2-72B-Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest22.7 GB
GGUF
BL
Blossom V6.3 36B
Blossom · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
QW
Potato-CODER-12GB-Fast
Qwen · Slomin
Params34.7B
Context256K
Smallest8.3 GB
CodingVision
QW
Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Roleplay
AS
Assistant_Pepe_70B
Assistant · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.8 Flash Next ROCmFP4 FAST
Qwen · kingjones777
Params177B
Context256K
Smallest94.4 GB
ReasoningTool use
TU
tulu-2-dpo-70b
Tulu · RichardErkhov
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
IN
InternVL2_5 78B MPO
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool use
QW
QVQ 72B Preview
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · baa-ai
Params177B
Context256K
Smallest4.1 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B
Qwen · Infatoshi
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
YI
Nous Hermes 2 Yi 34B
Yi · NousResearch
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Bostonouble
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LL
Llama 2 70b Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.5 35B A3B Derestricted
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LL
Nous Hermes Llama2 70b
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
PR
Precog 123B v1
Precog · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
CY
Blackfrost-AI/CYBER-FROST-3.8-BF16
Cyber · Shaeh
Params177B
Context256K
Q4_K_M2.6 GB
ReasoningTool useVision
LL
Hazy Llama 70b i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
MiroThinker v1.0 72B
Mirothinker · mradermacher
Params72.7B
Context256K
Q4_K_M47.4 GB
Tool use
LI
Ling 3.0 Flash
Ling · WhiskyAKM
Params127B
Context256K
Q4_K_M77.0 GB
ReasoningTool use
LL
Qwen3.8 Flash Next Uncensored ik llama v4 lite iq3 kt
Llama · Amarillys
Params177B
Context256K
Smallest80.0 GB
ReasoningTool use
CH
chronos007 70B
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Roleplay
CA
calme-3.1-instruct-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
LL
Llama EveningMirai Moonwalker MS 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DU
Dusk-Miqu-70B
Dusk · Quant-Cartel
Params69B
Context32K
Smallest14.5 GB
GGUF
TR
Trinity Large Base
Trinity · bartowski
Params399B
Context256K
Q4_K_M241.6 GB
GGUF

Other sizes

Keep browsing