Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama3.1 70b Cpt Sea Lionv3 Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Apodex 1.1 mini
Qwen · vcruz305
Params34.7B
Context256K
Q4_K_M23.4 GB
Vision
VE
UI Venus Ground 72B
Venus · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
GGUF
ME
Melusine 103b i1
Melusine · mradermacher
Params103B
Context32K
Smallest22.0 GB
Roleplay
SH
shuttle 3
Shuttle · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
YI
ChatAllInOne Yi 34B 200K V1
Yi · second-state
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
SignOfFour
Qwen · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
CodingReasoning
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
GP
Gpt Oss 120b Uncensored xCloud
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
CodingReasoning
MI
brillibits_instruct_mixtral-8x7b-v0.1_dolly15k
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
QW
Qwen3.6 35B A3B NVFP4 Src
Qwen · LibertAIDAI
Params34.7B
Context256K
Q4_K_M19.8 GB
Vision
WA
Watt Tool 70B
Watt · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
JA
AI21 Jamba2 Mini
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
GGUF
ST
Strawberrylemonade L3 70B v1.2
Strawberrylemonade · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
GR
GRM 3.2 Sky
Grm · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
LL
perplexity ai r1 1776 distill llama 70b
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
Cyberneurova Qwen3.8 Flash Next
Qwen · spiritfather
Params177B
Context256K
Q4_K_M119.2 GB
GGUF
MI
tosilos 128b
Mistral · nesilabs
Params125B
Context256K
Q4_K_M74.9 GB
ReasoningTool use
GR
Groot 65B A6B 261023
Groot · GrootTeam
Params117B
Context256K
Q4_K_M78.7 GB
ReasoningTool useVision
YI
mlinmg_sg-raccoon-yi-55b-200k
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
GGUF
LI
LING 3.0 FLASH ABLITERATED
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
Reasoning
GL
Zai org.GLM 5.3 Flash
GLM · DevQuasar
Params313B
Context1024K
Q4_K_M189.0 GB
Vision
BE
34b beta2
Beta · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF
KA
KAT Coder V2.5 Dev MTP
Kat · gbuzhf
Params35.5B
Context256K
Smallest14.4 GB
Coding
FL
flint uncensored
Flint · Octopusman388
Params39.8B
Context256K
Q4_K_M24.2 GB
ReasoningTool use
UM
Umbra-v3-MoE-4x11b-2ex
Umbra · mradermacher
Params36.1B
Context32K
Q4_K_M21.8 GB
GGUF
NO
Nous Puffin 70B
Nous · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GP
gpt oss 120b ultra heretic
gpt-oss · llmfan46
Params117B
Context128K
Smallest65.4 GB
GGUF
MI
DonutHole 8x7B
Mistral · ycros
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
QW
Qwen3.6 35B A3B heretic
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision

Other sizes

Keep browsing