Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
EU
Eurus 70b nca fixed
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Reasoning
QW
MARTHA 73B Qwen2 VL i1
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
LA
Laguna S 2.1 ROCmFP4 STRIX LEAN
Laguna · kingjones777
Params118B
Context256K
Smallest62.6 GB
ReasoningTool use
XY
XYZ Aquila Mini
Xyz · IsValorum
Params34.7B
Context256K
Smallest14.8 GB
Reasoning
LL
OrionStar Yi 34B Chat Llama
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Sakura Qwen3.8 Flash Next Compact ISTA IQ3 XXS 512E CP2
Qwen · webmp3
Params177B
Context256K
Smallest60.5 GB
ReasoningTool use
PI
PiVoT SUS RP i1
Pivot · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
Roleplay
XW
Xwinter 120b i1
Xwinter · mradermacher
Params118B
Context4K
Smallest25.0 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
Roleplay
KO
Kolibri-1
Kolibri · Eliasfpv28
Params78.1B
Context256K
Smallest33.9 GB
ReasoningTool use
MI
chargoddard_mixtralrpchat-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
CA
CalmeRys 78B Orpo v0.1 i1
Calmerys · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
QW
Swift1.5 Qwen3.8 Flash Next
Qwen · tirex2001
Params56.1B
Context256K
Smallest60.4 GB
GGUF
BA
BagelWorldTour-8x7B
Bagelworldtour · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
CL
Clover 35B A3B Preview APEX I NanoPlus V2.1
Clover · IsValorum
Params34.7B
Context128K
Smallest12.6 GB
ReasoningTool use
MA
MAmmoTH2-8x7B
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
QW
RWKV6QwQ 32B Final 250307
Qwen · mradermacher
Params34.9B
Context1024K
Q4_K_M22.8 GB
Reasoning
AG
Agents A1
Agents · el4
Params34.7B
Context256K
Smallest11.8 GB
ReasoningTool use
QW
Qwen3 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
NE
Sakura Nemotron 3.5 Bolt 74B A9B 24GB Uncensored
Nemotron · webmp3
Params74B
Context256K
Smallest23.4 GB
GGUF
QW
Qwen3.6 35B A3B
Qwen · Myric
Params35.5B
Context256K
Smallest14.4 GB
GGUF
TE
migtissera_tess-34b-v1.5b
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
CO
c4ai-command-r-plus
Command R · pmysl
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · tekosML
Params284B
Context1024K
Smallest86.7 GB
GGUF
PA
Palmyra-Med-70B
Palmyra · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LZ
lzlv limarpv3 l2 70b i1
Lzlv · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
MI
MiMo V2.6 Flash MOPD
Mimo · AesSedai
Params310B
Context—
Smallest1.0 GB
GGUF
TI
tigerresearch_tigerbot-70b-chat-v2
Tigerbot · TheBloke
Params69.4B
Context2K
Q4_K_M41.7 GB
GGUF
SY
migtissera_synthia-70b-v1.5
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF

Other sizes

Keep browsing