Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
EU
Eurus 70b nca fixed
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
QW
MARTHA 73B Qwen2 VL i1
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
LA
Laguna S 2.1 ROCmFP4 STRIX LEAN
Laguna · kingjones777
Params118B
Context256K
Smallest62.6 GB
XY
XYZ Aquila Mini
Xyz · IsValorum
Params34.7B
Context256K
Smallest14.8 GB
LL
OrionStar Yi 34B Chat Llama
Llama · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Sakura Qwen3.8 Flash Next Compact ISTA IQ3 XXS 512E CP2
Qwen · webmp3
Params177B
Context256K
Smallest60.5 GB
PI
PiVoT SUS RP i1
Pivot · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
XW
Xwinter 120b i1
Xwinter · mradermacher
Params118B
Context4K
Smallest25.0 GB
LL
Meta Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
KO
Kolibri-1
Kolibri · Eliasfpv28
Params78.1B
Context256K
Smallest33.9 GB
MI
chargoddard_mixtralrpchat-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CA
CalmeRys 78B Orpo v0.1 i1
Calmerys · mradermacher
Params78B
Context32K
Smallest24.3 GB
QW
Swift1.5 Qwen3.8 Flash Next
Qwen · tirex2001
Params56.1B
Context256K
Smallest60.4 GB
BA
BagelWorldTour-8x7B
Bagelworldtour · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CL
Clover 35B A3B Preview APEX I NanoPlus V2.1
Clover · IsValorum
Params34.7B
Context128K
Smallest12.6 GB
MA
MAmmoTH2-8x7B
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
RWKV6QwQ 32B Final 250307
Qwen · mradermacher
Params34.9B
Context1024K
Q4_K_M22.8 GB
AG
Agents A1
Agents · el4
Params34.7B
Context256K
Smallest11.8 GB
QW
Qwen3 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
NE
Sakura Nemotron 3.5 Bolt 74B A9B 24GB Uncensored
Nemotron · webmp3
Params74B
Context256K
Smallest23.4 GB
QW
Qwen3.6 35B A3B
Qwen · Myric
Params35.5B
Context256K
Smallest14.4 GB
TE
migtissera_tess-34b-v1.5b
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
CO
c4ai-command-r-plus
Command R · pmysl
Params104B
Context128K
Q4_K_M62.8 GB
DE
DeepSeek V4 Flash
DeepSeek · tekosML
Params284B
Context1024K
Smallest86.7 GB
PA
Palmyra-Med-70B
Palmyra · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LZ
lzlv limarpv3 l2 70b i1
Lzlv · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
MI
MiMo V2.6 Flash MOPD
Mimo · AesSedai
Params310B
Context—
Smallest1.0 GB
TI
tigerresearch_tigerbot-70b-chat-v2
Tigerbot · TheBloke
Params69.4B
Context2K
Q4_K_M41.7 GB
SY
migtissera_synthia-70b-v1.5
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB