Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
ZE
LD Zephyria 37b
Zephyria · mradermacher
Params37.5B
Context128K
Q4_K_M22.4 GB
Tool use
MI
mixtral megamerge dare 8x7b v2
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
LL
llama3.1 kartoffeldes 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
AN
AnubisLemonade 70B v1
Anubislemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
AN
Anansi 35B A3B
Anansi · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningRoleplayTool use
SA
Kataguru-Sage-A1.5-v1.0
Sage · kataguru
Params35.5B
Context256K
Smallest13.0 GB
ReasoningTool useVision
SE
Seed OSS 36B Base woSyn
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
MA
L3.3 70B Magnum Nexus
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
XO
XORTRON NXTXPRTXXL
Xortron · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
ReasoningTool useVision
LL
Smaug-Llama-3-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen2-57B-A14B-Instruct
Qwen · mradermacher
Params57.4B
Context32K
Q4_K_M34.9 GB
GGUF
AT
athena 120b i1
Athena · mradermacher
Params120B
Context4K
Smallest26.1 GB
GGUF
HO
K2 Horizon MoVA 36B A4B
Horizon · eaddario
Params37.4B
Context512K
Smallest0.3 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · Mspanz88
Params34.7B
Context256K
Q4_K_M22.1 GB
ReasoningTool useVision
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
AI
airoboros l2 70B gpt4 1.4.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Unbiased
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
Tessera 125B MoE
Qwen · Voidstackloop
Params162B
Context256K
Smallest2.9 GB
ReasoningTool use
CO
c4ai command r v01
Command R · andrewcanis
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
QW
DavidAU_Qwen3.5_40B_RHOpus4.6UCH
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
LL
shisa v2.1 llama3.3 70b i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
DA
Darwin 180B RSI Mixed Quant
Darwin · Baekpica
Params129B
Context256K
Smallest83.3 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
QW
Qwen3.5 122B A10B GM CoT
Qwen · cgg507
Params125B
Context256K
Q4_K_M83.3 GB
ReasoningRoleplayTool use
QW
Qwen3.8 Flash Next rcO4
Qwen · mkinc
Params177B
Context256K
Smallest0.6 GB
GGUF
JA
Jais-3-MoVA-36B-A4B
Jais · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
BI
BigQwen2.5 52B Instruct
Bigqwen · bartowski
Params52.3B
Context32K
Q4_K_M31.6 GB
GGUF
DU
Dusk-Miqu-70B
Dusk · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4
Nemotron · prithivMLmods
Params124B
Context1024K
Smallest78.7 GB
ReasoningTool useVision

Other sizes

Keep browsing