Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
ZE
LD Zephyria 37b
Zephyria · mradermacher
Params37.5B
Context128K
Q4_K_M22.4 GB
MI
mixtral megamerge dare 8x7b v2
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
LL
llama3.1 kartoffeldes 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
AN
AnubisLemonade 70B v1
Anubislemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
AN
Anansi 35B A3B
Anansi · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
SA
Kataguru-Sage-A1.5-v1.0
Sage · kataguru
Params35.5B
Context256K
Smallest13.0 GB
SE
Seed OSS 36B Base woSyn
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
MA
L3.3 70B Magnum Nexus
Magnum · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
XO
XORTRON NXTXPRTXXL
Xortron · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
LL
Smaug-Llama-3-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen2-57B-A14B-Instruct
Qwen · mradermacher
Params57.4B
Context32K
Q4_K_M34.9 GB
AT
athena 120b i1
Athena · mradermacher
Params120B
Context4K
Smallest26.1 GB
HO
K2 Horizon MoVA 36B A4B
Horizon · eaddario
Params37.4B
Context512K
Smallest0.3 GB
QW
Qwen3.6-35B-A3B
Qwen · Mspanz88
Params34.7B
Context256K
Q4_K_M22.1 GB
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
AI
airoboros l2 70B gpt4 1.4.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Unbiased
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Tessera 125B MoE
Qwen · Voidstackloop
Params162B
Context256K
Smallest2.9 GB
CO
c4ai command r v01
Command R · andrewcanis
Params35B
Context128K
Q4_K_M21.5 GB
QW
DavidAU_Qwen3.5_40B_RHOpus4.6UCH
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
LL
shisa v2.1 llama3.3 70b i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DA
Darwin 180B RSI Mixed Quant
Darwin · Baekpica
Params129B
Context256K
Smallest83.3 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.5 122B A10B GM CoT
Qwen · cgg507
Params125B
Context256K
Q4_K_M83.3 GB
QW
Qwen3.8 Flash Next rcO4
Qwen · mkinc
Params177B
Context256K
Smallest0.6 GB
JA
Jais-3-MoVA-36B-A4B
Jais · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
BI
BigQwen2.5 52B Instruct
Bigqwen · bartowski
Params52.3B
Context32K
Q4_K_M31.6 GB
DU
Dusk-Miqu-70B
Dusk · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4
Nemotron · prithivMLmods
Params124B
Context1024K
Smallest78.7 GB