Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
GL
Glm-4.6V
GLM · unsloth
Params107B
Context128K
Q4_K_M70.6 GB
DE
DeepSeek V4.1 Flash 1017
DeepSeek · mrfakename
Params748B
Context—
Q4_K_M444.7 GB
GL
GLM 5.3 Flash Maya M Derisked IQ2 S
GLM · peasantsmith
Params321B
Context1024K
Smallest116.0 GB
CY
Blackfrost-AI/CYBER-FROST-3.8-BF16
Cyber · freakyskittle
Params177B
Context256K
Q4_K_M2.6 GB
DE
Deepseek-V4-Flash
DeepSeek · unsloth
Params284B
Context1024K
Smallest82.5 GB
GL
GLM 5.3 Flash Coder RCO 152E
GLM · lapadatbogdan
Params170B
Context1024K
Q4_K_M102.6 GB
QW
Qwen3.6 35B A3B abliterated
Qwen · wangzhang
Params34.7B
Context256K
Q4_K_M21.2 GB
OR
Ornith 1.5 35B A3B Huihui Sangreal MTP ICE
Ornith · gbuzhf
Params35.5B
Context256K
Smallest0.2 GB
QW
Qwen3.8 Flash Next UNCENSORED IQ2 XXS
Qwen · BattleGhost
Params177B
Context256K
Smallest74.7 GB
QW
Models Qwen Qwen3 Coder Next
Qwen · MaziyarPanahi
Params79.7B
Context256K
Q4_K_M48.4 GB
HO
K2 Horizon MoVA 36B A4B
Horizon · IFM
Params37.4B
Context512K
Q4_K_M22.4 GB
GL
glm 5.3
GLM · antirez
Params754B
Context1024K
Smallest211.1 GB
QW
Qwen3.8 Flash Next NVIDIA NVFP4 Strata
Qwen · Maximilian228
Params51.2B
Context—
Smallest1.3 GB
QW
Whittle Qwen 3.8 35B A3B
Qwen · logic65
Params35.5B
Context256K
Q4_K_M21.3 GB
AG
Agents A1
Agents · InternScience
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
MiniCPM-V-4.7-35B-A3B
MiniCPM · AtomicChat
Params34.7B
Context256K
Smallest10.1 GB
QW
Qwen3 Next 80B A3B Instruct
Qwen · Qwen
Params80B
Context256K
Q4_K_M48.4 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO Uncen IQ1 332Exp
Qwen · DatKurai
Params134B
Context256K
Smallest60.7 GB
MI
mistralai_mixtral-8x7b-instruct-v0.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
DE
DeepSeek R1 0528
DeepSeek · bartowski
Params670B
Context160K
Q4_K_M409.2 GB
DE
DeepSeek V4.1 Flash
DeepSeek · vcruz305
Params748B
Context—
Q4_K_M444.7 GB
QW
Qwen3.8 Flash Next
Qwen · agentionai
Params177B
Context256K
Smallest93.5 GB
QW
RVN Qwen3.8 Flash Next Abliterated Uncensored
Qwen · 0bserverx
Params177B
Context256K
Q4_K_M119.2 GB
QW
Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local)
Qwen · fairfieldt
Params157B
Context256K
Smallest105.6 GB
QW
Qwen3.8 Flash Next
Qwen · agentionai
Params117B
Context256K
Smallest75.8 GB
DE
DeepSeek V4.1 Flash
DeepSeek · Lucebox
Params755B
Context—
Smallest355.4 GB
QW
OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4
Qwen · auto7x
Params126B
Context—
Smallest0.9 GB
MI
Mistral-Small-4-119B-2603
Mistral · unsloth
Params119B
Context1024K
Q4_K_M73.8 GB
GL
GLM 5.3 UNCENSORED FP8
GLM · softwareweaver
Params753B
Context1024K
Q4_K_M454.6 GB
OR
Ornith 1.5 122B UNCENSORED
Ornith · dealignai
Params125B
Context256K
Q4_K_M79.4 GB