Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 Flash Next Turbo Brilliance 50x Reasoning Instruct GSQ RCO
Qwen · DavidAU
Params177B
Context256K
Smallest83.6 GB
FL
Flint INT4 Preview
Flint · RecursiveSI
Params39.8B
Context256K
Smallest26.0 GB
OR
Ornith 1.5 35B A3B UNCENSORED
Ornith · dealignai
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.8 Flash Next Uncensored
Qwen · axi0mX
Params180B
Context256K
Smallest75.3 GB
GL
Glm-4.5-Air
GLM · unsloth
Params110B
Context128K
Q4_K_M73.0 GB
QW
Qwen3.8 Flash Next Uncensored GSQ RCO 12 GB GPU
Qwen · 0xSojalSec
Params177B
Context—
Smallest0.9 GB
OR
Ornith 1.5 35B A3B
Ornith · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
QW
Qwen2.5 72B Instruct Abliterated
Qwen · zetasepic
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
Models Meta Llama Llama 3.3 70B Instruct
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Models Meta Llama Meta Llama 3.1 70B Instruct
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
GL
GLM 5.3 Flash GGUF DGX Spark
GLM · autotrust
Params279B
Context1024K
Smallest84.9 GB
LL
Llama-4-Scout-17B-16E-Instruct
Llama · unsloth
Params108B
Context10240K
Q4_K_M65.4 GB
QW
Qwen3.5 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB
DE
Deepseek-R1-Distill-Llama-70B
DeepSeek · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next
Qwen · agentionai
Params177B
Context256K
Q4_K_M94.5 GB
MI
Models Mistralai Mistral Large Instruct 2411
Mistral · MaziyarPanahi
Params123B
Context128K
Q4_K_M73.2 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
DE
DeepSeek V3 0324
DeepSeek · MaziyarPanahi
Params671B
Context160K
Smallest133.6 GB
LL
Models Meta Llama Meta Llama 3.1 405B Instruct
Llama · MaziyarPanahi
Params410B
Context128K
Smallest151.2 GB
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
models--fireworks-ai--firefunction-v2
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.3 70B Instruct Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · pfeifferj
Params125B
Context256K
Smallest29.5 GB
LL
Meta Llama 3.1 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 Coder Next
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
QW
Qwen3.8 Flash CIRU STRIX Orca
Qwen · jcbtc
Params126B
Context256K
Smallest4.1 GB
DE
DeepSeek V4.1 Flash UNCENSORED
DeepSeek · Adolphsson
Params748B
Context—
Q4_K_M426.1 GB
LL
Llama-3.3-70B-Instruct
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
MiniCPM V 4.7 35B A3B CRACKv5 2p0
MiniCPM · dealignai
Params34.7B
Context256K
Q4_K_M22.6 GB
AG
Huihui Agents A1 Abliterated
Agents · huihui-ai
Params34.7B
Context256K
Smallest21.2 GB