Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash Next Turbo Brilliance 50x Reasoning Instruct GSQ RCO
Qwen · DavidAU
Params177B
Context256K
Smallest83.6 GB
CodingReasoningVision
FL
Flint INT4 Preview
Flint · RecursiveSI
Params39.8B
Context256K
Smallest26.0 GB
GGUF
OR
Ornith 1.5 35B A3B UNCENSORED
Ornith · dealignai
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningVision
QW
Qwen3.8 Flash Next Uncensored
Qwen · axi0mX
Params180B
Context256K
Smallest75.3 GB
Vision
GL
Glm-4.5-Air
GLM · unsloth
Params110B
Context128K
Q4_K_M73.0 GB
GGUF
QW
Qwen3.8 Flash Next Uncensored GSQ RCO 12 GB GPU
Qwen · 0xSojalSec
Params177B
Context—
Smallest0.9 GB
GGUF
OR
Ornith 1.5 35B A3B
Ornith · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
QW
Qwen2.5 72B Instruct Abliterated
Qwen · zetasepic
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LL
Models Meta Llama Llama 3.3 70B Instruct
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Models Meta Llama Meta Llama 3.1 70B Instruct
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GL
GLM 5.3 Flash GGUF DGX Spark
GLM · autotrust
Params279B
Context1024K
Smallest84.9 GB
GGUF
LL
Llama-4-Scout-17B-16E-Instruct
Llama · unsloth
Params108B
Context10240K
Q4_K_M65.4 GB
Vision
QW
Qwen3.5 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB
Vision
DE
Deepseek-R1-Distill-Llama-70B
DeepSeek · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
Qwen3.8 Flash Next
Qwen · agentionai
Params177B
Context256K
Q4_K_M94.5 GB
GGUF
MI
Models Mistralai Mistral Large Instruct 2411
Mistral · MaziyarPanahi
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
DE
DeepSeek V3 0324
DeepSeek · MaziyarPanahi
Params671B
Context160K
Smallest133.6 GB
GGUF
LL
Models Meta Llama Meta Llama 3.1 405B Instruct
Llama · MaziyarPanahi
Params410B
Context128K
Smallest151.2 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
LL
models--fireworks-ai--firefunction-v2
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
LL
Llama 3.3 70B Instruct Abliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · pfeifferj
Params125B
Context256K
Smallest29.5 GB
Vision
LL
Meta Llama 3.1 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3 Coder Next
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
Coding
QW
Qwen3.8 Flash CIRU STRIX Orca
Qwen · jcbtc
Params126B
Context256K
Smallest4.1 GB
Vision
DE
DeepSeek V4.1 Flash UNCENSORED
DeepSeek · Adolphsson
Params748B
Context—
Q4_K_M426.1 GB
GGUF
LL
Llama-3.3-70B-Instruct
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
MiniCPM V 4.7 35B A3B CRACKv5 2p0
MiniCPM · dealignai
Params34.7B
Context256K
Q4_K_M22.6 GB
Vision
AG
Huihui Agents A1 Abliterated
Agents · huihui-ai
Params34.7B
Context256K
Smallest21.2 GB
Vision

Other sizes

Keep browsing