Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
YI
Yislerp 34B i1
Yislerp · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
CA
calme-2.4-rys-78b
Calme · mradermacher
Params78B
Context32K
Smallest24.3 GB
GGUF
BI
BigAurelian v0.5 120b 32k i1
Bigaurelian · mradermacher
Params118B
Context4K
Smallest25.0 GB
GGUF
GL
GLM 4.7 Flash 49B
GLM · mradermacher
Params47.7B
Context198K
Q4_K_M28.9 GB
ReasoningTool use
DR
drama-3
Drama · Harsha001
Params35.8B
Context—
Smallest20.1 GB
GGUF
SP
Spicyboros 70B 2.2
Spicyboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 3.1 Tulu 3 405B
Llama · bartowski
Params406B
Context128K
Q4_K_M243.1 GB
GGUF
QW
Qwen3 Coder Next
Qwen · Omega-Factory
Params79.7B
Context256K
Q4_K_M48.5 GB
CodingTool use
FA
WizardLM Uncensored Falcon 40b
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M25.5 GB
GGUF
HO
Holo2 235B A22B
Holo · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningTool useVision
QW
Gemini 3 Pro Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
HO
K2-Horizon-MoVA-36B-A4B
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
ReasoningTool use
DE
DeepSeek V4 Flash 0731 Pruned 155B A13B
DeepSeek · takanori-ishikawa
Params155B
Context1024K
Smallest1.2 GB
GGUF
LL
Llama 3 Meerkat 70b v1.0
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.8 Flash Next Q8 UDQ4K DS4
Qwen · nazeshinjite
Params180B
Context256K
Smallest202.5 GB
Vision
KA
Karakuri Lm 70b Chat v0.1
Karakuri · mradermacher
Params69.2B
Context4K
Q4_K_M41.6 GB
GGUF
QW
Qwen3.8 Flash Next GSQ RCO
Qwen · FenomAI
Params177B
Context256K
Smallest66.4 GB
ReasoningTool useVision
LL
models--MaziyarPanahi--Llama-3-70B-Instruct-32k-v0.1
Llama · MaziyarPanahi
Params70.6B
Context31K
Q4_K_M42.5 GB
GGUF
AE
aegolius acadicus 34b v3
Aegolius · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
GGUF
DO
Donnager 70B V1A
Donnager · bartowski
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
DR
Drama 3 ConfigI
Drama · thetom-ai
Params34.7B
Context256K
Smallest24.3 GB
ReasoningTool use
DB
dbrx instruct iMat
Dbrx · dranger003
Params132B
Context32K
Smallest26.9 GB
GGUF
LL
Tess R1 Limerick Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
BE
Behemoth 123B v2.2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
CO
Command A Reasoning 08 2025
Command · bartowski
Params111B
Context488K
Q4_K_M67.1 GB
ReasoningTool use
QW
cerebras/Qwen3-Coder-REAP-363B-A35B
Qwen · unsloth
Params363B
Context256K
Q4_K_M219.3 GB
CodingTool use
CH
chronos 70b v2 i1
Chronos · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
Roleplay
LL
OpenBuddy Llama2 70b v10.1
Llama · TheBloke
Params69.1B
Context4K
Q4_K_M41.5 GB
GGUF
0G
0GM 1.0 35B A3B 0427
mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision

Other sizes

Keep browsing