Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
Ling 3.0 Flash Sante
Ling · bartowski
Params127B
Context256K
Q4_K_M80.4 GB
ReasoningTool use
QW
Qwen3.8-Flash-CIRU-STRIX-IU4-MTP
Qwen · jcbtc
Params126B
Context256K
Smallest4.1 GB
Vision
HO
Holo3 35B A3B APEX
Holo · mudler
Params34.7B
Context256K
Smallest14.3 GB
Vision
SA
Sage A1.5
Sage · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use
CO
Command A Plus 05 2026
Command · bartowski
Params218B
Context195K
Q4_K_M135.1 GB
GGUF
MI
MixtralOrochi8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
GL
GLM 5.3 Flash
GLM · batiai
Params313B
Context1024K
Q4_K_M188.7 GB
GGUF
MI
Nous-Hermes-2-Mixtral-8x7B-SFT
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
QW
Qwen3.8 Flash Next
Qwen · apetersson
Params126B
Context256K
Smallest2.8 GB
Vision
QW
Swift Qwen3.8 Flash Next Q4 0 Q8out v3
Qwen · nitinpanj
Params177B
Context256K
Smallest102.6 GB
Vision
MI
Midnight Miqu 70B v1.0 i1
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
QW
Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
MI
MiMo-V2.6-Flash-MOPD
Mimo · ddh0
Params310B
Context1024K
Smallest131.4 GB
ReasoningTool useVision
KO
Kolibri 1
Kolibri · InsidiousFiddler
Params78B
Context256K
Smallest37.5 GB
Reasoning
QW
Qwen3.6-35B-A3B
Qwen · cmp-nct
Params34.7B
Context256K
Q4_K_M22.1 GB
Vision
EL
Steelskull L3.3 Electra R1 70b
Electra · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
IQ
IQuest Coder V1 40B Instruct
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
Coding
AS
astrollama 2 70b chat aic i1
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen_Qwen3 Next 80B A3B Instruct
Qwen · lmstudio-community
Params80B
Context256K
Q4_K_M48.5 GB
GGUF
AI
airoboros l2 70B GPT4 2.0
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
YI
Yi 1.5 34B Chat Abliterated
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Qwen/Qwen3-Next-80B-A3B-Instruct
Qwen · lefromage
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
QW
Qwen3.6 35B A3B SILVER UNCENSORED APEX
Qwen · White-Wolf13
Params34.7B
Context256K
Smallest12.1 GB
GGUF
OR
Ornith-1.5-35B-A3B
Ornith · lmcoleman
Params35.5B
Context256K
Q4_K_M21.0 GB
Vision
AL
AliceAI Foundation 80B A3B NOESIS BF16
Aliceai · AMAImedia
Params79.6B
Context256K
Q4_K_M48.3 GB
Coding
QW
Qwen3-235B-A22B-128K
Qwen · unsloth
Params235B
Context128K
Q4_K_M142.2 GB
GGUF
TO
ToolSpace 35B A3B
Toolspace · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
CO
C4Ai Command R v01
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
WO
WorldSim Opus 3.6 35B A3B
Worldsim · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
ReasoningRoleplayVision
QW
QVQ 72B Preview
Qwen · bartowski
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision

Other sizes

Keep browsing