Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash 0731 MXFP4 Q3 K Q2 K mixed
DeepSeek · BahamutRU
Params284B
Context—
Smallest126.9 GB
GGUF
QW
Qwen3 53B A3B TOTAL RECALL v1.4 128k
Qwen · mradermacher
Params53B
Context128K
Q4_K_M32.1 GB
CodingReasoning
BA
bagel 34b v0.5
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
CodingRoleplayTool use
BE
Behemoth X 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
NO
doctor-shotgun_nous-capybara-limarpv3-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
AP
Apertus 70B Instruct 2509
Apertus · bartowski
Params70.6B
Context64K
Q4_K_M43.7 GB
GGUF
MO
L3.1 MOE 8X8B Dark Planet 8D Mirrored Chaos Uncensored 47B
Moe · DavidAU
Params47.5B
Context128K
Q4_K_M29.0 GB
Roleplay
QW
Huihui Qwen3 Next 80B A3B Thinking Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
ReasoningTool use
EU
L3-70B-Euryale-v2.1
Euryale · InferenceIllusionist
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
NO
Norobara ZLoss 8x7B
Norobara · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
MiMo V2.5
Mimo · huihui-ai
Params310B
Context1024K
Smallest186.7 GB
ReasoningTool useVision
LL
OpenBioLLM Llama3 70B GGUF smashed
Llama · PrunaAI
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 GSQ RCO StrixHalo
DeepSeek · Harsha001
Params658B
Context1024K
Smallest214.8 GB
ReasoningTool use
LL
Llama-3-Swallow-70B-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
OrionStar Yi 34B Chat Llama
Llama · second-state
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
GL
GLM 5.3 Flash dealignai orcarouter merge
GLM · Cypherfox
Params320B
Context1024K
Smallest170.9 GB
Vision
MA
Mach 2 Additive Medium
Mach · SyzygyResearch
Params65.6B
Context256K
Smallest130.1 GB
GGUF
QW
Qwen3.6-35B-A3B-MTP
Qwen · Ninnix96
Params34.7B
Context256K
Smallest1.6 GB
ReasoningTool use
YI
taozi555_rpbird-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen3.8 Flash Next Mooney
Qwen · DJLougen
Params177B
Context256K
Smallest2.8 GB
Vision
SP
Spikingkiki 122b A10B
Spikingkiki · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
SM
Smaug-34B-v0.1
Smaug · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
ST
StrawberryLemonade L3 70B v1.0
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
e n v y Legion V2.1 LLaMa 70B Elarablated v0.8 hf
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama 3.3 CURSEDMAGICALGIRL 2.5 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.5 35B A3B Sceptic v3.4
Qwen · kataguru
Params35.5B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Unbiased
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
CL
Clover 35B A3B Preview APEX I MiniPlus V2.1
Clover · IsValorum
Params34.7B
Context128K
Smallest14.8 GB
ReasoningTool use
AI
airoboros-2.2.1-limarpv3-y34b
Airoboros · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
SO
SOLARC MOE 10.7Bx4
Solarc · TheBloke
Params36B
Context4K
Q4_K_M20.4 GB
GGUF

Other sizes

Keep browsing