Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V4 Flash 0731 MXFP4 Q3 K Q2 K mixed
DeepSeek · BahamutRU
Params284B
Context—
Smallest126.9 GB
QW
Qwen3 53B A3B TOTAL RECALL v1.4 128k
Qwen · mradermacher
Params53B
Context128K
Q4_K_M32.1 GB
BA
bagel 34b v0.5
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
BE
Behemoth X 123B v2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
NO
doctor-shotgun_nous-capybara-limarpv3-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
AP
Apertus 70B Instruct 2509
Apertus · bartowski
Params70.6B
Context64K
Q4_K_M43.7 GB
MO
L3.1 MOE 8X8B Dark Planet 8D Mirrored Chaos Uncensored 47B
Moe · DavidAU
Params47.5B
Context128K
Q4_K_M29.0 GB
QW
Huihui Qwen3 Next 80B A3B Thinking Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
EU
L3-70B-Euryale-v2.1
Euryale · InferenceIllusionist
Params70.6B
Context8K
Q4_K_M42.5 GB
NO
Norobara ZLoss 8x7B
Norobara · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
MiMo V2.5
Mimo · huihui-ai
Params310B
Context1024K
Smallest186.7 GB
LL
OpenBioLLM Llama3 70B GGUF smashed
Llama · PrunaAI
Params70.6B
Context8K
Q4_K_M42.5 GB
DE
DeepSeek V4.1 Flash 1017 GSQ RCO StrixHalo
DeepSeek · Harsha001
Params658B
Context1024K
Smallest214.8 GB
LL
Llama-3-Swallow-70B-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
OrionStar Yi 34B Chat Llama
Llama · second-state
Params34.4B
Context4K
Q4_K_M20.7 GB
GL
GLM 5.3 Flash dealignai orcarouter merge
GLM · Cypherfox
Params320B
Context1024K
Smallest170.9 GB
MA
Mach 2 Additive Medium
Mach · SyzygyResearch
Params65.6B
Context256K
Smallest130.1 GB
QW
Qwen3.6-35B-A3B-MTP
Qwen · Ninnix96
Params34.7B
Context256K
Smallest1.6 GB
YI
taozi555_rpbird-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen3.8 Flash Next Mooney
Qwen · DJLougen
Params177B
Context256K
Smallest2.8 GB
SP
Spikingkiki 122b A10B
Spikingkiki · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
SM
Smaug-34B-v0.1
Smaug · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
ST
StrawberryLemonade L3 70B v1.0
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
e n v y Legion V2.1 LLaMa 70B Elarablated v0.8 hf
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3.3 CURSEDMAGICALGIRL 2.5 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.5 35B A3B Sceptic v3.4
Qwen · kataguru
Params35.5B
Context256K
Q4_K_M1.3 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored v2 Unbiased
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
CL
Clover 35B A3B Preview APEX I MiniPlus V2.1
Clover · IsValorum
Params34.7B
Context128K
Smallest14.8 GB
AI
airoboros-2.2.1-limarpv3-y34b
Airoboros · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
SO
SOLARC MOE 10.7Bx4
Solarc · TheBloke
Params36B
Context4K
Q4_K_M20.4 GB