Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
YI
dolphin-2.2-yi-34b-200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
SW
Swallow 70b Instruct v0.1
Swallow · RichardErkhov
Params69B
Context4K
Q4_K_M41.5 GB
DE
Deepseek-V3-0324
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
LL
CodeLlama 70b Instruct hf
Llama · second-state
Params69B
Context4K
Q4_K_M41.4 GB
QW
Whittle Qwen 3.8 45B A3B
Qwen · logic65
Params45.1B
Context256K
Q4_K_M27.1 GB
HO
K2-Horizon-375B-A23B
Horizon · bartowski
Params379B
Context512K
Q4_K_M237.8 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen3.5 40B Claude 4.5 Opus High Reasoning Thinking uncensored heretic
Qwen · llmfan46
Params39.1B
Context256K
Q4_K_M23.9 GB
MI
MiniMax M3
Minimax · bartowski
Params426B
Context1024K
Q4_K_M261.3 GB
LL
Hermes 3 Llama 3.1 70B
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
SE
Seed OSS 36B Instruct
Seed · bartowski
Params36.2B
Context512K
Q4_K_M21.8 GB
SO
Solar Open 100B
Solar · mradermacher
Params103B
Context128K
Q4_K_M62.3 GB
PI
maywell_pivot-sus-rp
Pivot · TheBloke
Params34.4B
Context8K
Q4_K_M20.7 GB
FA
Falcon
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M26.0 GB
OC
Occamy 1.0
Occamy · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
GL
GLM 5.3 Flash FP8
GLM · AMAImedia
Params313B
Context1024K
Smallest149.1 GB
CH
Chronos 70B v2
Chronos · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
AP
Apodex 1.1 Mini
Apodex · IsValorum
Params35.5B
Context256K
Smallest15.3 GB
YI
Nous Hermes 2 Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
FL
Abliterated
Flint · lilcheaty
Params39.8B
Context256K
Smallest19.1 GB
HU
Huihui3.5 67B A3B Abliterated
Huihui · mradermacher
Params67B
Context256K
Q4_K_M40.8 GB
YI
Yi-34Bx2-MoE-60B-DPO
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
TE
Tess M Creative v1.0
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GL
GLM 5.3 Flash BF16
GLM · avar6
Params321B
Context—
Smallest0.5 GB
QW
ThinkingCap Qwen3.8 Flash-Next
Qwen · bottlecapai
Params180B
Context256K
Q4_K_M113.2 GB
SW
Swallow 70B instruct
Swallow · TheBloke
Params69.2B
Context4K
Q4_K_M41.5 GB
LL
Upstage Llama1 65B Instruct
Llama · TheBloke
Params65B
Context2K
Q4_K_M39.3 GB
HE
NousResearch.Hermes 4 405B
Hermes · DevQuasar-13
Params405B
Context128K
Q4_K_M243.1 GB
LL
Hermes 2 Pro Llama 3.1 70B i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
Anubis 70B v1.2
Llama · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB