Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
Nemotron 3 Super 120B A12B
Nemotron · lmstudio-community
Params121B
Context1024K
Q4_K_M86.1 GB
GGUF
LL
Meta-Llama-3-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
YI
01-ai_yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
KO
Kohlibri 40B
Kohlibri · mradermacher
Params40.3B
Context256K
Q4_K_M24.5 GB
ReasoningTool use
QW
Qwen3 Next 80B A3B Thinking
Qwen · Qwen
Params80B
Context256K
Q4_K_M48.4 GB
Reasoning
DE
DeepSeek V4.1 Flash 1017 heretic
DeepSeek · pqhaz
Params748B
Context1024K
Smallest457.0 GB
GGUF
OP
openbuddy-zen-56b-v21.2-32k
Openbuddy · mradermacher
Params56.7B
Context128K
Q4_K_M34.0 GB
GGUF
LL
Nous Hermes Llama2 70b i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
BE
Beam 1.0 501B A23B
Beam · unsloth
Params501B
Context—
Smallest0.6 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · teamblobfish
Params284B
Context1024K
Q4_K_M174.9 GB
GGUF
MI
Mistral Medium 3.5 128B Eschaton Uncensored
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
Reasoning
AI
Airoboros L2 70B 2.1 Creative
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
Nous-Hermes-2-Mixtral-8x7B-DPO
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
MI
undi95_mixtral-8x7b-moe-rp-story
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
Roleplay
QW
Qwen2.5-Vl-72B-Instruct
Qwen · unsloth
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
PA
Palmyra Fin 70B 32K
Palmyra · legraphista
Params70.6B
Context32K
Smallest15.3 GB
GGUF
GL
GLM 4.5V
GLM · mradermacher
Params107B
Context64K
Q4_K_M70.4 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · AnonimousA
Params132B
Context256K
Smallest61.5 GB
GGUF
QW
Qwen3.6 35B A3B DSV4Pro SFT GPT56Sol RL Agent
Qwen · nerkyor
Params34.7B
Context256K
Smallest14.3 GB
Vision
EU
Eurus 70b sft fixed i1
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Reasoning
QW
Imperum CybersecurityLLM v1.0
Qwen · IMPERUM
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
OP
openPangu 2.0 Flash
Openpangu · mrexodia
Params91.6B
Context512K
Q4_K_M55.3 GB
GGUF
QW
Huihui Qwen3.5 122B A10B Abliterated
Qwen · huihui-ai
Params122B
Context256K
Smallest74.2 GB
Vision
SA
Strata Sage A1.5
Sage · ykarout
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
GL
GLM 4.5
GLM · unsloth
Params358B
Context128K
Q4_K_M216.5 GB
GGUF
BE
Behemoth X 123B v2.2
Behemoth · bartowski
Params123B
Context128K
Q4_K_M76.3 GB
GGUF
NE
Nex N2.5 Mini
Nex · IsValorum
Params34.7B
Context256K
Smallest14.8 GB
ReasoningTool useVision
QW
Qwen3.5-122B-A10B
Qwen · mudler
Params122B
Context256K
Smallest48.3 GB
Vision
MI
Models Mistralai Mistral Large Instruct 2407
Mistral · MaziyarPanahi
Params123B
Context32K
Q4_K_M73.2 GB
GGUF
VA
Valkyrie 49B v2.1
Valkyrie · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF

Other sizes

Keep browsing