Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
IN
INTELLECT 3
Intellect · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
Reasoning
AR
ARIA 70B V2
Aria · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Coding
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
GGUF
KI
Kimi K3
Kimi · AtomicChat
Params2780B
Context1024K
Smallest589.5 GB
ReasoningTool useVision
MI
miquplus-xwin-70b
Miquplus · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
OP
rombodawg_open_gpt4_8x7b
Open · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
KI
Qwopus3.5 122B A10B Kimi K2.6 destill healed abliterated
Kimi · OpenYourMind
Params125B
Context256K
Q4_K_M75.8 GB
Vision
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
Coding
QW
AgentMercury Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool useVision
YI
dolphin-2.9.1-yi-1.5-34b
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
CodingTool use
ME
Melody1437 35B A3B
Melody · ReadyArt
Params35.5B
Context256K
Q4_K_M21.7 GB
Roleplay
LL
Llama 3.3 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
LI
Ling 3.0 Flash Heretic
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
GGUF
FA
FashionGPT 70B V1 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
BE
Behemoth X 123B v2.2
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
AI
Airoboros L2 70B GPT4 m2.0
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
MiniMaxAI_MiniMax M2.7
Minimax · lmstudio-community
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
YI
Faro Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
LI
Ling 3.0 flash VL
Ling · bloomer010
Params124B
Context256K
Q4_K_M0.7 GB
Vision
OP
openbuddy-yi1.5-34b-v21.2-32k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
MI
WukongV2-Mixtral-8x7B-V0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Dolphin 2.6 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
QW
Qwen3.5 35B A3B
Qwen · Advantech-EIOT
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LL
Llama 3_1 Nemotron 51B Instruct
Llama · bartowski
Params51.5B
Context128K
Q4_K_M31.0 GB
GGUF
MI
Solstice Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
QW
Qwen Qwen3.6 35B A3B
Qwen · batiai
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
OP
openbuddy-yi1.5-34b-v21.3-32k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
DE
DeepSeek V2.5
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
GGUF

Other sizes

Keep browsing