Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
IN
INTELLECT 3
Intellect · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
AR
ARIA 70B V2
Aria · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama-3-Patronus-Lynx-70B-Instruct
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
KI
Kimi K3
Kimi · AtomicChat
Params2780B
Context1024K
Smallest589.5 GB
MI
miquplus-xwin-70b
Miquplus · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
OP
rombodawg_open_gpt4_8x7b
Open · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
KI
Qwopus3.5 122B A10B Kimi K2.6 destill healed abliterated
Kimi · OpenYourMind
Params125B
Context256K
Q4_K_M75.8 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
QW
AgentMercury Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
ME
Melody1437 35B A3B
Melody · ReadyArt
Params35.5B
Context256K
Q4_K_M21.7 GB
LL
Llama 3.3 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LI
Ling 3.0 Flash Heretic
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
FA
FashionGPT 70B V1 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
BE
Behemoth X 123B v2.2
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
AI
Airoboros L2 70B GPT4 m2.0
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
MiniMaxAI_MiniMax M2.7
Minimax · lmstudio-community
Params230B
Context192K
Q4_K_M138.3 GB
YI
Faro Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
LI
Ling 3.0 flash VL
Ling · bloomer010
Params124B
Context256K
Q4_K_M0.7 GB
OP
openbuddy-yi1.5-34b-v21.2-32k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
MI
WukongV2-Mixtral-8x7B-V0.1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
Dolphin 2.6 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Qwen3.5 35B A3B
Qwen · Advantech-EIOT
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · bartowski
Params51.5B
Context128K
Q4_K_M31.0 GB
MI
Solstice Mixtral v1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
QW
Qwen Qwen3.6 35B A3B
Qwen · batiai
Params34.7B
Context256K
Q4_K_M21.2 GB
OP
openbuddy-yi1.5-34b-v21.3-32k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
DE
DeepSeek V2.5
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB