Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V4.1 Flash
DeepSeek · mxxm-t
Params748B
Context1024K
Smallest8.0 GB
ME
L3.1 70b MeowMix i1
Meowmix · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
PH
Phind 70B
Phind · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
YI
Yi-34B-200K-AEZAKMI-v2
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
KI
Kimi K2.5
Kimi · bartowski
Params1030B
Context256K
Q4_K_M580.4 GB
MI
Mixtral 8x22B v0.1
Mistral · LiteLLMs
Params141B
Context64K
Q4_K_M85.6 GB
QW
Qwen3.6 35B A3B Abliterated Heretic BF16
Qwen · lhca521
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwopus MoE 35B A3B APEX
Qwopus · mudler
Params34.7B
Context256K
Smallest14.3 GB
MI
Nous Hermes 2 Mixtral 8x7B DPO
Mistral · NousResearch
Params46.7B
Context32K
Q4_K_M28.4 GB
ST
Step 5 Preview
Step · smalinin
Params601B
Context1024K
Smallest1.2 GB
LL
Llama 3.1 Nemotron 70B Instruct HF i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MU
Muse Spark Open 816B A42B
Muse · Interchained
Params820B
Context1024K
Q4_K_M499.6 GB
LL
Meta Llama 3 70B Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
SK
TheDrummer Skyfall 36B v2
Skyfall · bartowski
Params36.9B
Context32K
Q4_K_M22.4 GB
NE
Nex N2.5 Mini
Nex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GP
gpt oss 120b heretic v2
gpt-oss · llmfan46
Params117B
Context128K
Smallest65.4 GB
LO
LongAlpaca 70B
Longalpaca · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
NO
Nous Capybara 34B
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
DE
DeepSeek V2.5 1210
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
LO
LongCat Flash Lite Sparse Ultra Uncensored Heretic Native MTP And LSA Preserved
Longcat · llmfan46
Params69B
Context960K
Q4_K_M41.2 GB
WI
WizardLM-2-8x22B
Wizardlm · backyardai
Params141B
Context64K
Q4_K_M85.6 GB
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
ME
meditron 70B
Meditron · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
Mirai 70B 0.1 Public Alpha
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · RomanOneAndFun
Params35.5B
Context256K
Smallest29.4 GB
YI
Yi-34Bx2-MoE-60B-DPO
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
ST
Step 3.5 Flash REAP 149B A11B i1
Step · mradermacher
Params149B
Context256K
Q4_K_M89.9 GB
CR
Crunchy onion
Crunchy · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
PE
Pelican1.0 VL 235B A22B FC
Pelican · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
DA
Darwin 35B A3B Opus
Darwin · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB