Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
MI
ehartford_dolphin-2.5-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
MiniMax M3.1 Flash
Minimax · unsloth
Params426B
Context1024K
Smallest0.5 GB
OC
Occamy 1.0 Abliterated
Occamy · SC117
Params34.7B
Context256K
Q4_K_M16.5 GB
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LA
poolside_Laguna S 2.1
Laguna · lmstudio-community
Params118B
Context256K
Q4_K_M71.2 GB
FL
Flint
Flint · ggml-org
Params39.8B
Context256K
Q4_K_M23.4 GB
LL
Meta llama_Meta Llama 3 70B Instruct
Llama · ThomasBaruzier
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Flashnext Abliterated
Qwen · windowsxp811203
Params177B
Context256K
Q4_K_M119.2 GB
QW
Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · ScottzillaSystems
Params177B
Context—
Smallest0.9 GB
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
MI
MiniCPM V 4.7 35B A3B
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
KI
Kimi-K2.5
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
DE
Deepseek-V3.1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
QW
Qwen3.6 35B A3B Anko
Qwen · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
MU
Muse Spark Open 816B A42B
Muse · unsloth
Params816B
Context—
Smallest0.8 GB
OR
Ornith
Ornith · pfeifferj
Params34.7B
Context256K
Smallest13.0 GB
QW
Qwen3.8 Flash Next Uncensored ik llama
Qwen · ji-farthing
Params177B
Context—
Smallest2.2 GB
MI
MiMo-V2.6-Flash-RL
Mimo · YanissAmz
Params310B
Context1024K
Smallest107.8 GB
QW
Huihui Qwen3.5 35B A3B Abliterated
Qwen · HeYujie
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · DarkKitsune
Params151B
Context256K
Smallest61.4 GB
MI
MiMo-V2.6-Flash-RL
Mimo · ggml-org
Params309B
Context1024K
Smallest1.3 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
QW
Qwen3.6-35B-A3B
Qwen · TokenTinkerer
Params34.7B
Context256K
Q4_K_M0.6 GB
SP
Spectre 37B v1a
Spectre · BeaverAI
Params36.6B
Context256K
Q4_K_M22.2 GB
NE
NVIDIA Nemotron 3.5 Bolt Turbo Brilliance 50x 74B A9B 24GB
Nemotron · DavidAU
Params74B
Context256K
Smallest1.0 GB
MI
Mistral Small 4 119B 2603 Heretic
Mistral · Rioky
Params119B
Context1024K
Q4_K_M72.2 GB
HO
K2-Horizon-MoVA-36B-A4B
Horizon · bartowski
Params37.4B
Context512K
Q4_K_M22.7 GB
QW
Qwen3.8 Flash Next i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
QW
Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB