Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
NE
Neuron 46x4B Instruct
Neuron · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
FL
Flint APEX I MiniPlus V2.1
Flint · IsValorum
Params39.8B
Context256K
Smallest15.9 GB
FL
Flint 40B A2.5B Abliterated
Flint · mradermacher
Params39.8B
Context256K
Q4_K_M24.2 GB
ME
Mega Destroyer 8x7B
Mega · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
LL
Llama-3_3-Nemotron-Super-49B-V1
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
ST
Step 3.7 Flash AEON Ultimate Abliterated
Step · Vegss
Params197B
Context256K
Smallest48.4 GB
DE
Deepseek ai.DeepSeek V3.2 BF16
DeepSeek · DevQuasar
Params670B
Context160K
Q4_K_M404.5 GB
LL
llama 65b hf i1
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
SY
synthia-70b-v1.1
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
CO
C4Ai Command A 03 2025
Command R · bartowski
Params111B
Context16K
Q4_K_M67.1 GB
QW
Replete LLM V2.5 Qwen 72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
Ornith 1.5 35B A3B
Ornith · NANI-Nithin
Params35.5B
Context256K
Q4_K_M21.7 GB
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
AT
Athene 70B
Athene · legraphista
Params70.6B
Context8K
Smallest15.3 GB
MI
Mistral Magistral Devstral Instruct FUSED CODER Reasoning 36B
Mistral · mradermacher
Params35.8B
Context128K
Q4_K_M21.7 GB
QW
Qwen3.6 35B A3B StyleTune
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GR
Grug 35b
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
QW
Qwen3.6 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
DE
deepsex 34b
Deepsex · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
MI
Mixtral 8x7B v0.1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
QW
Qwen3.5-397B-A17B
Qwen · mudler
Params397B
Context256K
Smallest186.9 GB
MI
MiniCPM V 4.7 35B A3B APEX I NanoPlus
MiniCPM · IsValorum
Params34.7B
Context256K
Q4_K_M0.2 GB
JA
Jais-3-MoVA-36B-A4B
Jais · IFM
Params37.4B
Context512K
Q4_K_M22.4 GB
LL
Llama 3_3 Nemotron Super 49B GenRM Multilingual
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
CO
c4ai-command-r-plus
Command R · dranger003
Params104B
Context128K
Q4_K_M62.8 GB
NE
Nex N2 mini APEX
Nex · mudler
Params34.7B
Context256K
Smallest13.5 GB
LI
Liberated Miqu 70B
Liberated · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
MI
cerebras/MiniMax-M2-REAP-139B-A10B
Minimax · bartowski
Params139B
Context192K
Q4_K_M84.4 GB
BT
badtheorylabs BTL 4
Btl · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB