Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
Neuron 46x4B Instruct
Neuron · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
Tool use
FL
Flint APEX I MiniPlus V2.1
Flint · IsValorum
Params39.8B
Context256K
Smallest15.9 GB
CodingReasoningTool use
FL
Flint 40B A2.5B Abliterated
Flint · mradermacher
Params39.8B
Context256K
Q4_K_M24.2 GB
ReasoningTool use
ME
Mega Destroyer 8x7B
Mega · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
LL
Llama-3_3-Nemotron-Super-49B-V1
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
Coding
ST
Step 3.7 Flash AEON Ultimate Abliterated
Step · Vegss
Params197B
Context256K
Smallest48.4 GB
ReasoningTool useVision
DE
Deepseek ai.DeepSeek V3.2 BF16
DeepSeek · DevQuasar
Params670B
Context160K
Q4_K_M404.5 GB
GGUF
LL
llama 65b hf i1
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
SY
synthia-70b-v1.1
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
CO
C4Ai Command A 03 2025
Command R · bartowski
Params111B
Context16K
Q4_K_M67.1 GB
GGUF
QW
Replete LLM V2.5 Qwen 72b
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
OR
Ornith 1.5 35B A3B
Ornith · NANI-Nithin
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
Roleplay
AT
Athene 70B
Athene · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
MI
Mistral Magistral Devstral Instruct FUSED CODER Reasoning 36B
Mistral · mradermacher
Params35.8B
Context128K
Q4_K_M21.7 GB
CodingReasoning
QW
Qwen3.6 35B A3B StyleTune
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Roleplay
GR
Grug 35b
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
CodingReasoningTool use
QW
Qwen3.6 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
DE
deepsex 34b
Deepsex · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
Roleplay
MI
Mixtral 8x7B v0.1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
QW
Qwen3.5-397B-A17B
Qwen · mudler
Params397B
Context256K
Smallest186.9 GB
Vision
MI
MiniCPM V 4.7 35B A3B APEX I NanoPlus
MiniCPM · IsValorum
Params34.7B
Context256K
Q4_K_M0.2 GB
Vision
JA
Jais-3-MoVA-36B-A4B
Jais · IFM
Params37.4B
Context512K
Q4_K_M22.4 GB
ReasoningTool use
LL
Llama 3_3 Nemotron Super 49B GenRM Multilingual
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
CO
c4ai-command-r-plus
Command R · dranger003
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
NE
Nex N2 mini APEX
Nex · mudler
Params34.7B
Context256K
Smallest13.5 GB
Vision
LI
Liberated Miqu 70B
Liberated · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
MI
cerebras/MiniMax-M2-REAP-139B-A10B
Minimax · bartowski
Params139B
Context192K
Q4_K_M84.4 GB
GGUF
BT
badtheorylabs BTL 4
Btl · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
CodingReasoningTool use

Other sizes

Keep browsing