Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
MiMo V2.6 Flash REAP50
Mimo · patrickbdevaney
Params157B
Context1024K
Smallest2.4 GB
ReasoningTool useVision
HU
Huozi3.5
Huozi · mradermacher
Params46.9B
Context32K
Q4_K_M28.6 GB
GGUF
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
SY
migtissera_synthia-70b-v1.2
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
HO
K2 Horizon MoVA 36B A4B Uncensored
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
GGUF
QW
Qwen3.6 Candid Coder 35B A3B
Qwen · DarkKitsune
Params35.5B
Context256K
Smallest0.4 GB
GGUF
AP
Apertus 70B Instruct 2509 Abliterated
Apertus · mradermacher
Params70.6B
Context64K
Q4_K_M43.7 GB
GGUF
MI
dolphin-2.9.2-mixtral-8x22b
Mistral · crusoeai
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
QW
Qwopus3.6 35B A3B Coder Uncensored Genesis Hermes MTP
Qwen · LuffyTheFox
Params35.5B
Context256K
Smallest20.7 GB
CodingReasoningTool use
FA
FashionGPT 70B V1.1 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
AE
Aetheria L2 70B i1
Aetheria · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · wang-yang
Params35.5B
Context256K
Smallest31.4 GB
ReasoningTool use
HY
Hy3 295B A21B
YanissAmz
Params299B
Context—
Smallest0.6 GB
GGUF
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B heretic ara
Nemotron · spiritfather
Params121B
Context1024K
Q4_K_M86.1 GB
ReasoningTool useVision
DE
Deepseek-Tng-R1T2-Chimera
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
GGUF
YU
Yuan2 M32 hf IMat
Yuan · legraphista
Params40.2B
Context4K
Smallest8.7 GB
GGUF
MI
Mistral-Large-3-675B-Instruct-2512
Mistral · unsloth
Params675B
Context288K
Q4_K_M407.0 GB
Vision
NO
Nous Puffin 70B i1
Nous · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Occult Nail 1.0 35B A3B
Qwen · peculiar-ragdoll
Params34.7B
Context256K
Smallest12.3 GB
ReasoningVision
NA
NaNovel 35B A3B
Nanovel · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.6 35B A3B
Qwen · FreedomAISVR
Params34.7B
Context256K
Smallest19.8 GB
Vision
LL
nvidia Llama 3 3 Nemotron Super 49B v1
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
AI
airoboros 34b 3.3 i1
Airoboros · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
RoleplayTool use
QW
Qwable v1
Qwable · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Tool useVision
QW
Qwen3.8 Flash Next DS4 IQ2
Qwen · ivanfioravanti
Params136B
Context256K
Smallest44.8 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · peculiar-ragdoll
Params34.7B
Context256K
Smallest13.7 GB
ReasoningVision
MI
MiniMax M2.7 Abliterated
Minimax · Youssofal
Params229B
Context192K
Q4_K_M138.3 GB
ReasoningTool use
DR
drex v2.0 Q8 0
Drex · nace-ai
Params34.7B
Context256K
Smallest36.9 GB
ReasoningTool use
QW
Qwen3.8 Flash Next Abliterated
Qwen · apetersson
Params177B
Context256K
Smallest184.3 GB
Vision

Other sizes

Keep browsing