Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
MiMo V2.6 Flash REAP50
Mimo · patrickbdevaney
Params157B
Context1024K
Smallest2.4 GB
HU
Huozi3.5
Huozi · mradermacher
Params46.9B
Context32K
Q4_K_M28.6 GB
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
SY
migtissera_synthia-70b-v1.2
Synthia · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
HO
K2 Horizon MoVA 36B A4B Uncensored
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
QW
Qwen3.6 Candid Coder 35B A3B
Qwen · DarkKitsune
Params35.5B
Context256K
Smallest0.4 GB
AP
Apertus 70B Instruct 2509 Abliterated
Apertus · mradermacher
Params70.6B
Context64K
Q4_K_M43.7 GB
MI
dolphin-2.9.2-mixtral-8x22b
Mistral · crusoeai
Params141B
Context64K
Q4_K_M85.6 GB
QW
Qwopus3.6 35B A3B Coder Uncensored Genesis Hermes MTP
Qwen · LuffyTheFox
Params35.5B
Context256K
Smallest20.7 GB
FA
FashionGPT 70B V1.1 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
AE
Aetheria L2 70B i1
Aetheria · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · wang-yang
Params35.5B
Context256K
Smallest31.4 GB
HY
Hy3 295B A21B
YanissAmz
Params299B
Context—
Smallest0.6 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B heretic ara
Nemotron · spiritfather
Params121B
Context1024K
Q4_K_M86.1 GB
DE
Deepseek-Tng-R1T2-Chimera
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
YU
Yuan2 M32 hf IMat
Yuan · legraphista
Params40.2B
Context4K
Smallest8.7 GB
MI
Mistral-Large-3-675B-Instruct-2512
Mistral · unsloth
Params675B
Context288K
Q4_K_M407.0 GB
NO
Nous Puffin 70B i1
Nous · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Occult Nail 1.0 35B A3B
Qwen · peculiar-ragdoll
Params34.7B
Context256K
Smallest12.3 GB
NA
NaNovel 35B A3B
Nanovel · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.6 35B A3B
Qwen · FreedomAISVR
Params34.7B
Context256K
Smallest19.8 GB
LL
nvidia Llama 3 3 Nemotron Super 49B v1
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
AI
airoboros 34b 3.3 i1
Airoboros · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
QW
Qwable v1
Qwable · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
QW
Qwen3.8 Flash Next DS4 IQ2
Qwen · ivanfioravanti
Params136B
Context256K
Smallest44.8 GB
QW
Qwen3.6-35B-A3B
Qwen · peculiar-ragdoll
Params34.7B
Context256K
Smallest13.7 GB
MI
MiniMax M2.7 Abliterated
Minimax · Youssofal
Params229B
Context192K
Q4_K_M138.3 GB
DR
drex v2.0 Q8 0
Drex · nace-ai
Params34.7B
Context256K
Smallest36.9 GB
QW
Qwen3.8 Flash Next Abliterated
Qwen · apetersson
Params177B
Context256K
Smallest184.3 GB