Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4.1 Flash
DeepSeek · mxxm-t
Params748B
Context1024K
Smallest8.0 GB
GGUF
ME
L3.1 70b MeowMix i1
Meowmix · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
PH
Phind 70B
Phind · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Coding
YI
Yi-34B-200K-AEZAKMI-v2
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
KI
Kimi K2.5
Kimi · bartowski
Params1030B
Context256K
Q4_K_M580.4 GB
Vision
MI
Mixtral 8x22B v0.1
Mistral · LiteLLMs
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
QW
Qwen3.6 35B A3B Abliterated Heretic BF16
Qwen · lhca521
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
QW
Qwopus MoE 35B A3B APEX
Qwopus · mudler
Params34.7B
Context256K
Smallest14.3 GB
GGUF
MI
Nous Hermes 2 Mixtral 8x7B DPO
Mistral · NousResearch
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
ST
Step 5 Preview
Step · smalinin
Params601B
Context1024K
Smallest1.2 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MU
Muse Spark Open 816B A42B
Muse · Interchained
Params820B
Context1024K
Q4_K_M499.6 GB
GGUF
LL
Meta Llama 3 70B Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SK
TheDrummer Skyfall 36B v2
Skyfall · bartowski
Params36.9B
Context32K
Q4_K_M22.4 GB
GGUF
NE
Nex N2.5 Mini
Nex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
GP
gpt oss 120b heretic v2
gpt-oss · llmfan46
Params117B
Context128K
Smallest65.4 GB
GGUF
LO
LongAlpaca 70B
Longalpaca · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
NO
Nous Capybara 34B
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
DE
DeepSeek V2.5 1210
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
GGUF
LO
LongCat Flash Lite Sparse Ultra Uncensored Heretic Native MTP And LSA Preserved
Longcat · llmfan46
Params69B
Context960K
Q4_K_M41.2 GB
GGUF
WI
WizardLM-2-8x22B
Wizardlm · backyardai
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
ME
meditron 70B
Meditron · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
Mirai 70B 0.1 Public Alpha
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
QW
Qwen3.6 35B A3B Claude 4.7 Opus Reasoning Distilled
Qwen · RomanOneAndFun
Params35.5B
Context256K
Smallest29.4 GB
Reasoning
YI
Yi-34Bx2-MoE-60B-DPO
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
ST
Step 3.5 Flash REAP 149B A11B i1
Step · mradermacher
Params149B
Context256K
Q4_K_M89.9 GB
GGUF
CR
Crunchy onion
Crunchy · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PE
Pelican1.0 VL 235B A22B FC
Pelican · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
Vision
DA
Darwin 35B A3B Opus
Darwin · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
ReasoningTool useVision

Other sizes

Keep browsing