Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NO
notux 8x7b v1
Notux · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
SW
Swallow-70b-NVE-hf
Swallow · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
Air Striker Mixtral 8x7B ZLoss Instruct
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
QW
Qwen3 42B A3B 2507 TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoningTool use
GR
GRM 3.2 Sky
Grm · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.8 Flash Next strixflash
Qwen · tawei-amd
Params177B
Context256K
Smallest2.8 GB
GGUF
EU
Euryale 1.3 longLORA 70b rope8 32k fp16
Euryale · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · whm0627
Params177B
Context256K
Smallest72.5 GB
GGUF
OR
Ornith-1.5-35B-A3B-Uncensored
Ornith · vonvonhero
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
BA
bagel dpo 34b v0.5
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
CodingRoleplayTool use
TE
migtissera_tess-m-v1.1
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
MO
L3.1 MOE 6X8B Dark Reasoning Dantes Peak HORROR R1 Uncensored 36B
Moe · Jaedwards1986
Params36.2B
Context128K
Q4_K_M22.0 GB
ReasoningRoleplay
PY
Pyrhea 72B i1
Pyrhea · mradermacher
Params72B
Context32K
Q4_K_M43.8 GB
GGUF
YI
Yi-34Bx2-MoE-60B
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
OR
Ornith 1.0 35B AEON Ultimate Uncensored
Ornith · vcruz305
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
ZE
Zen4 Thinking
Zen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Reasoning
MU
Muse Spark Open 816B A42B GGUF UltraOptimised Curated Protium
Muse · Solstice-AI
Params816B
Context—
Smallest0.8 GB
GGUF
KI
moonshotai Kimi K2.6
Kimi · bartowski
Params1030B
Context256K
Smallest1.5 GB
GGUF
LI
Ling 3.0 flash VL
Ling · AtomicChat
Params124B
Context128K
Q4_K_M79.3 GB
ReasoningTool useVision
QW
calme-2.2-qwen2.5-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
AT
Athene 70B
Athene · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
HE
Hermes 4.3 36B ABLITERATED Heretic
Hermes · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
Tool use
MI
Solstice Mixtral v1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.5 40B Claude 4.5 Opus High Reasoning Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
NE
NVIDIA-Nemotron-3.5-Transcribe-30B-A4B BF16
Nemotron · Jmica
Params38B
Context1024K
Smallest13.9 GB
Vision
QW
spiral da HYAH Qwen2.5 72b i1
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
OR
Ornith 1.5 Cyclos 1M Uncensored
Ornith · mradermacher
Params35.5B
Context1024K
Q4_K_M21.7 GB
Vision
KI
KitchenSink 103b i1
Kitchensink · mradermacher
Params103B
Context4K
Smallest22.0 GB
Roleplay
AS
astrollama 2 70b base aic i1
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Other sizes

Keep browsing