Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M404.4 GB
Reasoning
MI
Merge Mixtral Prometheus 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
YI
mlinmg_sg-raccoon-yi-200k-2.0
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
GGUF
LL
dolphin-2.9.1-llama-3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
CodingTool use
TR
TripleTrouble
Tripletrouble · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
Tool use
QW
Qwen1.5-110B-Chat
Qwen · bartowski
Params111B
Context32K
Q4_K_M67.2 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
MO
Dark Planet 8D Mirrored Chaos
Moe · DavidAU
Params47.5B
Context8K
Q4_K_M29.0 GB
Roleplay
OP
rombodawg_open_gpt4_8x7b_v0.2
Open · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MA
MAmmoTH 70B
Mammoth · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
YI
Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
DI
Sf Diogenes v0.1
Diogenes · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
Tool use
GL
GLM 5.3 Flash
GLM · AesSedai
Params321B
Context1024K
Q4_K_M202.0 GB
Vision
QW
Qwen3.8 Flash Coder CYBER Heretic
Qwen · mradermacher
Params42.6B
Context256K
Q4_K_M28.4 GB
CodingReasoningTool use
QW
Qwen3.8-Flash-Next Q4-D6 (Q4 experts, ~6.2-bit dense)
Qwen · flaviodelgrosso
Params180B
Context256K
Smallest175.2 GB
ReasoningTool use
YI
Faro Yi 34B DPO
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
MI
Mistral Small 4 119B 2603
Mistral · mradermacher
Params119B
Context1024K
Q4_K_M72.2 GB
Vision
DE
Deita-34b
Deita · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Qwen3.8 Flash Next Heretic 2
Qwen · spiritfather
Params177B
Context256K
Smallest2.8 GB
Vision
TI
tigerresearch_tigerbot-70b-chat-v4
Tigerbot · TheBloke
Params69.5B
Context2K
Q4_K_M41.8 GB
GGUF
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 768k Ctx
Qwen · mradermacher
Params42.4B
Context768K
Q4_K_M25.7 GB
CodingReasoning
SW
Swallow MX 8x7b NVE v0.1
Swallow · mradermacher
Params46.7B
Context4K
Q4_K_M28.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · acrogenesis
Params748B
Context1024K
Smallest359.3 GB
GGUF
MI
Midnight Miqu 103B v1.0 i1
Midnight · mradermacher
Params103B
Context32K
Smallest22.0 GB
GGUF
AI
airoboros l2 c70b 3.1.2
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
MI
MiroThinker 1.7
Mirothinker · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
GGUF
LL
Trendyol Cybersecurity LLM v2 70B Q4 K M
Llama · Trendyol
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
Vision
GR
Groot 65B A6B 261023
Groot · mradermacher
Params118B
Context256K
Q4_K_M79.7 GB
ReasoningTool useVision
MI
MiniCPM V 4.7 35B A3B Abliterated
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision

Other sizes

Keep browsing