Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek R1
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M404.4 GB
MI
Merge Mixtral Prometheus 8x7B i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
YI
mlinmg_sg-raccoon-yi-200k-2.0
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
LL
dolphin-2.9.1-llama-3-70b
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
TR
TripleTrouble
Tripletrouble · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
QW
Qwen1.5-110B-Chat
Qwen · bartowski
Params111B
Context32K
Q4_K_M67.2 GB
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
MO
Dark Planet 8D Mirrored Chaos
Moe · DavidAU
Params47.5B
Context8K
Q4_K_M29.0 GB
OP
rombodawg_open_gpt4_8x7b_v0.2
Open · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
MA
MAmmoTH 70B
Mammoth · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
YI
Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
DI
Sf Diogenes v0.1
Diogenes · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
GL
GLM 5.3 Flash
GLM · AesSedai
Params321B
Context1024K
Q4_K_M202.0 GB
QW
Qwen3.8 Flash Coder CYBER Heretic
Qwen · mradermacher
Params42.6B
Context256K
Q4_K_M28.4 GB
QW
Qwen3.8-Flash-Next Q4-D6 (Q4 experts, ~6.2-bit dense)
Qwen · flaviodelgrosso
Params180B
Context256K
Smallest175.2 GB
YI
Faro Yi 34B DPO
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
MI
Mistral Small 4 119B 2603
Mistral · mradermacher
Params119B
Context1024K
Q4_K_M72.2 GB
DE
Deita-34b
Deita · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen3.8 Flash Next Heretic 2
Qwen · spiritfather
Params177B
Context256K
Smallest2.8 GB
TI
tigerresearch_tigerbot-70b-chat-v4
Tigerbot · TheBloke
Params69.5B
Context2K
Q4_K_M41.8 GB
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 768k Ctx
Qwen · mradermacher
Params42.4B
Context768K
Q4_K_M25.7 GB
SW
Swallow MX 8x7b NVE v0.1
Swallow · mradermacher
Params46.7B
Context4K
Q4_K_M28.4 GB
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · acrogenesis
Params748B
Context1024K
Smallest359.3 GB
MI
Midnight Miqu 103B v1.0 i1
Midnight · mradermacher
Params103B
Context32K
Smallest22.0 GB
AI
airoboros l2 c70b 3.1.2
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
MI
MiroThinker 1.7
Mirothinker · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
LL
Trendyol Cybersecurity LLM v2 70B Q4 K M
Llama · Trendyol
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama-4-Maverick-17B-128E-Instruct
Llama · unsloth
Params400B
Context1024K
Q4_K_M242.8 GB
GR
Groot 65B A6B 261023
Groot · mradermacher
Params118B
Context256K
Q4_K_M79.7 GB
MI
MiniCPM V 4.7 35B A3B Abliterated
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB