Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
cerebras/GLM-4.7-REAP-218B-A32B
GLM · bartowski
Params218B
Context198K
Q4_K_M133.8 GB
ReasoningTool use
LL
Dracarys Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
dolphin-2.9.2-qwen2-72b
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use
MI
Dolphin 2.7 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
AS
AstroSage 70B
Astrosage · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
R1
R1 1776
bartowski
Params671B
Context160K
Q4_K_M404.4 GB
ReasoningTool use
QW
Qwable v2
Qwable · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
CO
commandr-35b-cpt-sft
Commandr · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
KE
Keural Nova v1.1
Keural · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
QW
Qwen3.5 35B Uncensored YaRN 1M
Qwen · Exil01
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
IN
Index Translate 35B A3B preview
Index · Abu-Dju
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
MI
miqu 1 70b i1
Miqu · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
LL
R1 1776 Distill Llama 70b
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
GT
GTA1 72B
Gta · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
GGUF
QW
Huihui-Qwen3.6-35B-A3B-abliterated
Qwen · dnnagy
Params35.5B
Context256K
Smallest21.3 GB
ReasoningTool useVision
QW
RedHatAI/Qwen3.6-35B-A3B-NVFP4
Qwen · knoopx
Params34.7B
Context256K
Smallest22.5 GB
ReasoningTool useVision
SW
Swallow-70b-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
GR
GritLM 8x7B
Gritlm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
PH
PhAI-IDE-72B
Phai · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool use
EL
L3.3 Electra R1 70b
Electra · ddh0
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
GE
Gemma 3 40b
Gemma · bartowski
Params39.8B
Context128K
Q4_K_M24.3 GB
GGUF
MI
MiniMax M3.1 Flash abliterated
Minimax · orcarouter
Params426B
Context1024K
Smallest0.9 GB
ReasoningTool use
KY
Kyllima 34B v1 i1
Kyllima · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
SA
SambaLingo Arabic Chat 70B
Sambalingo · mradermacher
Params69.4B
Context4K
Q4_K_M41.7 GB
GGUF
MI
Mixtral 8x7B Instruct v0.1 Parasite
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B Sydney
Qwen · Evidence114
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Claude Genesis
Qwen · bowser1991
Params34.7B
Context256K
Smallest17.3 GB
ReasoningTool useVision
LL
Llama-3-70B-Instruct-norefusal
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes V10 Dequantized
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision

Other sizes

Keep browsing