Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
WI
wizardlm_wizardmath-70b-v1.0
Wizardmath · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
GGUF
DO
Dolphin 2.2 70b
Dolphin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GL
GLM 4.6 Derestricted
GLM · bartowski
Params357B
Context198K
Q4_K_M217.7 GB
GGUF
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Unrestricted
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
YI
Faro Yi 34B
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Genesis Final Safetensors
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · smalinin
Params748B
Context1024K
Smallest8.5 GB
GGUF
QW
Qwen2 57B A14B Instruct
Qwen · Qwen
Params57.4B
Context32K
Q4_K_M34.9 GB
GGUF
PI
maywell_pivot-moe
Pivot · TheBloke
Params36B
Context32K
Q4_K_M20.4 GB
GGUF
QW
Qwen3-Coder-480B-A35B-Instruct-1M
Qwen · unsloth
Params480B
Context1024K
Q4_K_M290.1 GB
Coding
QW
Qwen3-Vl-235B-A22B-Thinking-1M
Qwen · unsloth
Params235B
Context977K
Q4_K_M142.2 GB
ReasoningVision
LL
Smaug-Llama-3-70B-Instruct-abliterated-v3
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
miqu 1 103b i1
Miqu · mradermacher
Params103B
Context32K
Smallest22.0 GB
GGUF
LL
Llama3.3 70B oncefuturepunk v0.1a
Llama · schonsense
Params70.6B
Context128K
Q4_K_M43.3 GB
GGUF
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Smallest8.5 GB
GGUF
KI
Kimi Linear 48B A3B Instruct
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
GGUF
LL
Meta Llama 3 70B Instruct 64k i1
Llama · mradermacher
Params70.6B
Context64K
Q4_K_M42.5 GB
GGUF
FL
flint roleplay antislop
Flint · rawmodels
Params39.8B
Context256K
Q4_K_M25.3 GB
Roleplay
DE
deepseek llm 67b base i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
CA
CalibForge 35B A3B
Calibforge · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
AU
Austral 70B Winton
Austral · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
KI
Kimi-K2-Instruct-0905
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
GGUF
WI
WinterGoddess 1.4x limarpv3 70B L2 32k Requant
Wintergoddess · NexesQuants
Params69B
Context32K
Smallest14.5 GB
GGUF
QW
Qwen3.8 Flash Coder 85GB BF16
Qwen · IsValorum
Params42.6B
Context256K
Smallest85.3 GB
CodingReasoning
QW
Qwen3.6 35B A3B
Qwen · eaddario
Params34.7B
Context—
Smallest0.4 GB
GGUF
LL
Cogito-V2-Preview-Llama-70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DU
Dusk-Miqu-70B
Dusk · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
GGUF
BE
35b beta long i1
Beta · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
Tool use
YI
brucethemoose_caplattessdolxaboros-yi-34b-200k-dare-ties-highdensity
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision

Other sizes

Keep browsing