Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
WI
wizardlm_wizardmath-70b-v1.0
Wizardmath · TheBloke
Params69B
Context2K
Q4_K_M41.4 GB
DO
Dolphin 2.2 70b
Dolphin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GL
GLM 4.6 Derestricted
GLM · bartowski
Params357B
Context198K
Q4_K_M217.7 GB
QW
Qwen3.5-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Unrestricted
Params34.7B
Context256K
Q4_K_M21.2 GB
YI
Faro Yi 34B
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Final Safetensors
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · smalinin
Params748B
Context1024K
Smallest8.5 GB
QW
Qwen2 57B A14B Instruct
Qwen · Qwen
Params57.4B
Context32K
Q4_K_M34.9 GB
PI
maywell_pivot-moe
Pivot · TheBloke
Params36B
Context32K
Q4_K_M20.4 GB
QW
Qwen3-Coder-480B-A35B-Instruct-1M
Qwen · unsloth
Params480B
Context1024K
Q4_K_M290.1 GB
QW
Qwen3-Vl-235B-A22B-Thinking-1M
Qwen · unsloth
Params235B
Context977K
Q4_K_M142.2 GB
LL
Smaug-Llama-3-70B-Instruct-abliterated-v3
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
miqu 1 103b i1
Miqu · mradermacher
Params103B
Context32K
Smallest22.0 GB
LL
Llama3.3 70B oncefuturepunk v0.1a
Llama · schonsense
Params70.6B
Context128K
Q4_K_M43.3 GB
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Smallest8.5 GB
KI
Kimi Linear 48B A3B Instruct
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
LL
Meta Llama 3 70B Instruct 64k i1
Llama · mradermacher
Params70.6B
Context64K
Q4_K_M42.5 GB
FL
flint roleplay antislop
Flint · rawmodels
Params39.8B
Context256K
Q4_K_M25.3 GB
DE
deepseek llm 67b base i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
CA
CalibForge 35B A3B
Calibforge · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
AU
Austral 70B Winton
Austral · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
KI
Kimi-K2-Instruct-0905
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
WI
WinterGoddess 1.4x limarpv3 70B L2 32k Requant
Wintergoddess · NexesQuants
Params69B
Context32K
Smallest14.5 GB
QW
Qwen3.8 Flash Coder 85GB BF16
Qwen · IsValorum
Params42.6B
Context256K
Smallest85.3 GB
QW
Qwen3.6 35B A3B
Qwen · eaddario
Params34.7B
Context—
Smallest0.4 GB
LL
Cogito-V2-Preview-Llama-70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
DU
Dusk-Miqu-70B
Dusk · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
BE
35b beta long i1
Beta · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
YI
brucethemoose_caplattessdolxaboros-yi-34b-200k-dare-ties-highdensity
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB