Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
DE
DeepSeek V3 BF16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.4 GB
GP
OpenAi GPT Oss 36B BrainStorm20x Uncensored
gpt-oss · mradermacher
Params36.6B
Context128K
Q4_K_M27.5 GB
YI
Yi-1.5-34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GE
genz 70b i1
Genz · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
DE
DeepSeek R1 Distill Llama 70B Abliterated GGUF ARMADO
DeepSeek · Thaurock
Params70.6B
Context128K
Q4_K_M42.5 GB
PL
Platypus2 70B Instruct
Platypus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3.5 Uncensored Aggressive
Qwen · tripolskypetr
Params122B
Context256K
Q4_K_M1.3 GB
LL
Dobby Unhinged Llama 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LI
Ling-1T
Ling · unsloth
Params1000B
Context32K
Q4_K_M604.7 GB
YI
Hyperion 3.0 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
IN
L3.1 70b Inori i1
Inori · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
shisa v2.1 llama3.3 70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
EU
Euryale 1.3 longLORA 70b rope8 32k iMat
Euryale · InferenceIllusionist
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3 235B A22B Instruct 2507
Qwen · lmstudio-community
Params235B
Context256K
Q4_K_M142.6 GB
QW
Qwen2.5 72B 0.6x Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
QW
SVD Qwen3 Coder Next Thinking
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
QW
Kataguru Sceptic 35B A3B v2.8.1 BF16
Qwen · kataguru
Params35.2B
Context256K
Smallest12.9 GB
MI
Mistral Devstral 2505 CODER Brainstorm40x 44B
Mistral · mradermacher
Params43.6B
Context128K
Q4_K_M26.4 GB
KO
Kolibri 1
Kolibri · webmp3
Params74.4B
Context256K
Smallest21.5 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · lmstudio-community
Params108B
Context10240K
Q4_K_M67.5 GB
MI
Mistral Small 4 119B 2603
Mistral · mradermacher
Params119B
Context1024K
Q4_K_M72.2 GB
EU
L3.3 70B Euryale v2.3 i1
Euryale · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NO
doctor-shotgun_norobara-zloss-8x7b
Norobara · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
QW
Qwen3 54B A3B 2507 YOYO2 TOTAL RECALL Instruct
Qwen · mradermacher
Params53B
Context986K
Q4_K_M32.1 GB
CA
CabraLlama3-70b
Cabrallama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
OP
openbuddy-yi1.5-34b-v21.2-32k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
LL
Llama3 70B ShiningValiant2 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen3 Coder Next REAM
Qwen · mradermacher
Params60B
Context256K
Q4_K_M36.7 GB
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB