Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V3 BF16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.4 GB
GGUF
GP
OpenAi GPT Oss 36B BrainStorm20x Uncensored
gpt-oss · mradermacher
Params36.6B
Context128K
Q4_K_M27.5 GB
CodingReasoning
YI
Yi-1.5-34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
GE
genz 70b i1
Genz · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
DE
DeepSeek R1 Distill Llama 70B Abliterated GGUF ARMADO
DeepSeek · Thaurock
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
PL
Platypus2 70B Instruct
Platypus · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.5 Uncensored Aggressive
Qwen · tripolskypetr
Params122B
Context256K
Q4_K_M1.3 GB
Vision
LL
Dobby Unhinged Llama 3.3 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
LI
Ling-1T
Ling · unsloth
Params1000B
Context32K
Q4_K_M604.7 GB
GGUF
YI
Hyperion 3.0 Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M21.2 GB
Coding
IN
L3.1 70b Inori i1
Inori · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
LL
shisa v2.1 llama3.3 70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
EU
Euryale 1.3 longLORA 70b rope8 32k iMat
Euryale · InferenceIllusionist
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3 235B A22B Instruct 2507
Qwen · lmstudio-community
Params235B
Context256K
Q4_K_M142.6 GB
GGUF
QW
Qwen2.5 72B 0.6x Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
QW
SVD Qwen3 Coder Next Thinking
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
CodingReasoningTool use
QW
Kataguru Sceptic 35B A3B v2.8.1 BF16
Qwen · kataguru
Params35.2B
Context256K
Smallest12.9 GB
ReasoningTool useVision
MI
Mistral Devstral 2505 CODER Brainstorm40x 44B
Mistral · mradermacher
Params43.6B
Context128K
Q4_K_M26.4 GB
Coding
KO
Kolibri 1
Kolibri · webmp3
Params74.4B
Context256K
Smallest21.5 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct
Llama · lmstudio-community
Params108B
Context10240K
Q4_K_M67.5 GB
Vision
MI
Mistral Small 4 119B 2603
Mistral · mradermacher
Params119B
Context1024K
Q4_K_M72.2 GB
GGUF
EU
L3.3 70B Euryale v2.3 i1
Euryale · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
NO
doctor-shotgun_norobara-zloss-8x7b
Norobara · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
QW
Qwen3 54B A3B 2507 YOYO2 TOTAL RECALL Instruct
Qwen · mradermacher
Params53B
Context986K
Q4_K_M32.1 GB
CodingReasoningTool use
CA
CabraLlama3-70b
Cabrallama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
OP
openbuddy-yi1.5-34b-v21.2-32k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
LL
Llama3 70B ShiningValiant2 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen3 Coder Next REAM
Qwen · mradermacher
Params60B
Context256K
Q4_K_M36.7 GB
Coding
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision

Other sizes

Keep browsing