Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SO
Solar Open 100B
Solar · mradermacher
Params103B
Context128K
Q4_K_M62.3 GB
GGUF
MI
Mistral-Small-4-119B-2603
Mistral · mudler
Params119B
Context1024K
Smallest52.9 GB
Vision
HU
Hunyuan-A13B-Instruct
Hunyuan · unsloth
Params80B
Context256K
Q4_K_M48.8 GB
GGUF
QW
Scion FlashNext 176B A6B
Qwen · SkyIsNotGreen
Params177B
Context256K
Smallest57.6 GB
ReasoningTool use
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
CodingTool use
QW
Qwen3.5 35B A3B Claude Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Reasoning
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO
DeepSeek · AtomicChat
Params552B
Context1024K
Smallest120.7 GB
ReasoningTool use
YI
Yi 1.5 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
SA
SaulLM 54B Instruct i1
Saullm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 FP8
DeepSeek · AMAImedia
Params748B
Context1024K
Q4_K_M444.7 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
GGUF
YI
dolphin-2_2-yi-34b
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
MI
Mistral Small 4 119B Uncensored
Mistral · timteh673
Params119B
Context1024K
Q4_K_M72.2 GB
GGUF
AP
cantina-security/apex-flash-1-abliterated
Apex · freakyskittle
Params320B
Context1024K
Q4_K_M193.4 GB
Vision
WI
models--microsoft--WizardLM-2-8x22B
Wizardlm · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
LL
Llama 2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
Llama 3.3 70B Instruct ablated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Unrestricted
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
FL
flint
Flint · terelabs
Params39.8B
Context256K
Q4_K_M25.0 GB
ReasoningTool use
CO
C4Ai Command R Plus 08 2024
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
GL
GLM 5.3 Flash
GLM · SixVolts
Params321B
Context1024K
Smallest112.1 GB
Vision
MI
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
UM
Umbra-v3-MoE-4x11b-2ex
Umbra · mradermacher
Params36.1B
Context32K
Q4_K_M21.8 GB
GGUF
KA
KafkaLM 70B German V0.1
Kafkalm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
OR
Ornith 1.5 35B A3B
Ornith · IsValorum
Params34.7B
Context256K
Smallest12.6 GB
ReasoningTool useVision
LL
llama 65b instruct i1
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
GGUF
KA
KAT Coder V2.5 Dev 35B A3B MTP ABLITERATED
Kat · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Coding
DE
DeepSeek V3 0324 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
Coding
DE
DeepSeek V4 Flash 0731 Abliterated DS4 Headroom128
DeepSeek · apetersson
Params284B
Context—
Smallest6.0 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · ox-ox
Params284B
Context1024K
Smallest97.6 GB
GGUF

Other sizes

Keep browsing