Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
SO
Solar Open 100B
Solar · mradermacher
Params103B
Context128K
Q4_K_M62.3 GB
MI
Mistral-Small-4-119B-2603
Mistral · mudler
Params119B
Context1024K
Smallest52.9 GB
HU
Hunyuan-A13B-Instruct
Hunyuan · unsloth
Params80B
Context256K
Q4_K_M48.8 GB
QW
Scion FlashNext 176B A6B
Qwen · SkyIsNotGreen
Params177B
Context256K
Smallest57.6 GB
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
QW
Qwen3.5 35B A3B Claude Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO
DeepSeek · AtomicChat
Params552B
Context1024K
Smallest120.7 GB
YI
Yi 1.5 34B
Yi · RichardErkhov
Params34.4B
Context4K
Q4_K_M20.7 GB
SA
SaulLM 54B Instruct i1
Saullm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
DE
DeepSeek V4.1 Flash 1017 FP8
DeepSeek · AMAImedia
Params748B
Context1024K
Q4_K_M444.7 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
YI
dolphin-2_2-yi-34b
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
MI
Mistral Small 4 119B Uncensored
Mistral · timteh673
Params119B
Context1024K
Q4_K_M72.2 GB
AP
cantina-security/apex-flash-1-abliterated
Apex · freakyskittle
Params320B
Context1024K
Q4_K_M193.4 GB
WI
models--microsoft--WizardLM-2-8x22B
Wizardlm · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
LL
Llama 2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 3.3 70B Instruct ablated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Unrestricted
Params34.7B
Context256K
Q4_K_M21.2 GB
FL
flint
Flint · terelabs
Params39.8B
Context256K
Q4_K_M25.0 GB
CO
C4Ai Command R Plus 08 2024
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
GL
GLM 5.3 Flash
GLM · SixVolts
Params321B
Context1024K
Smallest112.1 GB
MI
Mixtral-8x7B-Instruct-v0.1-LimaRP-ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
UM
Umbra-v3-MoE-4x11b-2ex
Umbra · mradermacher
Params36.1B
Context32K
Q4_K_M21.8 GB
KA
KafkaLM 70B German V0.1
Kafkalm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
OR
Ornith 1.5 35B A3B
Ornith · IsValorum
Params34.7B
Context256K
Smallest12.6 GB
LL
llama 65b instruct i1
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
KA
KAT Coder V2.5 Dev 35B A3B MTP ABLITERATED
Kat · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
DE
DeepSeek V3 0324 BF16
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.4 GB
DE
DeepSeek V4 Flash 0731 Abliterated DS4 Headroom128
DeepSeek · apetersson
Params284B
Context—
Smallest6.0 GB
DE
DeepSeek V4 Flash
DeepSeek · ox-ox
Params284B
Context1024K
Smallest97.6 GB