Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
PR
Nohobby L3.3 Prikol 70B EXTRA
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
CH
Chronos Platinum 72B i1
Chronos · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
IQ
IQuest Coder V1 40B Base Stage1
Iquest · mradermacher
Params39.8B
Context16K
Q4_K_M24.0 GB
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Tetra04
Params34.7B
Context256K
Q4_K_M21.2 GB
FL
Flint APEX I NanoPlus V2.1
Flint · IsValorum
Params39.8B
Context256K
Smallest13.2 GB
LL
Hermes-2-Theta-Llama-3-70B-32k
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next
Qwen · pugant
Params177B
Context256K
Smallest81.5 GB
GL
zai org GLM 4.7
GLM · bartowski
Params358B
Context198K
Q4_K_M218.5 GB
LL
Llama-3-70b-Arimas-story-RP-V1.5
Llama · mradermacher
Params70.6B
Context256K
Q4_K_M42.5 GB
SA
Samantha 1.11 70B
Samantha · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
KA
Karakuri Lm 8x7b Instruct v0.1
Karakuri · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
Llama Primus Nemotron 70B Instruct i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
Ornith 1.5 35B Uncensored YMQ MTP
Ornith · dopaemon
Params35.5B
Context256K
Smallest12.0 GB
QW
Qwen3.6 35B A3B Abliterated v2
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
FA
FashionGPT 70B V1.2
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
MI
MiniMax M2.1 REAP 172B A10B i1
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
LL
Llama 3.1 70B ArliAI RPMax v1.1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Huihui Qwen3.5 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwopus3.6 35B A3B Coder
Qwopus · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen2.5 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.8 Flash Next APEX
Qwen · Atomic-Germ
Params177B
Context—
Smallest0.6 GB
DO
dolphin 2.2 70B
Dolphin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GL
GLM 5.3 Flash
GLM · marcorez8
Params321B
Context1024K
Smallest0.0 GB
LL
Meta Llama 3.1 405B Instruct
Llama · bullerwins
Params410B
Context128K
Q4_K_M245.7 GB
SE
T Search
Search · IsValorum
Params35.5B
Context256K
Smallest13.0 GB
QW
SIQ 1 35B
Qwen · AlexWortega
Params34.7B
Context256K
Q4_K_M21.2 GB
GL
Huihui GLM 4.5V Abliterated
GLM · mradermacher
Params107B
Context64K
Q4_K_M70.4 GB
LL
Llama2 70B SharpBalance
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
Llama 3.3 70B o1 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB