Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · CoreWolf
Params284B
Context1024K
Smallest10.9 GB
GGUF
LL
llama-3-70B-Instruct-abliterated
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
KI
Kimibrain
Kimi · burabeeh
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LL
Reflection Llama 3.1 70B IMat
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
QW
Qwen3.6 40B Grand Intelligence Fable Fusion Uncensored Heretic
Qwen · mradermacher
Params39.5B
Context256K
Q4_K_M24.2 GB
CodingReasoningRoleplay
EU
L3.1 70B Euryale v2.2
Euryale · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
TE
Tema_Q X3
Tema · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Tool use
PE
Pearl 34B ties i1
Pearl · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
KI
Huihui Kimi Linear REAP 35B A3B Instruct Abliterated
Kimi · mradermacher
Params35.1B
Context1024K
Q4_K_M21.3 GB
Tool use
HU
Huihui4 48B A4B Abliterated
Huihui · mradermacher
Params48.1B
Context256K
Q4_K_M32.0 GB
ReasoningTool useVision
BE
beam reap 255b
Beam · nbKPS
Params255B
Context1024K
Smallest0.3 GB
GGUF
AU
Aurora Nights 103B v1.0
Aurora · TheBloke
Params103B
Context4K
Smallest43.5 GB
GGUF
GL
GLM 4.6 REAP 268B A32B Derestricted
GLM · mradermacher
Params268B
Context198K
Q4_K_M162.3 GB
GGUF
GL
L3.1 70b glitz v0.2 i1
Glitz · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
QW
calme-2.1-qwen2.5-72b
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen.Qwen3 VL 235B A22B Instruct
Qwen · DevQuasar
Params235B
Context256K
Q4_K_M142.2 GB
Tool useVision
NE
Nex N2 Pro
Nex · bartowski
Params396B
Context256K
Q4_K_M241.8 GB
ReasoningTool useVision
TE
TerminalHorizon 122B A10B
Terminalhorizon · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningTool useVision
QW
Qwen3.5 35B A3B uncensored bughunter v8
Qwen · mmp2055
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
KA
KAT Coder V2.5 Dev
Kat · IsValorum
Params34.7B
Context256K
Smallest14.6 GB
Coding
NE
Nex N2 Mini
Nex · SC117
Params34.7B
Context256K
Smallest16.5 GB
ReasoningTool useVision
QW
Qwen3.5-122B-A10B-Uncensored-HauhauCS-Aggressive
Qwen · Unrestricted
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningTool useVision
QW
Qwen3-Coder-Next
Qwen · robertdemottojr83
Params79.7B
Context256K
Q4_K_M48.5 GB
CodingTool use
SE
SEMIKONG 70B
Semikong · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
GP
Michaelwaves Amoral GPT OSS 112E
gpt-oss · mradermacher
Params102B
Context128K
Q4_K_M77.1 GB
GGUF
QW
Swift1.5 Qwen3.8 Flash Next Mixed Quant
Qwen · Baekpica
Params129B
Context256K
Smallest83.3 GB
Vision
BA
BagelWorldTour-8x7B
Bagelworldtour · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
LL
llama 65b hf
Llama · mradermacher
Params65.3B
Context2K
Q4_K_M39.3 GB
GGUF
TR
Trinity
Trinity · bartowski
Params399B
Context256K
Q4_K_M241.8 GB
ReasoningTool use
QW
Qwen3.6 35B A3B GOLD APEX
Qwen · White-Wolf13
Params34.7B
Context256K
Smallest12.1 GB
GGUF

Other sizes

Keep browsing