Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-Coder-Next
Qwen · mudler
Params79.7B
Context256K
Smallest31.4 GB
Coding
QW
Qwen3.6 35B A3B
Qwen · byteshape
Params35.5B
Context256K
Smallest10.0 GB
Vision
XL
xLAM 8x22b R
Xlam · legraphista
Params141B
Context64K
Smallest29.7 GB
Tool use
LL
Nous Hermes Llama2 70B
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
MI
MiniMax-3.1-Flash-DeRisked
Minimax · freakyskittle
Params426B
Context1024K
Q4_K_M258.0 GB
ReasoningTool useVision
0G
0GM 1.0 35B A3B 0427
mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
MI
Mistral Large Instruct 2411
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
QW
Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled APEX
Qwen · mudler
Params34.7B
Context256K
Smallest14.3 GB
Reasoning
QW
Qwen3.8-Flash-Next GSQ-RCO Coder
Qwen · DatKurai
Params117B
Context256K
Smallest58.7 GB
CodingVision
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · lmstudio-community
Params74B
Context256K
Smallest22.0 GB
Vision
QW
qwen3.8 flash coder 26gb
Qwen · Jab1718
Params42.6B
Context256K
Q4_K_M28.4 GB
Coding
K2
K2-ckpt_360
legraphista
Params65B
Context2K
Smallest14.2 GB
GGUF
BA
bagel 34b v0.5 i1
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
CodingRoleplayTool use
AI
airoboros l2 c70b 3.1.2 i1
Airoboros · mradermacher
Params69B
Context4K
Q4_K_M41.7 GB
GGUF
MI
Air Striker Mixtral 8x7B ZLoss i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
QW
Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
LI
Ling 3.0 Flash Fin
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
Tool use
HE
Hermes 4.3 36B
Hermes · bartowski
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningRoleplayTool use
DB
dbrx 16x12b instruct q4 0
Dbrx · phymbert
Params132B
Context32K
Smallest74.2 GB
GGUF
MI
migtissera_synthia-moe-v3-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · legraphista
Params104B
Context128K
Smallest23.2 GB
GGUF
BA
bagel dpo 34b v0.5 i1
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
CodingRoleplayTool use
QW
Qwen3.5 35B A3B ultra uncensored heretic
Qwen · llmfan46
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
OR
Ornith-1.5-35B
Ornith · peculiar-ragdoll
Params34.7B
Context256K
Smallest12.3 GB
GGUF
MI
MiMo-V2.6-Flash-RL
Mimo · vultr
Params309B
Context1024K
Smallest2.4 GB
ReasoningTool useVision
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B Uncensored
Nemotron · AtomicChat
Params124B
Context1024K
Smallest55.8 GB
ReasoningTool useVision
LI
Ling 3.0 flash abliterated APEX
Ling · SC117
Params127B
Context256K
Smallest60.4 GB
Reasoning
CY
Cyber Tiel Coder 35B A3B MTP TTQ
Cyber · TokenTinkerer
Params35.5B
Context256K
Q4_K_M21.6 GB
CodingReasoningTool use
YI
ehartford_dolphin-2_2-yi-34b
Yi · TheBloke
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
SN
SNEX V1
Snex · gbuzhf
Params35.5B
Context256K
Smallest12.2 GB
GGUF

Other sizes

Keep browsing