Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
Command R 35b Writer v2
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · mradermacher
Params104B
Context128K
Smallest23.2 GB
GGUF
MI
Mixtral-instruct-56B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Vision
QW
Qwen3.5-35B-A3B
Qwen · ugreen-ai
Params34.7B
Context256K
Q4_K_M22.0 GB
Vision
XL
Models Salesforce xLAM 8x22b R
Xlam · MaziyarPanahi
Params141B
Context64K
Q4_K_M38.4 GB
Tool use
MI
MiniMax M2.7
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
OC
Occamy 1.0 APEX I NanoPlus V2.1 Abliterated
Occamy · IsValorum
Params34.7B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
HE
OS Helix 35B A3B
Helix · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LL
Hermes-2-Pro-Llama-3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
QW
Qwen3.8 Flash Next Abliterated Uncensored Turbo Brilliance 50x Reasoning Instruct GSQ RCO z
Qwen · zugquants
Params177B
Context256K
Smallest83.9 GB
CodingReasoningTool use
OC
Occamy 1.0
Occamy · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool use
JA
AI21 Jamba Mini 1.7
Jamba · bartowski
Params51.6B
Context256K
Q4_K_M31.2 GB
GGUF
QW
Qwen3.5 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen3.8 Flash Next CodeUD v18a
Qwen · mtita
Params177B
Context256K
Smallest1.3 GB
ReasoningTool useVision
KE
Keural Nova v1.1
Keural · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
CO
C4Ai Command R v01
Command R · mradermacher
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
QW
Qwen3.5-35B-A3B
Qwen · byteshape
Params34.7B
Context256K
Smallest9.4 GB
Vision
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · BenMonkey11
Params177B
Context256K
Smallest68.2 GB
ReasoningTool useVision
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
CodingTool use
MA
Anthracite Org_Magnum v2 72b
Magnum · anthracite-org
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
TH
Thomson 1.0 Small
Thomson · IsValorum
Params34.7B
Context256K
Smallest14.6 GB
Vision
MI
Mistral Devstral 2507 CODER Brainstorm40x 44B
Mistral · mradermacher
Params43.6B
Context128K
Q4_K_M26.4 GB
CodingTool use
LE
leolm_leo-hessianai-70b
Leo · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
GGUF
DE
deepseek v4.1 flash gguf mirror
DeepSeek · hyukudan
Params755B
Context—
Smallest8.0 GB
GGUF
LU
Lumosia MoE 4x10.7
Lumosia · TheBloke
Params36B
Context4K
Q4_K_M20.4 GB
Roleplay
MI
Mistral Small 3.2 46B The Brilliant Raconteur II Instruct 2506
Mistral · mradermacher
Params45.2B
Context128K
Q4_K_M27.4 GB
ReasoningRoleplayVision
GL
GLM 4.6V
GLM · bartowski
Params107B
Context128K
Q4_K_M71.4 GB
ReasoningTool useVision
AN
AnubisLemonade 70B v1.1
Anubislemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
PL
Plesio 70B
Plesio · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RoleplayTool use
NE
NVIDIA Nemotron 3 Super 120B A12B BF16 heretic v2
Nemotron · Sabomako
Params121B
Context1024K
Smallest68.6 GB
ReasoningTool use

Other sizes

Keep browsing