Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
KI
Kimi Dev 72B
Kimi · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
CodingTool use
OR
Ornith 1.5 35B A3B Heretic Ja
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
ET
Etheria 55b v0.1
Etheria · mradermacher
Params55.6B
Context195K
Q4_K_M33.9 GB
GGUF
MA
Maxine 34B stock
Maxine · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
OR
Ornith 1.5 122B NVFP4
Ornith · prithivMLmods
Params125B
Context256K
Smallest80.9 GB
ReasoningTool useVision
WI
WizardLM 2 8x22B i1
Wizardlm · mradermacher
Params141B
Context64K
Smallest29.6 GB
GGUF
OR
Ornith 1.5 35B A3B
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
CL
Clover 35B A3B Preview BF16
Clover · IsValorum
Params34.7B
Context128K
Smallest69.4 GB
ReasoningTool use
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
SA
Sage A1.5
Sage · prithivMLmods
Params35.5B
Context256K
Smallest18.6 GB
CodingReasoningTool use
QW
mango qwen38 flashnext iq4xs
Qwen · isilicon
Params177B
Context256K
Smallest98.4 GB
ReasoningTool use
PA
saikei
Paddleocr · DaniRey
Params34.7B
Context32K
Smallest0.6 GB
ReasoningTool useVision
QW
Huihui Qwen3.6 35B A3B abliterated NVFP4
Qwen · vladimir94
Params34.7B
Context256K
Smallest3.7 GB
ReasoningTool useVision
ST
Step 3.5 Flash APEX
Step · mudler
Params197B
Context256K
Smallest76.5 GB
GGUF
YI
brucethemoose Yi 34B 200K DARE megamerge v8 iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen3.8 Flash Next OrcaUncensored IQ2 Light
Qwen · dongnhdev
Params51B
Context—
Smallest28.8 GB
GGUF
QW
Qwen3 Coder Next
Qwen · alfodaniello
Params79.7B
Context256K
Smallest19.3 GB
CodingTool use
KI
Kimi-K3
Kimi · 6block
Params2780B
Context1024K
Smallest540.4 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B Fable 5 Distill
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingVision
MI
Mistral-Small-4-119B-2603
Mistral · lmstudio-community
Params119B
Context1024K
Q4_K_M72.2 GB
Vision
MI
Mistral 2x24B MOE Power Magistral Devstral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
CodingReasoning
OP
opus v1 34b
Opus · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
KA
KAT Coder V2.5 Dev
Kat · RemySkye
Params34.7B
Context256K
Q4_K_M21.2 GB
Coding
HO
Holo4 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
MI
MiniMax M2.1 REAP 139B A10B i1
Minimax · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
ReasoningTool use
AG
Agents A1 Hf
Agents · LordNeel
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
ST
Steelskull L3.3 Mokume Gane R1 70b
Steelskull · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
Llama 3 Meerkat 70b v1.0
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
KI
fiction.live Kimiko V2 70B
Kimi · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF

Other sizes

Keep browsing