Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
ornith15 35b a3b apex mtp fixed
Ornith · conFIGur8tor
Params35.5B
Context256K
Smallest17.4 GB
GGUF
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
CodingTool use
AG
Agents A1
Agents · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
FA
fable coder 35B A3B
Fable · Achilles1089
Params35.5B
Context256K
Q4_K_M21.7 GB
Coding
MA
magnum-72b-v1
Magnum · Quant-Cartel
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
ZE
MD Zephyria 42b i1
Zephyria · mradermacher
Params42B
Context128K
Q4_K_M25.2 GB
GGUF
PE
Pernicious_Prophecy_70B
Pernicious · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DE
DeepSeek V4 Flash MTP
DeepSeek · rogerai-fyi
Params291B
Context—
Smallest142.8 GB
GGUF
NE
Nemotron 3 Super 120B A12B Uncensored
Nemotron · timteh673
Params121B
Context1024K
Q4_K_M86.1 GB
GGUF
MI
orangetin_fennec-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
Tool use
ML
MLExpert
Mlexpert · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
CodingReasoningTool use
OR
Ornstein3.6 35B A3B SABER
Ornstein · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
DR
Dracarys2 72B Instruct
Dracarys · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
QW
Qwen3.5 35B A3B Gemini 3.1 Opus 4.6 Reasoning
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
QW
Qwen2.5 72B Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest23.7 GB
Tool use
ZE
models--HuggingFaceH4--zephyr-orpo-141b-A35b-v0.1
Zephyr · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
QW
Qwen3 Coder 480B A35B Instruct
Qwen · bartowski
Params480B
Context256K
Q4_K_M290.8 GB
Coding
LL
Llama 3 70B Orpo v0.1 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
Mistral Small 4 119B 2603 NVFP4
Mistral · FedericoFB
Params119B
Context1024K
Smallest70.0 GB
Vision
QW
QwenPaw Flash 35B A3B Q4 K M
Qwen · agentscope-ai
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Carnice Qwen3.6 MoE 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool use
NE
Nex N2.5 Mini
Nex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
OC
Occamy 1.0
Occamy · IsValorum
Params34.7B
Context256K
Smallest14.6 GB
ReasoningTool useVision
QW
Featherless ai.Qwerky QwQ 32B
Qwen · DevQuasar-12
Params34.9B
Context1024K
Q4_K_M22.8 GB
Reasoning
YI
ChatAllInOne-Yi-34B-200K-V1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
Tarek07 Legion V2.1 LLaMa 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3 Yoyo V3 42B A3B Thinking TOTAL RECALL Horror
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
CodingReasoning
QW
Endy Qwen3.6 CyberSec 35B A3B
Qwen · endystrike
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
KA
KAT Dev 72B Exp
Kat · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
LL
Llama3.1 70B Chinese Chat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Other sizes

Keep browsing