Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Nomad LLaMa 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MI
Mixtral 34Bx2 MoE 60B i1
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
CL
ClinicalCamel 70B
Clinicalcamel · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
OR
Ornith 1.0 35B
Ornith · tashfene
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
QW
Qwen3 Coder Next REAP 48B A3B
Qwen · lovedheart
Params48.9B
Context256K
Smallest22.9 GB
CodingTool use
IN
InternVL3 78B
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
CodingTool useVision
FL
flint MXFP4 MOE 40B A2.5B
Flint · prithivMLmods
Params39.8B
Context256K
Smallest22.2 GB
ReasoningTool use
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 768k Ctx
Qwen · mradermacher
Params42.4B
Context768K
Q4_K_M25.7 GB
CodingReasoningTool use
QW
Qwen3.5 REAP 262B A17B abliterated
Qwen · RobinsonLabs
Params260B
Context256K
Q4_K_M158.6 GB
GGUF
MI
MiniMax M2 THRIFT 55 i1
Minimax · mradermacher
Params106B
Context192K
Smallest0.2 GB
GGUF
MI
cerebras/MiniMax-M2.5-REAP-172B-A10B
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
ReasoningTool use
MI
Mistralai Mixtral 8x7B Instruct v0.1
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
QW
DavidAU_Qwen3.5_40B_RHOpus4.6UCH
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
DE
Cogito-V2-Preview-Deepseek-671B-Moe
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.9 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4
Nemotron · FedericoFB
Params124B
Context1024K
Smallest78.7 GB
ReasoningTool useVision
AQ
Aquif 3.5 Max 1205
Aquif · bartowski
Params42.4B
Context256K
Q4_K_M25.8 GB
ReasoningTool use
KE
KernelBench RLVR 120b
Kernelbench · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
CodingTool use
BA
bagel dpo 34b v0.2
Bagel · Artefact2
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
DE
Total04 DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
QW
Qwen2.5 72B
Qwen · RichardErkhov
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
LL
Llama 3.1 Swallow 70B v0.1 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
cerebras/MiniMax-M2-REAP-162B-A10B
Minimax · bartowski
Params162B
Context192K
Q4_K_M98.2 GB
ReasoningTool use
QW
Niwaki Qwen3.8 Flash Next 141B A6B v4.0
Qwen · neopolita
Params141B
Context256K
Smallest61.7 GB
ReasoningTool use
QW
Qwen3.5 35B A3B Heretic v2 Opus 4.6 Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
QW
Qwen3.6 35B v2 MoE Ablit Heretic Uncensor Hermes MTP Vision FT
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningRoleplayTool use
QW
Qwen.Qwen3 VL 235B A22B Thinking
Qwen · DevQuasar
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningTool useVision
OR
Ornith-1.5-35B-A3B
Ornith · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
ReasoningTool useVision
QW
XORTRON XPRT
Qwen · darkc0de
Params34.7B
Context256K
Smallest24.7 GB
ReasoningTool useVision
VO
Void Citrus L3.3 70B
Void · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
OR
Ornith 1.0 35B FP8 BLOCK MTP
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CodingReasoningTool use

Other sizes

Keep browsing