Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Dolphin 2.7 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
PO
Poro 34B Chat
Poro · RichardErkhov
Params35.1B
Context7K
Q4_K_M22.4 GB
GGUF
ST
Step 3.5 Flash REAP 128B A11B
Step · mradermacher
Params121B
Context256K
Q4_K_M72.8 GB
CodingReasoningTool use
DA
DataWorld 35B A3B
Dataworld · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes V11 Dequantized
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Tool use
EX
ExoMind
Exomind · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
QW
Qwen2.5 QwQ 35B Eureka Cubed i1
Qwen · mradermacher
Params34.7B
Context128K
Q4_K_M21.0 GB
ReasoningTool use
GL
GLM 5.3 ewaste edition
GLM · SixVolts
Params753B
Context1024K
Smallest7.2 GB
ReasoningTool use
QW
Qwen2.5 Math 72B Instruct
Qwen · mradermacher
Params72.7B
Context4K
Q4_K_M47.4 GB
Tool use
SH
L3.3 Unnamed Exp 70B v0.8
Shakudo · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3 Yoyo V3 42B A3B Thinking Total Recall
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
CodingReasoningTool use
QW
72B Qwen2.5 Kunou v1
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
KI
Kimi K3 IQ1S REAP568 64K 4XSPARKS
Kimi · 0xTank
Params1780B
Context1024K
Smallest398.5 GB
CodingReasoningTool use
MI
MiniCPM V 4.7 35B A3B
MiniCPM · WhiskyAKM
Params34.7B
Context256K
Smallest19.7 GB
ReasoningTool useVision
LL
Meta Llama 3 70B Instruct function calling
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
QW
Qwen 3.5 122B Uncensored Stxt
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningTool useVision
PE
perlthoughts_starling-lm-alpha-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
GGUF
MI
mixtral-8x22b-instruct-oh
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
Tool use
MI
Mistral 2x22B MOE Power Codestral Ultimate 39B
Mistral · mradermacher
Params39.2B
Context32K
Q4_K_M23.6 GB
Coding
LL
Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
LL
inclusionAI LLaDA2.2 flash
Llada · Akicou
Params100B
Context128K
Smallest59.1 GB
GGUF
IN
Intern S1
InternLM · bartowski
Params235B
Context40K
Q4_K_M142.7 GB
Vision
QW
Qwen3.8 Flash Next GSQ RCO Ko Coder
Qwen · attention-is-all-i-want
Params117B
Context256K
Smallest58.4 GB
CodingReasoningTool use
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · k0ndra
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
LL
Ostrich 70B Llama3 251212
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
BI
BigBang v1
Bigbang · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
GE
em german 70b v01
German · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
SP
Spoomplesmaxx Flash 35B A3
Spoomplesmaxx · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningRoleplayTool use
FL
Flint APEX
Flint · Myric
Params39.8B
Context256K
Smallest14.9 GB
ReasoningTool use
NE
NVIDIA Nemotron Labs 3 Puzzle 75B A9B
Nemotron · RemySkye
Params78.3B
Context1024K
Q4_K_M51.6 GB
ReasoningTool use

Other sizes

Keep browsing