Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Cogito v1 Preview Llama 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
LL
Hermes-2-Theta-Llama-3-70B-32k
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
Tool use
RE
Reasoner Hermes3 70b
Reasoner · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
QW
Qwen3.8 Flash Next Uncensored ROCmFP4 FAST
Qwen · kingjones777
Params177B
Context256K
Smallest94.4 GB
ReasoningTool useVision
LL
Infinity Instruct 7M Gen Llama3_1 70B
Llama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
LL
Smaug-Llama-3-70B-Instruct-32K
Llama · mradermacher
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
MI
MiniMax M2.5 REAP 172B A10B i1
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
ReasoningTool use
QW
Qwen3.8 Flash Next
Qwen · bitlamas
Params177B
Context256K
Smallest102.5 GB
ReasoningTool use
QW
Qwen3.8 Flash Next
Qwen · Myric
Params177B
Context256K
Smallest91.7 GB
ReasoningTool useVision
ET
steelskull_etheria-55b-v0.1
Etheria · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
GGUF
YI
Dolphin 2.2 Yi 34B
Yi · second-state
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
EV
Eva Mindlink 72b
Eva · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
QW
Deepwen 3.6
Qwen · quimmedes
Params34.7B
Context256K
Smallest10.1 GB
Vision
SE
T Search
Search · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
ReasoningTool useVision
IQ
IQuest Coder V1 40B Thinking Heretic
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
CodingReasoningTool use
MI
Mixtral-8x22B-v0.1
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
QW
dolphin 2.9.2 qwen2 72b
Qwen · dphn
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
OM
Omega Sapphira L3.3 70B v1.3
Omega · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
YI
Faro Yi 34B 200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
QW
Qwen3 Coder 57B
Qwen · mradermacher
Params56.6B
Context256K
Q4_K_M34.4 GB
CodingTool use
SI
Simsema_Small 4 119B 32226
Simsema · mradermacher
Params119B
Context1024K
Q4_K_M72.2 GB
Tool use
IN
InnoSpark3.0 397B q8
Innospark · innospark
Params396B
Context256K
Smallest290.8 GB
ReasoningTool use
QW
Qwen1.5 55B Chat Cut i1
Qwen · mradermacher
Params54.8B
Context32K
Q4_K_M33.3 GB
GGUF
AI
airoboros-70b-3.3
Airoboros · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
RoleplayTool use
GP
Gpt Oss 120b
gpt-oss · SoAIHQ
Params117B
Context128K
Smallest65.4 GB
Tool useVision
CA
Cathallama 70B
Cathallama · bartowski
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SE
senku-70b
Senku · NexesQuants
Params69B
Context32K
Smallest14.1 GB
GGUF
LA
Laguna-S-2.1
Laguna · ggml-org
Params118B
Context1024K
Q4_K_M67.7 GB
ReasoningTool use
P1
P1 VL 235B A22B
axi0mX
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningTool useVision
DE
CyberNeurova DeepSeek V4 Flash abliterated
DeepSeek · cyberneurova
Params284B
Context1024K
Smallest98.8 GB
GGUF

Other sizes

Keep browsing