Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM 5.3 Flash
GLM · therickcain
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
LL
Llama3.1 70B ShiningValiant2
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
HY
Hypernova 60B 2605
Hypernova · mradermacher
Params58.7B
Context128K
Q4_K_M40.7 GB
Tool use
LL
Meta Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.8 35B A3B Distill
Qwen · Atomic-Germ
Params35.5B
Context—
Smallest0.2 GB
GGUF
TI
tigerresearch_tigerbot-70b-chat
Tigerbot · TheBloke
Params69.4B
Context2K
Q4_K_M41.7 GB
GGUF
DE
DeepSeek V4.1 Flash EXL3 3.0bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
GGUF
HO
Holo 3.1 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
LA
Laguna S 2.1 Uncensored
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
GGUF
SU
Superkarakuri lm chat 70b v0.1
Superkarakuri · mradermacher
Params69.2B
Context4K
Q4_K_M41.6 GB
GGUF
KI
moonshotai Kimi K2 Instruct 0905
Kimi · bartowski
Params1030B
Context256K
Q4_K_M624.0 GB
Tool use
QW
Qwen3 42B A3B 2507 Thinking Abliterated Uncensored TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoningTool use
QW
Qwen3.8 Flash Next
Qwen · WhiskyAKM
Params177B
Context256K
Smallest2.4 GB
ReasoningTool useVision
LL
Llama3.1 70B Chinese Chat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.8 Flash Next Uncensored R9V IQ4 XS
Qwen · Dyluhn
Params177B
Context256K
Smallest93.7 GB
ReasoningTool useVision
LL
Llama 4 Scout Medical MoE Fp8 Base
Llama · mradermacher
Params108B
Context10240K
Q4_K_M65.4 GB
Tool use
MI
Mistral Large Instruct 2407
Mistral · legraphista
Params123B
Context32K
Smallest26.0 GB
GGUF
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
AL
ALIA 40b Instruct 2606
Alia · mradermacher
Params40.4B
Context160K
Q4_K_M24.6 GB
Reasoning
MO
MoMo 70B V1.1
Momo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GR
Xai Org.Grok 2
Grok · DevQuasar
Params270B
Context128K
Q4_K_M164.1 GB
GGUF
QW
Qwen3.5 35B A3B Uncensored Aggressive Safetensors
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
LL
Llama PLLuM 70B Instruct 2508
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DE
DeepSeek Coder V2 Instruct
DeepSeek · second-state
Params236B
Context160K
Q4_K_M142.5 GB
Coding
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
SE
Seed OSS 36B Base Instruct Karcher Merge
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
ReasoningTool use
BI
BiscuitRP 8x7B
Biscuitrp · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
Roleplay
AN
AntAngelMed
Antangelmed · mradermacher
Params103B
Context32K
Q4_K_M62.4 GB
GGUF
PA
Palmyra Fin 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.5 122B A10B REAP 30
Qwen · mradermacher
Params87.7B
Context256K
Q4_K_M53.3 GB
ReasoningTool use

Other sizes

Keep browsing