Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
ultratensor models
DeepSeek · NagusameCS
Params73.8B
Context1024K
Smallest17.1 GB
GGUF
LL
nvidia Llama 3 3 Nemotron Super 49B v1 5
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
UN
UNAversal 8x7B v1beta i1
Unaversal · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
IR
Iris Mini
Iris · IsValorum
Params35.5B
Context256K
Smallest15.3 GB
ReasoningVision
MI
Air Striker Mixtral 8x7B ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
LL
Meta Llama 3.1 Chat Uncensored i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.8 35B A3B APEX Abliterated Blender v1
Qwen · JohnDOeNNN
Params34.7B
Context256K
Smallest16.5 GB
Coding
SA
sarvam 105b GGUF IQ2 M IQ1 M
Sarvam · Aaravomega
Params106B
Context128K
Smallest0.3 GB
GGUF
QW
Qwen 3.8 flash next heretic 3.78bpw
Qwen · soyaakinohara
Params177B
Context256K
Smallest83.6 GB
Vision
WI
WizardLM 70B V1.0
Wizardlm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
CA
Carnice MoE 35B A3B
Carnice · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool use
SW
Swallow-70b-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
GGUF
OR
Ornith 1.0 35B NVFP4 MTP
Ornith · s-batman
Params35.5B
Context256K
Smallest20.3 GB
Reasoning
WO
WorldSim Opus 3.6 35B A3B
Worldsim · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningRoleplay
GR
Grug 35b v2
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
ReasoningTool useVision
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
CodingReasoning
DR
Draco 8x7B
Draco · mradermacher
Params46.7B
Context8K
Q4_K_M28.6 GB
Tool use
QW
Qwen3.5-35B-A3B
Qwen · Mungert
Params34.7B
Context256K
Q4_K_M21.6 GB
Vision
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest203.6 GB
GGUF
QW
Qwen3.6 35B A3B Heretic Cerebellum
Qwen · deucebucket
Params34.7B
Context256K
Smallest12.0 GB
Vision
QW
Qwen3-Vl-235B-A22B-Thinking
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningVision
KI
Kimi K3
Kimi · Blackfrost-AI
Params2780B
Context1024K
Smallest1009.5 GB
ReasoningTool use
KI
moonshotai Kimi K2 Thinking
Kimi · bartowski
Params1030B
Context256K
Q4_K_M624.0 GB
Reasoning
JA
Jais-3-32B
Jais · IFM
Params34.8B
Context512K
Q4_K_M21.1 GB
ReasoningTool use
QW
JoyFox Qwen3.6 35B A3B RP Aggressive
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Roleplay
GL
zai org GLM 4.6
GLM · bartowski
Params357B
Context198K
Q4_K_M217.7 GB
GGUF
LL
Llama3-ChatQA-1.5-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
FI
Fireplace 34b
Fireplace · mradermacher
Params34.4B
Context195K
Q4_K_M22.1 GB
CodingTool use
LL
Llama 3.3 70B Instruct ablated i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
OR
Ornith 1.5 122B
Ornith · prithivMLmods
Params125B
Context256K
Q4_K_M75.8 GB
ReasoningTool useVision

Other sizes

Keep browsing