Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
DE
ultratensor models
DeepSeek · NagusameCS
Params73.8B
Context1024K
Smallest17.1 GB
LL
nvidia Llama 3 3 Nemotron Super 49B v1 5
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
UN
UNAversal 8x7B v1beta i1
Unaversal · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
IR
Iris Mini
Iris · IsValorum
Params35.5B
Context256K
Smallest15.3 GB
MI
Air Striker Mixtral 8x7B ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
LL
Meta Llama 3.1 Chat Uncensored i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 35B A3B APEX Abliterated Blender v1
Qwen · JohnDOeNNN
Params34.7B
Context256K
Smallest16.5 GB
SA
sarvam 105b GGUF IQ2 M IQ1 M
Sarvam · Aaravomega
Params106B
Context128K
Smallest0.3 GB
QW
Qwen 3.8 flash next heretic 3.78bpw
Qwen · soyaakinohara
Params177B
Context256K
Smallest83.6 GB
WI
WizardLM 70B V1.0
Wizardlm · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
CA
Carnice MoE 35B A3B
Carnice · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
SW
Swallow-70b-hf
Swallow · mradermacher
Params69.2B
Context4K
Q4_K_M41.5 GB
OR
Ornith 1.0 35B NVFP4 MTP
Ornith · s-batman
Params35.5B
Context256K
Smallest20.3 GB
WO
WorldSim Opus 3.6 35B A3B
Worldsim · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GR
Grug 35b v2
Grug · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
DR
Draco 8x7B
Draco · mradermacher
Params46.7B
Context8K
Q4_K_M28.6 GB
QW
Qwen3.5-35B-A3B
Qwen · Mungert
Params34.7B
Context256K
Q4_K_M21.6 GB
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest203.6 GB
QW
Qwen3.6 35B A3B Heretic Cerebellum
Qwen · deucebucket
Params34.7B
Context256K
Smallest12.0 GB
QW
Qwen3-Vl-235B-A22B-Thinking
Qwen · unsloth
Params235B
Context256K
Q4_K_M142.2 GB
KI
Kimi K3
Kimi · Blackfrost-AI
Params2780B
Context1024K
Smallest1009.5 GB
KI
moonshotai Kimi K2 Thinking
Kimi · bartowski
Params1030B
Context256K
Q4_K_M624.0 GB
JA
Jais-3-32B
Jais · IFM
Params34.8B
Context512K
Q4_K_M21.1 GB
QW
JoyFox Qwen3.6 35B A3B RP Aggressive
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GL
zai org GLM 4.6
GLM · bartowski
Params357B
Context198K
Q4_K_M217.7 GB
LL
Llama3-ChatQA-1.5-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
FI
Fireplace 34b
Fireplace · mradermacher
Params34.4B
Context195K
Q4_K_M22.1 GB
LL
Llama 3.3 70B Instruct ablated i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
Ornith 1.5 122B
Ornith · prithivMLmods
Params125B
Context256K
Q4_K_M75.8 GB