Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LL
Nomad LLaMa 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Mixtral 34Bx2 MoE 60B i1
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
CL
ClinicalCamel 70B
Clinicalcamel · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
OR
Ornith 1.0 35B
Ornith · tashfene
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3 Coder Next REAP 48B A3B
Qwen · lovedheart
Params48.9B
Context256K
Smallest22.9 GB
IN
InternVL3 78B
Internvl · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
FL
flint MXFP4 MOE 40B A2.5B
Flint · prithivMLmods
Params39.8B
Context256K
Smallest22.2 GB
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M 768k Ctx
Qwen · mradermacher
Params42.4B
Context768K
Q4_K_M25.7 GB
QW
Qwen3.5 REAP 262B A17B abliterated
Qwen · RobinsonLabs
Params260B
Context256K
Q4_K_M158.6 GB
MI
MiniMax M2 THRIFT 55 i1
Minimax · mradermacher
Params106B
Context192K
Smallest0.2 GB
MI
cerebras/MiniMax-M2.5-REAP-172B-A10B
Minimax · mradermacher
Params173B
Context192K
Q4_K_M104.4 GB
MI
Mistralai Mixtral 8x7B Instruct v0.1
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
QW
DavidAU_Qwen3.5_40B_RHOpus4.6UCH
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
DE
Cogito-V2-Preview-Deepseek-671B-Moe
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.9 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4
Nemotron · FedericoFB
Params124B
Context1024K
Smallest78.7 GB
AQ
Aquif 3.5 Max 1205
Aquif · bartowski
Params42.4B
Context256K
Q4_K_M25.8 GB
KE
KernelBench RLVR 120b
Kernelbench · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
BA
bagel dpo 34b v0.2
Bagel · Artefact2
Params34.4B
Context195K
Q4_K_M20.7 GB
DE
Total04 DeepSeek R1 Distill Llama 70B Heretic
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 72B
Qwen · RichardErkhov
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
Llama 3.1 Swallow 70B v0.1 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
cerebras/MiniMax-M2-REAP-162B-A10B
Minimax · bartowski
Params162B
Context192K
Q4_K_M98.2 GB
QW
Niwaki Qwen3.8 Flash Next 141B A6B v4.0
Qwen · neopolita
Params141B
Context256K
Smallest61.7 GB
QW
Qwen3.5 35B A3B Heretic v2 Opus 4.6 Distilled
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.6 35B v2 MoE Ablit Heretic Uncensor Hermes MTP Vision FT
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen.Qwen3 VL 235B A22B Thinking
Qwen · DevQuasar
Params235B
Context256K
Q4_K_M142.2 GB
OR
Ornith-1.5-35B-A3B
Ornith · vultr
Params34.7B
Context256K
Q4_K_M23.3 GB
QW
XORTRON XPRT
Qwen · darkc0de
Params34.7B
Context256K
Smallest24.7 GB
VO
Void Citrus L3.3 70B
Void · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OR
Ornith 1.0 35B FP8 BLOCK MTP
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB