Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
GL
GLM 5.3 Flash
GLM · therickcain
Params321B
Context1024K
Smallest93.1 GB
LL
Llama3.1 70B ShiningValiant2
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
HY
Hypernova 60B 2605
Hypernova · mradermacher
Params58.7B
Context128K
Q4_K_M40.7 GB
LL
Meta Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 35B A3B Distill
Qwen · Atomic-Germ
Params35.5B
Context—
Smallest0.2 GB
TI
tigerresearch_tigerbot-70b-chat
Tigerbot · TheBloke
Params69.4B
Context2K
Q4_K_M41.7 GB
DE
DeepSeek V4.1 Flash EXL3 3.0bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
HO
Holo 3.1 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LA
Laguna S 2.1 Uncensored
Laguna · mradermacher
Params118B
Context1024K
Q4_K_M71.2 GB
SU
Superkarakuri lm chat 70b v0.1
Superkarakuri · mradermacher
Params69.2B
Context4K
Q4_K_M41.6 GB
KI
moonshotai Kimi K2 Instruct 0905
Kimi · bartowski
Params1030B
Context256K
Q4_K_M624.0 GB
QW
Qwen3 42B A3B 2507 Thinking Abliterated Uncensored TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
QW
Qwen3.8 Flash Next
Qwen · WhiskyAKM
Params177B
Context256K
Smallest2.4 GB
LL
Llama3.1 70B Chinese Chat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next Uncensored R9V IQ4 XS
Qwen · Dyluhn
Params177B
Context256K
Smallest93.7 GB
LL
Llama 4 Scout Medical MoE Fp8 Base
Llama · mradermacher
Params108B
Context10240K
Q4_K_M65.4 GB
MI
Mistral Large Instruct 2407
Mistral · legraphista
Params123B
Context32K
Smallest26.0 GB
NE
Openbuddy Nemotron 70b V23.2Q 131k
Nemotron · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
AL
ALIA 40b Instruct 2606
Alia · mradermacher
Params40.4B
Context160K
Q4_K_M24.6 GB
MO
MoMo 70B V1.1
Momo · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GR
Xai Org.Grok 2
Grok · DevQuasar
Params270B
Context128K
Q4_K_M164.1 GB
QW
Qwen3.5 35B A3B Uncensored Aggressive Safetensors
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Llama PLLuM 70B Instruct 2508
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek Coder V2 Instruct
DeepSeek · second-state
Params236B
Context160K
Q4_K_M142.5 GB
DE
DeepSeek R1 Distill Llama 70B Abliterated
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
SE
Seed OSS 36B Base Instruct Karcher Merge
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
BI
BiscuitRP 8x7B
Biscuitrp · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
AN
AntAngelMed
Antangelmed · mradermacher
Params103B
Context32K
Q4_K_M62.4 GB
PA
Palmyra Fin 70B 32K
Palmyra · bartowski
Params70.6B
Context32K
Q4_K_M42.5 GB
QW
Qwen3.5 122B A10B REAP 30
Qwen · mradermacher
Params87.7B
Context256K
Q4_K_M53.3 GB