Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
YI
Yi 34B 200K DARE megamerge v8 i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen3.5 35B A3B
Qwen · ggml-org
Params34.7B
Context256K
Smallest36.9 GB
KO
Kolibri 1
Kolibri · bartowski
Params78.1B
Context256K
Q4_K_M49.8 GB
LL
Ostrich 70B
Llama · some1nostr
Params70.6B
Context8K
Smallest34.3 GB
CO
CohereForAI aya 23 35B
Cohereforai · RichardErkhov
Params35B
Context—
Q4_K_M0.0 GB
QW
Qwen_Qwen3.5 122B A10B
Qwen · lmstudio-community
Params122B
Context256K
Q4_K_M74.2 GB
QW
Qwen3.8 35B A3B Distill
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
OR
Ornith-1.5-35B
Ornith · na0x2c6
Params35.5B
Context256K
Q4_K_M21.7 GB
HO
K2 Horizon 32B Heretic
Horizon · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
YI
ChatAllInOne-Yi-34B-200K-V1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen3.8-2.4T-A95B
Qwen · unsloth
Params2450B
Context256K
Smallest397.3 GB
QW
Qwen3.8 Flash Next FP8 Abliterated
Qwen · GCSA-AiLab
Params177B
Context256K
Q4_K_M2.8 GB
AI
Airoboros L2 70B 2.1
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
SA
Sage A1.5
Sage · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
DE
DeepSeek V4 Flash Vision Strix Halo
DeepSeek · otheru
Params284B
Context—
Smallest10.9 GB
QW
Qwen3.8 Flash Next
Qwen · FINAL-Bench
Params177B
Context256K
Q4_K_M100.2 GB
LL
OrionStar-Yi-34B-Chat-Llama
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen3.8 Flash Next FLE
Qwen · sirfyyn
Params177B
Context256K
Smallest1.5 GB
NO
nousresearch_nous-capybara-34b
Nous · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
DA
Darwin 36B Opus
Darwin · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
MI
Minicpm
MiniCPM · trithemius
Params34.7B
Context256K
Smallest15.5 GB
QW
Qwen3.6 40B Fable Fusion 6 Core Deckard Eleanor Heretic Uncensored NM DAU NEO MAX MTP
Qwen · DavidAU
Params39.1B
Context256K
Q4_K_M25.9 GB
MI
MiniCPM V 4.7 35B A3B
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Huihui Qwen3 Next 80B A3B Thinking Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
AG
Agents A1 Uncensored MTP APEX
Agents · SC117
Params35.5B
Context256K
Smallest14.3 GB
OC
Occamy 1.0 Abliterated
Occamy · gbuzhf
Params34.7B
Context256K
Smallest14.5 GB
LL
Meta Llama 3 70B Instruct
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
MiniCPM V 4.7 35B A3B APEX I MiniPlus V2.1
MiniCPM · IsValorum
Params34.7B
Context256K
Q4_K_M0.2 GB
VI
Vinci MLE 123B 1.0
Vinci · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
KA
KAT Coder V2.5 Dev APEX I MiniPlus V2.1
Kat · IsValorum
Params34.7B
Context256K
Smallest1.2 GB