Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
OR
ornith15 35b a3b apex mtp fixed
Ornith · conFIGur8tor
Params35.5B
Context256K
Smallest17.4 GB
YI
dolphin-2.9.3-Yi-1.5-34B-32k
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
AG
Agents A1
Agents · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
FA
fable coder 35B A3B
Fable · Achilles1089
Params35.5B
Context256K
Q4_K_M21.7 GB
MA
magnum-72b-v1
Magnum · Quant-Cartel
Params72.7B
Context32K
Q4_K_M47.4 GB
ZE
MD Zephyria 42b i1
Zephyria · mradermacher
Params42B
Context128K
Q4_K_M25.2 GB
PE
Pernicious_Prophecy_70B
Pernicious · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek V4 Flash MTP
DeepSeek · rogerai-fyi
Params291B
Context—
Smallest142.8 GB
NE
Nemotron 3 Super 120B A12B Uncensored
Nemotron · timteh673
Params121B
Context1024K
Q4_K_M86.1 GB
MI
orangetin_fennec-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
ML
MLExpert
Mlexpert · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
OR
Ornstein3.6 35B A3B SABER
Ornstein · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
DR
Dracarys2 72B Instruct
Dracarys · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.5 35B A3B Gemini 3.1 Opus 4.6 Reasoning
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen2.5 72B Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest23.7 GB
ZE
models--HuggingFaceH4--zephyr-orpo-141b-A35b-v0.1
Zephyr · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · bartowski
Params480B
Context256K
Q4_K_M290.8 GB
LL
Llama 3 70B Orpo v0.1 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
Mistral Small 4 119B 2603 NVFP4
Mistral · FedericoFB
Params119B
Context1024K
Smallest70.0 GB
QW
QwenPaw Flash 35B A3B Q4 K M
Qwen · agentscope-ai
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Carnice Qwen3.6 MoE 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
NE
Nex N2.5 Mini
Nex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
OC
Occamy 1.0
Occamy · IsValorum
Params34.7B
Context256K
Smallest14.6 GB
QW
Featherless ai.Qwerky QwQ 32B
Qwen · DevQuasar-12
Params34.9B
Context1024K
Q4_K_M22.8 GB
YI
ChatAllInOne-Yi-34B-200K-V1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
Tarek07 Legion V2.1 LLaMa 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 Yoyo V3 42B A3B Thinking TOTAL RECALL Horror
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
QW
Endy Qwen3.6 CyberSec 35B A3B
Qwen · endystrike
Params35.5B
Context256K
Q4_K_M21.7 GB
KA
KAT Dev 72B Exp
Kat · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
LL
Llama3.1 70B Chinese Chat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB