Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
CL
Clover-35B-A3B-Preview
Clover · Diffuspace
Params34.7B
Context128K
Q4_K_M23.0 GB
QW
Qwen3.6 35B A3B Uncensored MTP
Qwen · mecha-factory
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.8 Flash Next
Qwen · jamesrogers
Params177B
Context256K
Smallest126.8 GB
QW
PAW 125B FLASH NEXT X3.1
Qwen · lackonendes
Params79.3B
Context—
Smallest1.0 GB
QW
JoyFox Qwen3.6 35B A3B RP Aggressive
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Whittle Qwen 3.8 35B A3B
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.3 GB
LL
tulu v1 llama2 70b i1
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
AI
airoboros-65b-gpt4-2.0
Airoboros · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
KI
Kimi-K2-Thinking
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
LL
Llama-3_3-Nemotron-Super-49B-V1_5
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
QW
Qwen3.5 122B A10B Abliterix
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
LL
calme 2.2 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Huihui Qwen3.8 Flash Next abliterated MTP
Qwen · htdohk
Params177B
Context256K
Q4_K_M1.9 GB
MI
Minimax-M2.5
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
GE
Genz 70b
Genz · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
Mistral Small 4 119B 2603 Heretic
Mistral · Rioky
Params119B
Context1024K
Q4_K_M72.2 GB
MI
MiniCPM V 4.7 35B A3B
MiniCPM · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO
Qwen · taurusduan
Params177B
Context256K
Smallest0.6 GB
DI
discoresearch_discolm-70b
Discolm · TheBloke
Params69B
Context8K
Q4_K_M41.4 GB
OR
Ornith 1.5 35B A3B uncensored
Ornith · ressl
Params35.5B
Context256K
Q4_K_M21.7 GB
JA
Jais-3-MoVA-36B-A4B
Jais · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
MI
Mixtral-instruct-56B
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
calme-2.2-qwen2-72b
Qwen · MaziyarPanahi
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3Vl 235b A22B Instruct
Qwen · Qwen
Params235B
Context256K
Q4_K_M142.2 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B heretic ara i1
Nemotron · spiritfather
Params121B
Context1024K
Q4_K_M86.1 GB
QW
Qwen3.8 Flash Next NVFP4 Q8 0
Qwen · CompiledThoughts
Params177B
Context—
Smallest1.5 GB
FA
Falcon
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M26.0 GB
NO
Nous Capybara limarpv3 34B i1
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
QW
Qwen2.5 72B Instruct
Qwen · ThomasBaruzier
Params72.7B
Context32K
Q4_K_M47.4 GB