Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
KI
Kimi Dev 72B
Kimi · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
OR
Ornith 1.5 35B A3B Heretic Ja
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ET
Etheria 55b v0.1
Etheria · mradermacher
Params55.6B
Context195K
Q4_K_M33.9 GB
MA
Maxine 34B stock
Maxine · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
OR
Ornith 1.5 122B NVFP4
Ornith · prithivMLmods
Params125B
Context256K
Smallest80.9 GB
WI
WizardLM 2 8x22B i1
Wizardlm · mradermacher
Params141B
Context64K
Smallest29.6 GB
OR
Ornith 1.5 35B A3B
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CL
Clover 35B A3B Preview BF16
Clover · IsValorum
Params34.7B
Context128K
Smallest69.4 GB
LL
Llama-3-Swallow-70B-Instruct-v0.1
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
SA
Sage A1.5
Sage · prithivMLmods
Params35.5B
Context256K
Smallest18.6 GB
QW
mango qwen38 flashnext iq4xs
Qwen · isilicon
Params177B
Context256K
Smallest98.4 GB
PA
saikei
Paddleocr · DaniRey
Params34.7B
Context32K
Smallest0.6 GB
QW
Huihui Qwen3.6 35B A3B abliterated NVFP4
Qwen · vladimir94
Params34.7B
Context256K
Smallest3.7 GB
ST
Step 3.5 Flash APEX
Step · mudler
Params197B
Context256K
Smallest76.5 GB
YI
brucethemoose Yi 34B 200K DARE megamerge v8 iMat
Yi · Nexesenex
Params34.4B
Context195K
Q4_K_M20.7 GB
QW
Qwen3.8 Flash Next OrcaUncensored IQ2 Light
Qwen · dongnhdev
Params51B
Context—
Smallest28.8 GB
QW
Qwen3 Coder Next
Qwen · alfodaniello
Params79.7B
Context256K
Smallest19.3 GB
KI
Kimi-K3
Kimi · 6block
Params2780B
Context1024K
Smallest540.4 GB
QW
Qwen3.6 35B A3B Fable 5 Distill
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
MI
Mistral-Small-4-119B-2603
Mistral · lmstudio-community
Params119B
Context1024K
Q4_K_M72.2 GB
MI
Mistral 2x24B MOE Power Magistral Devstral Reasoning Ultimate 44B
Mistral · mradermacher
Params43.7B
Context128K
Q4_K_M26.5 GB
OP
opus v1 34b
Opus · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
KA
KAT Coder V2.5 Dev
Kat · RemySkye
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
Holo4 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
MiniMax M2.1 REAP 139B A10B i1
Minimax · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
AG
Agents A1 Hf
Agents · LordNeel
Params34.7B
Context256K
Q4_K_M21.2 GB
ST
Steelskull L3.3 Mokume Gane R1 70b
Steelskull · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 Meerkat 70b v1.0
Llama · RichardErkhov
Params70.6B
Context8K
Q4_K_M42.5 GB
KI
fiction.live Kimiko V2 70B
Kimi · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB