Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
LL
llama 4 scout 17b 16e it
Llama · chatpig
Params110B
Context10240K
Smallest39.6 GB
WI
WizardMath 70B V1.0
Wizardmath · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
LL
Meta Llama 3 70B Instruct
Llama · LiteLLMs
Params70.6B
Context8K
Q4_K_M42.5 GB
AL
ALIA 40b Fc 2605
Alia · mradermacher
Params40.4B
Context160K
Q4_K_M24.6 GB
PX
PXA bench files
Pxa · poisonxa
Params34.7B
Context256K
Smallest10.7 GB
QW
Qwen3.8 Flash Next
Qwen · mudler
Params177B
Context256K
Smallest73.0 GB
MA
MAmmoTH2-8x7B-Plus
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
NA
Nammu_72B_Base
Nammu · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3.5 122B A10B Abliterated v1
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
Qwen AgentWorld 35B A3B
Qwen · DhruvalLabs
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Llama 3.3 70B ArliAI RPMax v1.4
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 Next 80B A3B Instruct
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
AP
Apodex 1.1 Mini
Apodex · IsValorum
Params35.5B
Context256K
Smallest15.0 GB
LL
Llama 3.3 70B Instruct Heretic
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
AS
astrollama 2 70b chat aic
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
LL
Tess-2.0-Llama-3-70B-v0.2
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MI
Dolphin 2.6 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
Llama-3-Groq-70B-Tool-Use
Llama · lmstudio-community
Params70.6B
Context8K
Q4_K_M42.5 GB
DE
DeepSeek V4.1 Flash UNCENSORED EXL3 2.9bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
OR
Ornith 1.5 Cyclos 1M Uncensored
Ornith · mradermacher
Params35.5B
Context1024K
Q4_K_M21.7 GB
MI
miqu evil dpo iMat
Miqu · InferenceIllusionist
Params69B
Context32K
Smallest14.5 GB
YI
SG Raccoon Yi 55B 200k i1
Yi · mradermacher
Params55.6B
Context195K
Q4_K_M33.3 GB
QW
Qwen3.6 35B A3B Brainwaves Nex Uncensored
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
AN
Anansi 35B A3B
Anansi · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
doctor-shotgun_mixtral-8x7b-instruct-v0.1-limarp-zloss-dare-ties
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
CA
CatNyanster 34b
Catnyanster · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
LL
Llama SEA LION v3 70B IT
Llama · aisingapore
Params70.6B
Context128K
Q4_K_M42.5 GB
NO
Nous Hermes 2 Mixtruct v0.1 8x7B DPO DARE TIES iMat
Nous · InferenceIllusionist
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
StellarBright
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB