Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
Qwen2.5 Godzilla Coder 51B 128k
Qwen · mradermacher
Params51B
Context128K
Q4_K_M30.7 GB
XW
Xwin LM 70B V0.1
Xwin · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MO
L3.1 MOE 6X8B Dark Reasoning Dantes Peak HORROR R1 Uncensored 36B
Moe · DavidAU
Params36.2B
Context128K
Q4_K_M22.0 GB
ZE
Zen4 Coder
Zen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
SW
Swallow MX 8x7b NVE v0.1
Swallow · mradermacher
Params46.7B
Context4K
Q4_K_M28.4 GB
MI
Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
BE
Behemoth X 123B v2.1
Behemoth · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
DE
Deepseek-Prover-V2-671B-Bf16
DeepSeek · unsloth
Params671B
Context160K
Q4_K_M404.5 GB
LL
Infinity-Instruct-3M-0613-Llama3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
KA
Karnak
Karnak · mradermacher
Params40.7B
Context256K
Q4_K_M24.7 GB
HO
Holo2 235B A22B
Holo · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
QW
MLXFW Qwen3.8 Flash Next Heretic Q8 0
Qwen · the-shop
Params177B
Context256K
Smallest4.1 GB
OR
Ornith-1.5-35B
Ornith · julianmb
Params35.5B
Context256K
Smallest19.1 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · bartowski
Params235B
Context256K
Q4_K_M142.6 GB
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
NE
Source Hf Nex N2.5 Mini
Nex · ngquocvinh
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
MixtralOrochi8x7B Alt
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
SA
Salience 1.5 Pro
Salience · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
SO
SOLAR 0 70b 16bit
Solar · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
YI
blossom v3 1 yi 34b i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
Llama 3.1 70B Instruct lorablated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Swift 1.5 Qwen 3.8 Flash Next Heretic UD IQ4 XS
Qwen · trubisky
Params177B
Context256K
Smallest93.6 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B Pollard
Nemotron · PollardWeights
Params74B
Context256K
Smallest17.9 GB
UM
Umbra v2.1 MoE 4x10.7 i1
Umbra · mradermacher
Params36B
Context32K
Q4_K_M22.0 GB
MA
Mag Picaro 72B
Mag · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
MY
mythxl 70b i1
Mythxl · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen2 72B Instruct
Qwen · Qwen
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
ShiningValiant 1.2
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
UN
una xaberius 34b v1beta i1
Una · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
sheep duck llama 2 70b v1.1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB