Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
open text detector qwen36 35b a3b oct10
Qwen · woog
Params34.7B
Context256K
Q4_K_M21.2 GB
0X
0x01 8x7b hf i1
mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
CA
Carnice MoE 35B A3B APEX
Carnice · mudler
Params34.7B
Context256K
Smallest14.3 GB
QW
Qwen3.6 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
NO
Nontoxic PiVoT Bagel RP 34b i1
Nontoxic · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
PI
PiVoT MoE i1
Pivot · mradermacher
Params36B
Context32K
Q4_K_M21.8 GB
CO
Yi Coder 9B Chat
Coder · mradermacher
Params54.3B
Context128K
Q4_K_M33.0 GB
QW
qwen38 flash next v3
Qwen · nitinpanj
Params177B
Context256K
Q4_K_M1.9 GB
HU
Huihui3.5 67B A3B APEX
Huihui · mudler
Params67B
Context256K
Smallest27.3 GB
DA
Darwin 36B Opus APEX
Darwin · mudler
Params34.7B
Context256K
Smallest11.5 GB
AT
Atom 80b
Atom · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
QW
Qwen3.8 35B A3B Distill
Qwen · ngquocvinh
Params35.5B
Context256K
Q4_K_M21.7 GB
NE
Nemotron H 47B Reasoning 128K
Nemotron · bartowski
Params47B
Context1024K
Q4_K_M28.2 GB
MI
neversleep_noromaid-v0.4-mixtral-instruct-8x7b-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
YI
Capybara Tess Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GR
GritLM 8x7B KTO i1
Gritlm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
YI
Yi 34B Chat
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
Rombos LLM 70b Llama 3.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
KO
Kolibri 1
Kolibri · webmp3
Params78B
Context256K
Smallest22.5 GB
YI
Yi 34B 200K DARE megamerge v8
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
DE
DeepSeek V4 Flash 0731 ROCmFP3
DeepSeek · Lucebox
Params284B
Context1024K
Smallest98.3 GB
NO
Norobara ZLoss 8x7B i1
Norobara · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
DE
Deepseek-R1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
IN
Intern S2 397B
InternLM · bartowski
Params403B
Context256K
Q4_K_M254.6 GB
NE
L3.3 MS Nevoria 70b
Nevoria · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
FL
flint APEX
Flint · mudler
Params39.8B
Context256K
Smallest14.8 GB
LL
Wayfarer Large 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
FR
Frontis MA1 35B
Frontis · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
QW
Qwen3.6 35B A3B Brainwaves Nex Uncensored
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CO
c4ai-command-r-plus
Command R · BNK128
Params104B
Context128K
Q4_K_M62.8 GB