Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
QW
SignOfFour
Qwen · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
YI
brucethemoose_capybara-tess-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
NE
Nemotron 3 Super 120B A12B
Nemotron · bartowski
Params121B
Context1024K
Q4_K_M87.0 GB
MI
Air Striker Mixtral 8x7B ZLoss Instruct i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GL
Huihui GLM 4.7 Flash Abliterated 57B
GLM · mradermacher
Params55.6B
Context198K
Q4_K_M33.7 GB
QW
Winery Qwen3.8 Flash Next Cuvee
Qwen · WineryLabs
Params177B
Context256K
Smallest49.3 GB
YI
Yi-1.5-34B-32K
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
OP
opus v1 34b i1
Opus · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
CY
Blackfrost-AI/CYBER-FROST-3.8-BF16
Cyber · 0xSojalSec
Params177B
Context256K
Q4_K_M2.6 GB
MI
zephyr-orpo-141b-A35b-v0.1
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
MI
Midnight-Rose-70B-v2.0.3
Midnight · backyardai
Params69B
Context4K
Q4_K_M41.4 GB
KA
KAT Coder V2.5 Dev
Kat · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CO
commandr
Command R · DavidAU
Params35B
Context128K
Q4_K_M21.5 GB
QW
Qwen3.5 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
KI
Kimid V4A Q235 2k
Kimi · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
JA
japanese stablelm base beta 70B
Japanese · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
QW
Qwen3.6 35B A3B Uncensored Heretic NVFP4 Experts Only
Qwen · llmfan46
Params34.7B
Context256K
Smallest20.8 GB
QW
Qwen3.5 35B A3B Base
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next GSQ RCO IQ2 XS
Qwen · baibairui
Params177B
Context256K
Smallest68.0 GB
LL
MultiPL-T-CodeLlama_70b
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
YI
Yi-34B-200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
calme-2.1-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
YI
Yi 34B
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen3 42B A3B Stranger Thoughts Deep20x Abliterated Uncensored
Qwen · mradermacher
Params42.4B
Context40K
Q4_K_M25.7 GB
LL
Llama 3.3 70B Vulpecula R1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next NVFP4
Qwen · magnitudedev
Params177B
Context256K
Smallest127.8 GB
DE
deepseek llm 67b chat i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
LL
Llama 3.3 70B Instruct Heretic
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB