Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
SignOfFour
Qwen · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
CodingReasoning
YI
brucethemoose_capybara-tess-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
NE
Nemotron 3 Super 120B A12B
Nemotron · bartowski
Params121B
Context1024K
Q4_K_M87.0 GB
GGUF
MI
Air Striker Mixtral 8x7B ZLoss Instruct i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
GL
Huihui GLM 4.7 Flash Abliterated 57B
GLM · mradermacher
Params55.6B
Context198K
Q4_K_M33.7 GB
GGUF
QW
Winery Qwen3.8 Flash Next Cuvee
Qwen · WineryLabs
Params177B
Context256K
Smallest49.3 GB
GGUF
YI
Yi-1.5-34B-32K
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
OP
opus v1 34b i1
Opus · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
CY
Blackfrost-AI/CYBER-FROST-3.8-BF16
Cyber · 0xSojalSec
Params177B
Context256K
Q4_K_M2.6 GB
GGUF
MI
zephyr-orpo-141b-A35b-v0.1
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
MI
Midnight-Rose-70B-v2.0.3
Midnight · backyardai
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
KA
KAT Coder V2.5 Dev
Kat · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Coding
CO
commandr
Command R · DavidAU
Params35B
Context128K
Q4_K_M21.5 GB
Roleplay
QW
Qwen3.5 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
KI
Kimid V4A Q235 2k
Kimi · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
Tool use
JA
japanese stablelm base beta 70B
Japanese · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Heretic NVFP4 Experts Only
Qwen · llmfan46
Params34.7B
Context256K
Smallest20.8 GB
Vision
QW
Qwen3.5 35B A3B Base
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use
DE
DeepSeek R1 Distill Llama 70B Uncensored
DeepSeek · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
Qwen3.8 Flash Next GSQ RCO IQ2 XS
Qwen · baibairui
Params177B
Context256K
Smallest68.0 GB
GGUF
LL
MultiPL-T-CodeLlama_70b
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
Coding
YI
Yi-34B-200K
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
calme-2.1-llama3.1-70b
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
YI
Yi 34B
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Qwen3 42B A3B Stranger Thoughts Deep20x Abliterated Uncensored
Qwen · mradermacher
Params42.4B
Context40K
Q4_K_M25.7 GB
ReasoningRoleplay
LL
Llama 3.3 70B Vulpecula R1
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
QW
Qwen3.8 Flash Next NVFP4
Qwen · magnitudedev
Params177B
Context256K
Smallest127.8 GB
ReasoningTool useVision
DE
deepseek llm 67b chat i1
DeepSeek · mradermacher
Params67.4B
Context4K
Q4_K_M40.4 GB
GGUF
LL
Llama 3.3 70B Instruct Heretic
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF

Other sizes

Keep browsing