Large GGUF models

15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
open text detector qwen36 35b a3b oct10
Qwen · woog
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
0X
0x01 8x7b hf i1
mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
CA
Carnice MoE 35B A3B APEX
Carnice · mudler
Params34.7B
Context256K
Smallest14.3 GB
Tool use
QW
Qwen3.6 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
NO
Nontoxic PiVoT Bagel RP 34b i1
Nontoxic · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
Roleplay
PI
PiVoT MoE i1
Pivot · mradermacher
Params36B
Context32K
Q4_K_M21.8 GB
GGUF
CO
Yi Coder 9B Chat
Coder · mradermacher
Params54.3B
Context128K
Q4_K_M33.0 GB
Coding
QW
qwen38 flash next v3
Qwen · nitinpanj
Params177B
Context256K
Q4_K_M1.9 GB
GGUF
HU
Huihui3.5 67B A3B APEX
Huihui · mudler
Params67B
Context256K
Smallest27.3 GB
GGUF
DA
Darwin 36B Opus APEX
Darwin · mudler
Params34.7B
Context256K
Smallest11.5 GB
Reasoning
AT
Atom 80b
Atom · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
Reasoning
QW
Qwen3.8 35B A3B Distill
Qwen · ngquocvinh
Params35.5B
Context256K
Q4_K_M21.7 GB
GGUF
NE
Nemotron H 47B Reasoning 128K
Nemotron · bartowski
Params47B
Context1024K
Q4_K_M28.2 GB
Reasoning
MI
neversleep_noromaid-v0.4-mixtral-instruct-8x7b-zloss
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
YI
Capybara Tess Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
GR
GritLM 8x7B KTO i1
Gritlm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
YI
Yi 34B Chat
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
LL
Rombos LLM 70b Llama 3.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
KO
Kolibri 1
Kolibri · webmp3
Params78B
Context256K
Smallest22.5 GB
GGUF
YI
Yi 34B 200K DARE megamerge v8
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
DE
DeepSeek V4 Flash 0731 ROCmFP3
DeepSeek · Lucebox
Params284B
Context1024K
Smallest98.3 GB
Vision
NO
Norobara ZLoss 8x7B i1
Norobara · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
DE
Deepseek-R1
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.7 GB
CodingReasoning
IN
Intern S2 397B
InternLM · bartowski
Params403B
Context256K
Q4_K_M254.6 GB
Vision
NE
L3.3 MS Nevoria 70b
Nevoria · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
FL
flint APEX
Flint · mudler
Params39.8B
Context256K
Smallest14.8 GB
ReasoningTool use
LL
Wayfarer Large 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
FR
Frontis MA1 35B
Frontis · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
QW
Qwen3.6 35B A3B Brainwaves Nex Uncensored
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Reasoning
CO
c4ai-command-r-plus
Command R · BNK128
Params104B
Context128K
Q4_K_M62.8 GB
GGUF

Other sizes

Keep browsing