Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
MI
Dolphin 2.7 Mixtral 8x7b
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
PO
Poro 34B Chat
Poro · RichardErkhov
Params35.1B
Context7K
Q4_K_M22.4 GB
ST
Step 3.5 Flash REAP 128B A11B
Step · mradermacher
Params121B
Context256K
Q4_K_M72.8 GB
DA
DataWorld 35B A3B
Dataworld · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes V11 Dequantized
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
EX
ExoMind
Exomind · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen2.5 QwQ 35B Eureka Cubed i1
Qwen · mradermacher
Params34.7B
Context128K
Q4_K_M21.0 GB
GL
GLM 5.3 ewaste edition
GLM · SixVolts
Params753B
Context1024K
Smallest7.2 GB
QW
Qwen2.5 Math 72B Instruct
Qwen · mradermacher
Params72.7B
Context4K
Q4_K_M47.4 GB
SH
L3.3 Unnamed Exp 70B v0.8
Shakudo · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 Yoyo V3 42B A3B Thinking Total Recall
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
QW
72B Qwen2.5 Kunou v1
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
KI
Kimi K3 IQ1S REAP568 64K 4XSPARKS
Kimi · 0xTank
Params1780B
Context1024K
Smallest398.5 GB
MI
MiniCPM V 4.7 35B A3B
MiniCPM · WhiskyAKM
Params34.7B
Context256K
Smallest19.7 GB
LL
Meta Llama 3 70B Instruct function calling
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen 3.5 122B Uncensored Stxt
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
PE
perlthoughts_starling-lm-alpha-8x7b-moe
Perlthoughts · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
mixtral-8x22b-instruct-oh
Mistral · mradermacher
Params141B
Context64K
Smallest29.6 GB
MI
Mistral 2x22B MOE Power Codestral Ultimate 39B
Mistral · mradermacher
Params39.2B
Context32K
Q4_K_M23.6 GB
LL
Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
inclusionAI LLaDA2.2 flash
Llada · Akicou
Params100B
Context128K
Smallest59.1 GB
IN
Intern S1
InternLM · bartowski
Params235B
Context40K
Q4_K_M142.7 GB
QW
Qwen3.8 Flash Next GSQ RCO Ko Coder
Qwen · attention-is-all-i-want
Params117B
Context256K
Smallest58.4 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · k0ndra
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Ostrich 70B Llama3 251212
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
BI
BigBang v1
Bigbang · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GE
em german 70b v01
German · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
SP
Spoomplesmaxx Flash 35B A3
Spoomplesmaxx · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
FL
Flint APEX
Flint · Myric
Params39.8B
Context256K
Smallest14.9 GB
NE
NVIDIA Nemotron Labs 3 Puzzle 75B A9B
Nemotron · RemySkye
Params78.3B
Context1024K
Q4_K_M51.6 GB