Large GGUF models
15744 GGUF models with 35B parameters and up. Sizes run from 34.1B to 20260731B parameters. The longest trained context is 10240K tokens.
FU
functionary medium v2.4
Functionary · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
AT
Athene V2 Chat
Athene · bartowski
Params73B
Context32K
Q4_K_M47.4 GB
MI
orangetin_openhermes-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
UN
una xaberius 34b v1beta
Una · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
LL
Llama 3.1 70B Instruct Jbliterated
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
DE
DeepSeek V3 Bf16
DeepSeek · bullerwins
Params671B
Context160K
Q4_K_M404.4 GB
FL
Flint-40B-A2.5B-abliterated
Flint · dima6312
Params39.8B
Context256K
Smallest22.9 GB
MI
MiniMax M3.1 Flash StrixHalo
Minimax · Harsha001
Params313B
Context1024K
Smallest96.6 GB
QW
Qwen3.8 KAT AgentWorld 35B A3B Coder
Qwen · pragmaticcs
Params34.7B
Context256K
Q4_K_M21.2 GB
BA
weyaxi_bagel-hermes-2x34b
Bagel · TheBloke
Params60.8B
Context195K
Q4_K_M36.7 GB
QW
Qwen3.6 35B A3B TinyKV
Qwen · darioooooo0o
Params35.5B
Context256K
Q4_K_M22.1 GB
MI
MiniMax M2
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.6 GB
LL
Llama 3.3 Swallow 70B Instruct v0.4
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
OpenMath2 Llama3.1 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
OD
L3-Odyssey-70B
Odyssey · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MO
Steelskull L3.3 Mokume Gane R1 70b v1.1
Mokume · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3.8 Flash Next
Qwen · Guile
Params177B
Context256K
Q4_K_M119.6 GB
QW
Qwen3 Coder 42B A3B Instruct TOTAL RECALL MASTER CODER M
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
MI
MiMo V2.6 Flash MOPD NVFP4
Mimo · ProCreations
Params310B
Context1024K
Smallest4.2 GB
QW
Qwen2.5 6x7B Six Pack Coder Instruct 38B
Qwen · mradermacher
Params42B
Context32K
Q4_K_M25.4 GB
YI
Yi 70B 200k RPMerge Franken
Yi · mradermacher
Params71.2B
Context195K
Q4_K_M42.6 GB
OR
Ornith 1.5 35B Uncensored YMQ MTP
Ornith · zerodigest
Params35.5B
Context256K
Smallest12.0 GB
YI
blossom v3 1 yi 34b
Yi · TheBloke
Params34.4B
Context4K
Q4_K_M20.7 GB
AL
ALIA 40b Instruct 2601
Alia · mradermacher
Params40.4B
Context160K
Q4_K_M24.6 GB
QW
Qwen3 Coder Next Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
CO
c4ai-command-r-v01
Command R · bartowski
Params35B
Context128K
Q4_K_M21.5 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · mradermacher
Params108B
Context10240K
Smallest22.2 GB
EV
L3.3 MS Evayale 70B
Evayale · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
UnifiedReward 2.0 Qwen 72b
Qwen · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB